Scribd
Upload
2 views

Assignment7

This document outlines the procedure for implementing a Linear Regression model using Python in a Jupyter notebook as part of an Artificial Intelligence & Machine Learning Lab. It includes prerequisites, library imports, dataset handling, and the steps to create and visualize the regression model. The program demonstrates the generation of a dataset, model training, prediction, and evaluation using metrics like Mean Squared Error and R^2 Score.

Uploaded by

vaishali.plahire
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
2 views

Assignment7

This document outlines the procedure for implementing a Linear Regression model using Python in a Jupyter notebook as part of an Artificial Intelligence & Machine Learning Lab. It includes prerequisites, library imports, dataset handling, and the steps to create and visualize the regression model. The program demonstrates the generation of a dataset, model training, prediction, and evaluation using metrics like Mean Squared Error and R^2 Score.

Uploaded by

vaishali.plahire
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

People’s Education Society

P.E.S. COLLEGE OF ENGINEERING


NAGSENVANA, AURANGABAD

DEPARTMENT: Department of Computer Science and Engineering


CLASS: TY ECE LABORATORY: Lab 4
& ETC
SUBJECT: Artificial Intelligence & Machine Learning Lab
Semester-VI Experiement No. 7: To implement Linear Regression model in jupyter
notebook.

.Prerequisites

 Familiarity with the Anaconda Environment

 Familiarity with Python

1. Import the Relevant Libraries

 NumPy — used to perform mathematical operations mainly using multi-dimensional arrays.

 pandas — used for data manipulation and analysis.

 matplotlib — it is a plotting library as a component of NumPy

 statsmodels — it is used to explore data, estimate statistical models and perform statistical
tests.

2. Import the Dataset

After importing the libraries, you can import/load the data into the notebook using the pandas
method read_csv() (for CSV files) or read_excel() (for excel files).

3. Descriptive Statistics

It is a good practice beforehand to get apprised with the descriptive statistics as it helps us to
understand the dataset (eg. — are there any outliers present, etc.)
4. Create Your First Linear Regression

Declare the Dependent and Independent Variables

To create a linear regression, you’ll have to define the dependent (targets) and the independent
variable(s) (inputs/features).

We have to predict GPA based on SAT scores, so our dependent variable would be GPA and the
independent variable would be SAT.

Explore the Data

We can plot the data using:

matplotlib.pyplot(independent variable, dependent variable)

(pyplot arguments — The first argument would be the data to be plotted on the x-axis, and the second
argument would be the data to be plotted on the y-axis).

Linear Regression

To perform a linear regression we should always add the bias term or the intercept (b0). We can do
this using the following method:

statsmodels.add_constant(independent_variable)

It’d create a new bias column equal in length to the independent variable, which consists only of 1's.

Let’s fit the Linear Regression model using the Ordinary Least Squares (OLS) model with the
dependent variable and an independent variable as the arguments.

5. Plot the Regression Line

To plot the regression line on the graph, simply define the linear regression equation, i.e., y_hat = b0
+ (b1*x1)

b0 = coefficient of the bias variable

b1 = coefficient of the input/s variables


and finally, plot the regression line using matplotlib.pyplot()

Program:

import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
from sklearn.model_selection import train_test_split
from sklearn.linear_model import LinearRegression
from sklearn.metrics import mean_squared_error, r2_score

# Generate a simple dataset


np.random.seed(0)
X = 2 * np.random.rand(100, 1)
y = 4 + 3 * X + np.random.randn(100, 1)

# Convert to DataFrame for easier manipulation


data = pd.DataFrame(np.hstack((X, y)), columns=['X', 'y'])

# Split the data into training and testing sets


X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2,
random_state=42)

# Create the model


model = LinearRegression()

# Train the model


model.fit(X_train, y_train)

# Make predictions
y_pred = model.predict(X_test)

# Calculate the mean squared error


mse = mean_squared_error(y_test, y_pred)

# Calculate the R^2 score


r2 = r2_score(y_test, y_pred)

print(f"Mean Squared Error: {mse}")


print(f"R^2 Score: {r2}")

# Plot the training data


plt.scatter(X_train, y_train, color='blue', label='Training data')

# Plot the testing data


plt.scatter(X_test, y_test, color='green', label='Testing data')

# Plot the regression line


plt.plot(X_test, y_pred, color='red', linewidth=2, label='Regression line')
plt.xlabel('X')
plt.ylabel('y')
plt.legend()
plt.show()

Output:

Conclusion:
In this exercise, we implemented a Linear Regression model from scratch using Python and the
scikit-learn library

Prepared By H.O.D

Prof. B.S.Pawar Dr. V.B.Kamble

You might also like