Scribd
Upload
11 views

Regression

The document discusses linear regression, which is a simple and widely used regression technique for predictive analysis and modeling relationships between variables. It explains what regression is, when it is needed, different types of regression models including linear, polynomial and logistic regression. It then focuses on linear regression, describing the concepts of positive and negative linear relationships, and providing Python code examples to perform simple and multiple linear regression.

Uploaded by

reduanullah nawshad
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
11 views

Regression

The document discusses linear regression, which is a simple and widely used regression technique for predictive analysis and modeling relationships between variables. It explains what regression is, when it is needed, different types of regression models including linear, polynomial and logistic regression. It then focuses on linear regression, describing the concepts of positive and negative linear relationships, and providing Python code examples to perform simple and multiple linear regression.

Uploaded by

reduanullah nawshad
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 14

Parul Institute of Computer Application

Faculty Of IT and Computer Science

Machine learning Important


Algorithm

Explain Concept of Regression


With Linear Regression
What Is Regression?
Regression searches for relationships among variables. For example, you can
observe several employees of some company and try to understand how their
salaries depend on their features, such as experience, education level, role, city
of employment, and so on.
This is a regression problem where data related to each employee represents
one observation. The presumption is that the experience, education, role, and
city are the independent features, while the salary depends on them.
The dependent features are called the dependent variables, outputs,
or responses. The independent features are called the independent
variables, inputs, regressors, or predictors
When Do You Need Regression?
Regression is also useful when you want to forecast a response using a new set

of predictors. For example, you could try to predict electricity consumption of a

household for the next hour given the outdoor temperature, time of day, and

number of residents in that household.


Types of Regression models
1. Linear Regression

2. Polynomial Regression

3. Logistics Regression
1 Linear Regression
Linear regression is a quiet and simple statistical regression method used for

predictive analysis and shows the relationship between the continuous variables.

Linear regression shows the linear relationship between the independent

variable (X-axis) and the dependent variable (Y-axis), consequently called linear

regression. If there is a single input variable (x), such linear regression is called

simple linear regression. And if there is more than one input variable, such linear

regression is called multiple linear regression. The linear regression model gives

a sloped straight line describing the relationship within the variables.


1 Linear Regression

The above graph presents the linear relationship between the dependent

variable and independent variables. When the value of x (independent

variable) increases, the value of y (dependent variable) is likewise increasing.

The red line is referred to as the best fit straight line. Based on the given

data points, we try to plot a line that models the points the best.
1 Linear Regression

y= Dependent Variable.

x= Independent Variable.

a0= intercept of the line.

a1 = Linear regression coefficient.


1 Positive Linear Relationship
If the dependent variable expands on the Y-axis and the independent variable progress on X-axis,
then such a relationship is termed a Positive linear relationship.
1 Negative Linear Relationship
If the dependent variable decreases on the Y-axis and the independent variable increases on the X-
axis, such a relationship is called a negative linear relationship.
Impact of different values for learning rate
Linear Regression
Linear regression is probably one of the most important and widely used
regression techniques. It’s among the simplest regression methods. One of its
main advantages is the ease of interpreting results.

Simple Linear Regression

Simple or single-variate linear regression is the simplest case of linear regression,


as it has a single independent variable, 𝐱 = 𝑥.
Python Code For Linear Regression
from sklearn import linear_model
features = [[2],[1],[5],[10]]
labels = [27, 11, 75, 155]
clf = linear_model.LinearRegression()
clf=clf.fit(features,labels)
#predicted = clf.predict([[5]])
predicted = clf.predict([[5], [5], [2]])
print(predicted)
Output :[75. 75. 27.]
Python Code For Linear Regression
import matplotlib.pyplot as plt
from scipy import stats

x = [5,7,8,7,2,17,2,9,4,11,12,9,6]
y = [99,86,87,88,111,86,103,87,94,78,77,85,86]

slope, intercept, r, p, std_err = stats.linregress(x, y) # use of Linerreg function

def myfunc(x):
return slope * x + intercept

mymodel = list(map(myfunc, x))

plt.scatter(x, y)
plt.plot(x, mymodel)
plt.show()
End of Topic

You might also like