Scribd
Upload
4 views

Unit 2linear Regression Bayesian Learning

Regression is a supervised learning technique used to predict a continuous output variable from one or more predictor variables. It models the relationship between dependent and independent variables. Linear regression models this relationship as a linear equation to predict continuous variables like temperature or salary. Logistic regression instead predicts non-continuous target variables that are categorical, like probabilities of an event occurring or not. It models the relationship using a logistic function to output probabilities between 0 and 1.

Uploaded by

iamutkarshdube
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
4 views

Unit 2linear Regression Bayesian Learning

Regression is a supervised learning technique used to predict a continuous output variable from one or more predictor variables. It models the relationship between dependent and independent variables. Linear regression models this relationship as a linear equation to predict continuous variables like temperature or salary. Logistic regression instead predicts non-continuous target variables that are categorical, like probabilities of an event occurring or not. It models the relationship using a logistic function to output probabilities between 0 and 1.

Uploaded by

iamutkarshdube
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 12

Unit - 2

Part -1
Regression
WHAT IS REGRESSION?
• Regression is a supervised learning technique which helps in finding the
correlation between variables and enables us to predict the continuous
output variable based on the one or more predictor variables.
• Regression analysis is a statistical method to model the relationship
between a dependent (target) and independent (predictor) variables with
one or more independent variables.
• More specifically, Regression analysis helps us to understand how the
value of the dependent variable is changing corresponding to an
independent variable when other independent variables are held fixed.
• It predicts continuous/real values such as temperature, age, salary,
price, etc.
REGRESSION(CONT’D)
• In Regression, we plot a graph between the variables which best fits the
given datapoints, using this plot, the machine learning model can make
predictions about the data.
• In simple words, "Regression shows a line or curve that passes through
all the datapoints on target-predictor graph in such a way that the
vertical distance between the datapoints and the regression line is
minimum.
Examples:
• Prediction of rain using temperature and other factors
• Determining Market trends
• Prediction of road accidents due to rash driving
TERMINOLOGIES
• Dependent Variable: The main factor in Regression analysis which we want to predict or
understand is called the dependent variable. It is also called target variable.
• Independent Variable: The factors which affect the dependent variables or which are used to
predict the values of the dependent variables are called independent variable, also called as
a predictor.
• Outliers: Outlier is an observation which contains either very low value or very high value in
comparison to other observed values. An outlier may hamper the result, so it should be
avoided.
• Multicollinearity: If the independent variables are highly correlated with each other than
other variables, then such condition is called Multicollinearity. It should not be present in the
dataset, because it creates problem while ranking the most affecting variable.
• Underfitting and Overfitting: If our algorithm works well with the training dataset but not
well with test dataset, then such problem is called Overfitting. And if our algorithm does not
perform well even with training dataset, then such problem is called underfitting.
TYPES OF REGRESSION
LINEAR REGRESSION
• Linear regression is a statistical regression method which is used for predictive
analysis.
• It is one of the very simple and easy algorithms which works on regression and
shows the relationship between the continuous variables.
• It is used for solving the regression problem in machine learning.
• Linear regression shows the linear relationship between the independent variable (X-
axis) and the dependent variable (Y-axis), hence called linear regression.
• If there is only one input variable (x), then such linear regression is called simple
linear regression. And if there is more than one input variable, then such linear
regression is called multiple linear regression.
• The relationship between variables in the linear regression model can be explained
using the below image. Here we are predicting the salary of an employee on the
basis of the year of experience.
TYPES OF REGRESSION(CONT’D)

Below is the mathematical equation for Linear regression:


Y= mX+c

Here, Y = dependent variables (target variables),


X=Independent variables (predictor variables),
m= Slope and C= Intercept
Regression
LOGISTIC REGRESSION
DIFFERENCE B/W LINEAR AND LOGISTIC REGRESSION

You might also like