Regression Analysis
Regression Analysis
Regression
ANALYSIS Techniques
WHAT IS REGRESSION
ANALYSIS?
Regression analysis is a set of
statistical methods used for the
estimation of relationships between
a dependent variable and one or
more independent variables. It can
be utilized to assess the strength of
the relationship between variables
and for modeling the future
relationship between them.
TYPES OF REGRESSION
Number of Scale of Scale of
independent measurement measurement
variables dependent independent
variable variable
Simple linear one metric metric,
Regression ordinal,
nominal
Multiple multiple metric metric,
lineare ordinal,
Regression nominal
Logistic multiple ordinal, metric,
Regression nominal ordinal,
nominal
TYPES OF REGRESSION
1. Simple Linear Regression – One
independent variable.
2. Multiple Linear Regression –
Multiple independent variables.
3. Logistic Regression – Used for
classification problems.
SIMPLE LINEAR
REGRESSION
Simple linear regression is a model that assesses
the relationship between a dependent variable
and an independent variable. The simple linear
model is expressed using the following equation:
Y = a + bX
Where:
•Y – Dependent variable
•X – Independent (explanatory) variable
•a – Intercept
•b – Slope
MULTIPLE LINEAR
REGRESSION
Multiple linear regression analysis is essentially similar
to the simple linear model, with the exception that
multiple independent variables are used in the model.
The mathematical representation of multiple linear
regression is:
Y = a + bX1 + cX2 + dX3
Where:
•Y – Dependent variable
•X1, X2, X3 – Independent (explanatory) variables
•a – Intercept
•b, c, d – Slopes
MULTIPLE LINEAR
REGRESSION
Multiple linear regression follows the same
conditions as the simple linear model. However,
since there are several independent variables in
multiple linear analysis, there is another mandatory
condition for the model:
•Non-collinearity: Independent variables should
show a minimum correlation with each other. If the
independent variables are highly correlated with
each other, it will be difficult to assess the true
relationships between the dependent and
independent variables.
LOGISTIC REGRESSION
Logistic regression is a special case of
regression analysis and is used when
the dependent variable is nominally scaled.
This is the case, for example, with the variable
purchase decision with the two values buys a
product and does not buy a product.
The following equation represents logistic
regression:
The logistic model is based on the logical
function. The special thing about the logistic
function is that for values between minus and
plus infinity, it always assumes only values
between 0 and 1.
APPLICATIONS OF
REGRESSION
• Business: Sales forecasting, revenue
prediction.
• Healthcare: Disease prediction.
• Urban Planning: Traffic congestion
analysis.
CONCLUSION
• Regression is a powerful tool for
understanding data relationships.
• Choosing the right type of
regression depends on the problem
type.
THANK YOU!