Multiple Linear Regression (MLR)
Multiple Linear Regression (MLR)
REGRESSION
(MLR)
W I T H S P SS
INTRODUCTION
What is MLR
Multiple Regression is a statistical method for
estimating the (linear) relationship between a
dependent variable and two or more
independent (or predictor) variables.
Can you have just one IV and one DV? Of
course, but that would be called Simple Linear
Regression.
PURPOSE
Assess the overall model fit
Test the individual contribution of IV(s) to DV
Describe the nature of relationship between IVs and DV
Predict the value of DV
Regression analysis is used to produce an equation that
will predict a dependent variable using one or more
independent variables. This equation has the form:
y = b0 + b1x1+b2X2 +
y = mx+c
ASSUMPTIONS
Your dependent variable should be Scale(interval/
ratio)
You have two or more independent variables, which
can be either in scale (i.e., an interval or ratio
variable) or categorical (i.e., an ordinal or nominal
variable).
You should have independence of observations
ASSUMPTIONS
There needs to be a linear relationship between (a)
the dependent variable and each of your independent
variables, and (b) the dependent variable and the
independent variables collectively.
Your data needs to show homoscedasticity!
There should be no significant outliers
Your data must not show multicollinearity, which
occurs when you have two or more independent
variables that are highly correlated with each other.
WHICH METHOD?
1. ENTER METHOD:
Research questions
How accurate can score be predicted from a linear
combination of all three predictors (Social,
attitude, home support)?
How much does each independent (predictor)
variable uniquely contributed to that relationship?
WHICH METHOD?
1.STEPWISE METHOD:
.In stepwise regression not all independent (predictor)
variables, e.g. social, attitude, home support, may end up in
the equation, therefore this method should ensure that you
end up with the smallest possible set of predictor variables
included.
Research questions
.Which predictor variables (in sequence) significantly
contributed towards the DV.
EXAMPLE
We want to know which of these factors (social,
attitude, and home support) significantly influence
exam score.
score=f(social environment, attitude, home support).
dependent variable= score
Independent variable= social, attitude, home
DATA
OUTPUT
OUTPUT
VARIATION
Unpredicted variation
Total variation
in Y
Variation that can be
predicted by IVs
we have
OUTPUT
OUTPUT
y=mx+c
score=2.167H-16.6
or:
y = C + b1x1+b2X2 +
y = -16.6+2.167H
OUTPUT
END