Scribd
Upload
131 views17 pages

L20 - Regression Analysis 1 PDF

Simple linear regression allows prediction of a dependent variable (Y) based on an independent variable (X). It finds the linear relationship between X and Y that best predicts Y from X. The real estate example showed that house price (Y) could be predicted from square footage (X) using the linear regression equation: house price = 98.24833 + 0.10977(square feet). This model had a correlation of 0.76211 and explained 58.1% of the variation in house prices.

Uploaded by

quang hoa
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
131 views17 pages

L20 - Regression Analysis 1 PDF

Simple linear regression allows prediction of a dependent variable (Y) based on an independent variable (X). It finds the linear relationship between X and Y that best predicts Y from X. The real estate example showed that house price (Y) could be predicted from square footage (X) using the linear regression equation: house price = 98.24833 + 0.10977(square feet). This model had a correlation of 0.76211 and explained 58.1% of the variation in house prices.

Uploaded by

quang hoa
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 17

Simple Linear Regression

Correlation vs. Regression


• A scatter plot can be used to show the relationship
between two variables
• Correlation analysis is used to measure the strength
of the association (linear relationship) between two
variables
– Correlation is only concerned with strength of the
relationship
– No causal effect is implied with correlation
Introduction to Regression Analysis

• Regression analysis is used to:


– Predict the value of a dependent variable based on the value of at least one independent
variable
– Explain the impact of changes in an independent variable on the dependent variable

Dependent variable: the variable we wish to predict or explain


Independent variable: the variable used to predict or explain the dependent variable
Simple Linear Regression Model
• Only one independent variable, X

• Relationship between X and Y is described by a linear function

• Changes in Y are assumed to be related to changes in X


Types of Relationships
Linear relationships Curvilinear relationships

Y Y

X X

Y Y

X X
Types of Relationships
(continued)
Strong relationships Weak relationships

Y Y

X X

Y Y

X X
Types of Relationships
(continued)
No relationship

X
Y

X
Simple Linear Regression Model

Population Random
Population Independent Error
Slope
Y intercept Variable term
Coefficient
Dependent
Variable

Yi = β 0 + β1Xi + /−ε i
Linear component Random Error
component
Simple Linear Regression Model
(continued)

Y Yi = β0 + β1Xi + εi
Observed Value
of Y for Xi

εi Slope = β1

Predicted Value Random Error for this


of Y for Xi Xi value

Intercept = β0

Xi X
Simple Linear Regression Equation (Prediction Line)
The simple linear regression equation provides an estimate of the population regression line

Estimated (or
predicted) Y Estimate of the Estimate of the
value for regression regression slope
observation i intercept

Value of X for

Yˆi = b 0 + b1X i
observation i
Interpretation of the Slope and the Intercept

• b0 is the estimated mean value of Y when the value of X is zero

• b1 is the estimated change in the mean value of Y as a result of a one-


unit change in X
Simple Linear Regression Example
• A real estate agent wishes to examine the relationship between the selling price
of a home and its size (measured in square feet)

• A random sample of 10 houses is selected


– Dependent variable (Y) = house price in $1000s
– Independent variable (X) = square feet
Simple Linear Regression Example: Data
House Price in $1000s Square Feet
(Y) (X)
245 1400
312 1600
279 1700
308 1875
199 1100
219 1550
405 2350
324 2450
319 1425
255 1700
Simple Linear Regression Example: Scatter Plot

House price model: Scatter Plot


450
400

House Price ($1000s)


350
300
250
200
150
100
50
0
0 500 1000 1500 2000 2500 3000
Square Feet
Simple Linear Regression Example: Using Excel
Simple Linear Regression Example: Excel Output
Regression Statistics
Multiple R 0.76211 The regression equation is :
R Square 0.58082
Adjusted R Square 0.52842 house price = 3 + 0.1 0977 (squ are feet)
98.2483
Standard Error 41.33032
Observations 10

ANOVA
df SS MS F Significance F
Regression 1 18934.9348 18934.9348 11.0848 0.01039
Residual 8 13665.5652 1708.1957
Total 9 32600.5000

Coefficients Standard Error t Stat P-value Lower 95% Upper 95%


Intercept 98.24833 58.03348 1.69296 0.12892 -35.57720 232.07386
Square Feet 0.10977 0.03297 3.32938 0.01039 0.03374 0.18580
Simple Linear Regression Example: Minitab Output
The regression equation is
The regression equation is:
Price = 98.2 + 0.110 Square Feet house price = 98.24833 + 0.10977(square feet)

Predictor Coef SE Coef T P


Constant 98.25 58.03 1.69 0.129
Square Feet 0.10977 0.03297 3.33 0.010

S = 41.3303 R-Sq = 58.1% R-Sq(adj) = 52.8%

Analysis of Variance

Source DF SS MS F P
Regression 1 18935 18935 11.08 0.010
Residual Error 8 13666 1708
Total 9 32600

You might also like