Correlation vs. Regression
Correlation vs. Regression
Unit 2
A S Raheja
[email protected]
9717871155
Correlation vs. Regression
Examples
Price and supply
Income & Expenditure
Correlation analysis is used to measure strength of the
association (linear relationship) between two variables
Correlation is only concerned with strength of the relationship.
No causal effect is implied with correlation.
Most widely used and widely abused statistical measure.
Reduces range of uncertainty.
Types of Correlations
Y Y
X X
- Correlation, r<0 No Correlation, r = 0
Y Y
X X
Type of Correlation
A measure of the linear association between variables
– Positive Correlation indicates positive linear relationship
– Negative Correlation indicates a negative linear relationship
– Values close to zero indicates no linear relationship
It not affected by the units of measurement for x and y
variables
– Pearson product moment correlation coefficient or Sample
correlation coefficient, r (used in case data is continuous)
It is a numerical index that reflects the linear relationship between two
variables
The values of the descriptive statistic range between a value -1 (perfect –ve
correlation) to +1(perfect positive correlation) , it is also referred to as Bi
variate
Correlation Formula 1
xy
r
xy
x y XY
1 _ _
( X X )(Y Y )
n
1 2 1 2
x n (X X )
y n (Y Y )
Where
r = sample correlation coefficient,
σxy = sample covariance
σx = sample standard deviation of x
σy = sample standard deviation of y
Calculating from Covariance
Knowing the covariance and the standard deviations of
each variable we can compute the sample correlation
coefficient, r
Covariance = 11,
σx = 1.49, σy = 7.93
1
XY n
X . Y
r
1 1
X
2
n
( X ) 2
n
Y 2
( Y ) 2
Solution
Assumed mean
1
xy n
x. y
r
1 1
n
x
2
( x ) 2
n
y 2
( y ) 2
x X a
y Y b
Spearman’s Rank Correlation
6 D
2
rs 1
N ( N 2 1)
Rules