Bangladesh University of Business and Technology

Course Title: Introduction to Statistics

Chapter: Regression

Regression

Regression is a mathematical measure of expressing the average of relationship between

two or more variables in terms of the original units of the data. In a regression analysis
there are two types of variables. The variable whose is influenced or is to be predicted is
called dependent variable, regressed predicted or explained variable and the variable
which influences the values or is used for prediction is called independent variable or
regressor or predictor or explanator. These relationships between two variables can be
considered between say rainfall and agricultural production, price of an output and the
overall cost of product, consumer expenditure and disposable income.

Q. Discuss about regression equation and regression line.

Regression equation

Regression equations are algebraic expression of the regression lines. Since there are two
regression lines, the regression equation of on is said to describe the variation in the
values of for given changes in and the regression equation of on is used to
describe the variation in the values of for given changes in .

The regression equation of on is expressed as follows

The regression equation of on is expressed as follows

Regression line

If the variables in a bivariate distribution are related we will find that points in the scatter
diagram will cluster around some curve called the “Curve of regression”. If the curve is
straight line of, it is called the line of regression and there is said to be linear regression
between the variables, otherwise regression is said to be curvilinear. The line of
regression is the line which gives the best estimate to the value of one variable for any
specific value of the other variable.

Md. Moyazzem Hossain (Sabuj)

Lecturer in Statistics, BUBT
 Regression Analysis

Q. What are the regression coefficients?

In the line of regression of on

The coefficient ‘ ’ which is the slope of the line of regression of on is called the
coefficient of regression of on . It represents the increment in the value of the
dependent variable for a unit change in the value of the independent variable . For
notational convenience, coefficient of regression of on is denoted by .

Regression coefficient of on is

and the intercept

=

Similarly in the regression equation of on

Regression coefficient of on is

and the intercept

=

Note: Interpret and for the regression equation

** The slope represents the estimated average change in when increases by

one unit.

** The intercept represents the estimated average value of when equals

zero.
Example # 1

2 Md. Moyazzem Hossain (Sabuj)

Lecturer in Statistics, BUBT
 Regression Analysis

From the following data obtain the regression equations of on :

Sales 91 97 108 121 67 124 51 73 111 57

Purchase 71 75 69 97 70 91 39 61 80 47

Solution:

We know that,

The regression equation of on is expressed as follows

Again,

Regression coefficient of on is

Sales Purchase
91 71 8281 5041 6461
97 75 9409 5625 7275
108 69 11664 4761 7452
121 97 14641 9409 11737
67 70 4489 4900 4690
124 91 15376 8281 11284
51 39 2601 1521 1989
73 61 5329 3721 4453
111 80 12321 6400 8880
57 47 3249 2209 2679
= 900 = 700 = 87360 = 51868 = 66900

= = = 14.81

3 Md. Moyazzem Hossain (Sabuj)

Lecturer in Statistics, BUBT
 Regression Analysis

Regression equation of on is

Example # 2

The following data give the ages and blood pressure of 10 women

Age 56 42 36 47 49 42 60 72 63 55
Blood pressure
147 125 118 128 145 140 155 160 149 150

a) Find the correlation coefficient between and

b) Determine the least squares regression equation of on .

c) Estimate the blood pressure of a women whose age is 45 years

Solution:

a) We know that, Correlation coefficient between and is given by

Age Blood
Pressure

4 Md. Moyazzem Hossain (Sabuj)

Lecturer in Statistics, BUBT
 Regression Analysis

56 147 3136 21609 8232

42 125 1764 15625 5250
36 118 1296 13924 4248
47 128 2209 16384 6016
49 145 2401 21025 7105
42 140 1764 19600 5880
60 155 3600 24025 9300
72 160 5184 25600 11520
63 149 3969 22201 9387
55 150 3025 22500 8250
= 522 = 1417 = 28348 = 202493 = 75188

b) We know that, the regression equation of on is expressed as follows

Again, Regression coefficient of on is

= =

Regression equation of on is

c) When then

Hence the most likely blood pressure of women of 45 years is 134.

5 Md. Moyazzem Hossain (Sabuj)

Lecturer in Statistics, BUBT
 Regression Analysis

Compare the correlation analysis with regression analysis.

Correlation Regression
1) Correlation coefficient is Regression co-efficients are not
symmetric i.e. symmetric in and i.e.
2) Correlation co-efficient is a The regression co-efficient are
relative measure of the linear absolute measures representing the
relationship between and and change in the value of the variable (
is independent of the units of the ) for a unit change in the variable ( ).
measurement. If is a pure number
lying between 1.

3) Correlation analysis has limited 3) Regression analysis studies linear as

applications as it is confined only well as non-linear relationship between
to the study of linear relationship the variables and therefore has much
between the variables. wider applications.

Q. What are the uses of regression analysis?

Uses:

The relation can be used for predictive purpose.

Regression analysis is widely used in statistical estimation of demand curves,

supply curves, production functions; cost functions, consumption function etc.

6 Md. Moyazzem Hossain (Sabuj)

Lecturer in Statistics, BUBT