L1 Introduction 2023
L1 Introduction 2023
Regression Analysis
1
Historical Origin of the Term Regression
● Introduced by Francis Galton.
● Tendency for tall parents to have tall children and for short parents to
have short children, the average height of children born of parents of a
given height tended to move or “regress” toward the average height in
the population as a whole.
● Finance examples
Statistical versus Deterministic Relationships
● In statistical relationships among variables we deal with random or
stochastic variables, that is, variables that have probability
distributions. Eg. dependence of crop yield on temperature, rainfall,
sunshine, and fertilizer.
● Every particle in the universe attracts every other particle with a force
directly proportional to the product of their masses and inversely
proportional to the square of the distance between them
Regression versus Causation
● A statistical relationship in itself cannot logically imply causation.
Regression versus Correlation
● In correlation analysis, we measure the strength or degree of linear
association between two variables.
● Most empirical work based on time series data assumes that the
underlying time series is stationary.