Of Of: Normal
Of Of: Normal
normal distribution
MesoRustic
Leftokurtic
Platyburtic
Notation
Eni nitz
End m 2 mini
Stastical undefendence
Two R.vn and y are statastical independent
if and only if
finny
f fly
r
of probability
Characteristics distribution
Marginalproperty
β
The enfected value denoted
by E x nfa
of v.v
The enfected value of constant Eb b
E axtb aE x b
Variance
2 2
Var x 0 E x a
Standard deviation
Var x x
affix if is discreate
E x U 2M
E x2 E u 2E XM ECD M
Ex U2 2m
E m
E x2 x
properties
ofvariance
zygyny um
var ax Varch
2
E axtb aeon b
Covariance
Defination
The covariance between XandY Cov X Y or ox
by
denoted
is givenby
Cov x y E x 4 114 411
coveniy 4m a Y y
Cov x x var X
Cov XM Cov Y x
Cov xD O
Cov ax Y Cov x Y
EEY Uxuy
o
If X andY are independent County
originandscale
Changeof
P Cov my
Fri Cov ng
oxoy
COV NY P oxoy
Linear in variable
Model linear in SLRM SimpleLinear
Parameter BOB
yes No regressionmodel
SLRM SLRM
yes
No not SIRM not SIRM
Mi Yi E Y ni
Ye E Yin tdi
f E T Xi is assumed to be linear in Xi
then Yi E 91mi
stochastic error term
could
Callunobserved variable that
PithxitMe not be captured hymodel
Yi Bi Bai
Yi estimator
of E Yini
Bi estimatorof β
Yi Bit β thingumated
Sample residual
value of sampleerror
conceptually Mi is analogousto Mi and canbe considered as an
estimate
of Mi
Ordinary least Squares Assumptions
residual term E Ui i
mean
ofthe error o
oftime
Cov Ma U E Min O
Handom
Variable
non stochasticity of Xi's thatis the series
ofXi is fined
in repeated samples
Cov Xi Mi 0
B2 unhart of on will not be accurate if
assumhtion is not mentioned
linearityassumption
The model must be linear in parameter as us islinear
estimation method
yi BE Pixi
Mi yi yi
one possible criteria to select BiandBE so as to make EMi
yr BS pixi o
dunding earation by N
FEE BS BIT
hence BS andBi should be choosen in sucha way
that it passes through x̅ andT
EME is minimized
Yi BI Bixis minimize
he necessary conditions requires
of minimization
SEMI O S 2EUR 0
JBS dB
2 Yi BS Bixi 1 0
2 Yi Bi Bixi Xi
R y
for of on x
E x x̅ Mi
Eximi EMEO
I EY
COV Ri Mi Exilli
2 condition Y Bd Bix o
necessary
JfE
2 Exi M BS Bix
Exit x
XLMEO
function of Xi
estimated co efficient BGand B can be sequentially computed
using the following formula
Shelf space weekly sales
6 526
3 421
6 581
a 630
3 412
9 560
6 434
3 4h3
9 590
6 570
3 346
9 672
Yon X
β Exigi
End
Substituting
Bi J Bix̅ in 2ⁿᵈ normal equation we
get
Xi Yi BSExi B EXE
XiYi J β x̅ Exi BI EXE
ñ C
Bi Cov x Y
var x
paroundmean
4ᵗʰ property Total variation in Yi maybe expressed as the sum
of two components
yi I 5 5
yield sixi Bi Bit
yi Bini
hence we E Bin
can write RSS
EYE can also bewritten as
RSS βiExc
Rss YES
RSS Eng
m
RSS β Enigi
Q ThreeVariable N D Y all have o means and went unit
Variance a 4ᵗʰ Variable is C NTD in the regressional
Cony the Globeis 0.8 In the regression Conn scope o
In the regression Don I Slote ofwhat is sum
of is on
Squarred in con
of residual theregression
of
There are 21 observation and all moments are capturedusing
asthe dunson
co
hunt C NTD
COV GP OU ND Vara
Mi 4 5 Bis x x̅
a E Di 512 20
n
C NTD
Vance Vanen Van 2 COVID
I I 2COV WID
2 vCNID
CO
22
N DY
COV GY 0.8 COV GY
0.8
Varcy 0.9 COV CIN
0 S 100 LIN OOH IOU DIY
var N
0 M COV P Y 50
venial 1
4
0.8 COUNY COULAY
0 5 Var N Car NID
0 4 IOU DIY
0.4 Cov N Y
005 vain C Y NID
005 COV NIP
COV CID 0.5 1 112
Q Yon X
Y X
3 1
5 2
6 3
Verify
if jJ
if 396 4.67
3
Y 1.5004 1.667
1.9 1 667
y
42 3 1 667
13 Host 7 607
4.67
5
Me Y Y
µ Y β pixi
Mi EMi nos plexi
J BJ Bix
Mi F 9 Bix̅ Bix
Gio
Mi Yi Yi
EY
Since it 0 x̅ x̅
1 Unbiasedness
MinimumVariance Bestness
saidto be minimum variance
An estimator is
of Best
estimator if A variance is less thanthe variance
ofanyother
estimator
Var B Vor P
Efficiency
Linearity
An estimator is said tohave linearity property if itis possibleto
express it as adenear combination
of Sample observation
Mean Saward Error MSE
Ny j TR Moore
Var β Varp
In Such a situation we are
facing a tradeoff b w two
Characteristics This notion can be expressed in formof
MSF mean Squarred error
MSE B E B BY
E B E B ECB B
E i Eci Eci B 2 B E B EG β
www.tbe
MSE B Varis Bias B
1 Asymptotic Unbaisedness
E B p
him
2 Consistency
Yi Bot Bixe hi
estimator
MOLS
where Mi follows
E Mc O
E Mi
E Mi.us O
We knowthat
β Eni Yi 5
22 m
Enif J Eni
Eni
niYi
Exe
1 E Wi o
22 Proof
2
EWiXi I
3 EWi
2
4 Bi Ewik we Botaxi Mi
B Bit Wlvi
E wine
E pi E B
wine Ew E µ
estimator
Eli β
umbaised estimator
ofβ
Q In a sample 3 observation 7 4.67 andx̅ 2
of
Xi x̅ Y 9 3
2
x x̅ 2
β 3 2 15 βO 1067
ESS EM y y
84,5 Yi 9 Y Y V2
57 yi
E Citmi 7 Yi 9 A
JC 11
Yi 5 mi 1 5 A
Gi YI A
Regresssum Sanace
Rss of
Solve with hypotheticdataset of 10 observation
Minimum Variance
Variance B E B E B EE Win
E WEME 2
E WilliMIMI
Variance B EWEE Mi
2
Varis Freedstandardengages
βo it β Ec i t Ecimi
E BP BOECI β EG Xi
ECI O
E a c Came yes
n X x̅
E BP β
G Wit G W
42 w c we 2W Ci Wi
42 EW a we 2W Ci Wi
Ckdcheck
42 EWF 3 1 wit't 2Ew wi
var BP 242 Sw Ca Ew
Wiff
E WE ECG wa Ef Ime
0
Var Bt Var B a we
vance varied
Regression without interceptor
Yi BXi Mi
yi PXi
β YiXi
XR
theVariance of B no intercept model is obtained as follows
for
I EX βXi Mi
EXE
β BEX EXIMI
12
B β
T o
E F P unbased estimator
B B EXIMI
XR
ECB EMI E E
Goodness
offit in no intercept model
TSS RSSTESS
Y 412 EM
Enigi p
Eye
Stastical on SLRM
Inference
i n B
Em
This result whenthe variance disturbance
is useful
ofthe
term is known
2
In practice hasto be estimated
I
GEESEofregression
no
ofobservation noof harameter estimated in mode Dof
intercept isalso a parameter
Hypothesis Test
Ho β O
HA BIO
note the null hypothesis is what we going totest and alternate
hypothesis the conclusion
represent is the enherementaltest
indicate that the null hypothesis is
false
To conduct a hypothesis test we calculate the
t Stastic
following
thcalculated
under β 0
off gff methylothesis
E B
FE
The reason behind calculating is as follow
in Non
n 22proof
t using this we can write
Essima
III Eggs
varia
E
it B β
E
level of Significance is the probability
ofrejecting null hypothesiswhen
it is true Also the standard error of estimator is the
standard deviation
of the sampling distribution ofthe estimator
R Regression 55
Total 55
Faire
r C
EBEIF.ee
whining your
ANOVA MSLRM
Analysis ofvariance
we notedthat TSS
ESStRSS
As before a null hypothesis is β 0
follows 212
2
also the regression sum ofSavarr divided by
distribution 242 and a n 2
If Estorsum
assuming that these two X variable are independenttheir
ratio derided
by respective
dof generates the F Statistic
F 1 11
E n 2
F Embi
Miyn 2
prognosameh
F FI R
n.ie Iyn
I
f Estat care r
fades sumgaukas
Sources variation
001
i Benisi a RSS 1
Residuals
EME n 2 ESS n 2
n 1
Qi Yi so 2978.5 Xi
629.37
stops
82 0.6149
find Sample size
GAP Todo
Q 15 new result were given varing amount oftraining
between 3 and 12 his Afterthe training their time to
the denotes duration
perform
job were recorded oftraining
in hour and Yis time todojob in minutes Thefollowing
Summary statistics are calculated
bo J bin
1.7023 1
Yi 57 857
with hours
more
of Training
iii
Conductsingletailtest
22
54
2.19
I
Stat 4.48
to 01,13 2 650
Q Estimate mean
jobtime for 9hr oftraining
and construct 951 CF
wedontknow
population 57.85 1
1.70
std.MY
henceusing t
est Xia
Yi 42055
Yi SECY to 025,13
Say foreg we have two independent Variable n n2 and econometric
Sheafication
Y Pot β it Baxai Mi
Malefleregression
Forexample Wehave two econometric Variable m N2andoureconometric
steafication
Yi BothXii RzxaitMi
In addition toSLRM assumptionwehave
p neggy.fm oysgyfr
Yi Not β Xii β2EXzi
EXiiYL BOEXiitB2EXI.tt βzEXiiX2i
X2iYi βo X2i βaEXaE B E XIIXai
Thevarianceof by
stone toefferentgiven
varieil varia
an 1 may
where un is the sample co efferent ofcorelation bwmandn
E
FI
Measuring goodness
offit
R B EMiyigty.ae EnaiYi
R is a nondecreasing thenumberof variable
functionof
independent
Adjusted 62
dgus
oldmodel Yi BotBihithi
newmodel Yi Bo BXii Baxai Minew
sumigsamht.in iian1.4kmanae9s'infamous
gression
Source Dof Means's
Tahoe of Sumof
variation Sawares
RSSdetox β Exiyi I
2
RssduetoXSX2BENiifitBERaig Rssdue.to
addition
B2 n2iyi
of X2 N 3
ESSunthenew Tssnew Rssnew
mode
TSS Tssnw Eye n l
To asses the indurdual contribution
significance of ofX2after
allowing contribution X we compute thefollowing
forthe of
F Value
Essnew n3
Rnw fold
C1 R2new In 3
Fincreases
whenthe absolute value of computed stat the
added variable becomes
of
newly 71
Yi Bo LBK
restrictedmodel
pun
Logyi dogbo Pilogh Balogkt Mi
this is an example
of linear equality restriction Bitra 1 in the
content aboveproduction function
of
Ho β B2 1
HA BitBa 1
1 t testapproach
the computed t stat
nd
fcommuted Bi Bi β B2
SE Bi B2
β 1 B Substituting in modelspecification
MEUR n k
If I the structure
can re write
of
dependent
the
Variable remains thesame then
formulationas follow duding neemanddenominator
by TSS
EMER EMEUR
M
MEUR n k
Rur R r M
irr n k
a
The following model is built to analyse the determinant factorofwage
HN BH BS O
HA Ho nottrue
prestricted
In wage 6.157 0.0457 educationt 0.0121 experiance
In wage 6.746 0.065education 0.0267Exh 0.0094tenure
0.0209age
Genome sum g.gg
N 53
residual sum 6.250
Explained 55 112 5
Residual ss 19.5
Which
ofslope co efficent stat different at St
me 6H
use Estat
F t R SIRI
1 am
F
54
Company ABC
dollar spent on Shecial incentive has higher incidence onsales
than dollar spent on advertisement
Variabe to efficient SE t P
C 396 59 3548.11 0.11 0.91
Add 18.63 8.92 2.08 0.05
incentive 30 69 3 60 8.51 0000
AN Bz 82 0 No B B2 0
HA βz β270 HA P3 Baco
Weare not usingthis
An Sincewell willinclude
stat
β β greater
thaneaualt
TItnaci acod.at varcis
ril
trombuted 1295
Significance level 0 10 isdof
21 lnig Int
Regress YY on X and 21
by usual t test
Y Bo BiXi Mi
teacheris doct
I 1 if
o otherwise
a 1 if teacheris PGradelat
0 Otherwise
graduate and
doctorate
in meansalary of
is diff
E Yi X 1 2 0 Bo t B 2
Pranddoctorate
β diff
in meansalary of
Yi Xi 0 2 1 βo B2 22
Df Ye x 0 42 0 Bo 23
mean salaryof Graduate
Suppose Y Both 2 hi
0
2
if graduate
2 L postgraduate
if doctorate
2 2
if
E y 2 0 BO
E 91 2 1 Both notgood
f 41 2 21 Bo tag
Interaction Dummy
Xi I iffemale X2 1 if doctorate
male
Of 0
if otherwise
effect these dummyvariable on clothing expenditure canbe
of
mulflicative also not only additive
E YeXp 1 2 0 BOTBI
B2
E Yi X 0 X2 1 Bot
E 47 1 1 2 1 Bo BI Bath
done
fora very longtime frame
co efficient are stable or not
dof n k dof na k
Rich Rich
800
Both poor
Bo
Ix
ouch
In Model 1 C Bo Pixi 12 Mi
21 1
iffamily is rich
21 0
if otherwise
onlydifference in intercept
We are postulating that therich has has higher Subsistence
level of consumption
c Bot β Xi XP Me
we reject Ho theconsumption
If for are deft
3ʳᵈcase
c POTBIX 2x faithi
e Bots BAX X Mi 271
Pot Bix Mi 22 0
chook cost Number
Tyne
1 349000 623
2 537000 6553
3 R 170000 400
4 0 526000 663
5 R 7,001000 563
6 R 28000 236
ORR 1401000 307
8 0 120000 146
9 0 611000 99
10 0 2461000 520
11 0 4137,000 453
12
R 1,501000 350
13 R 140000 423
14 R 130000 352
Assume model
of cost on number
conduct chow test in cost function acrossbschool
forany difference
tyke
1 cost on number
212755162126
RSS
forwhole model
MSS
forError 13037903156
1011
SSE 1 524 54838 ofenteredated
Estate 16 32
fz.ms
2 take all lo's together and R's together dono keosehostly
F
MISE
ESS 4.661961649 1010
For Regular R
RSS 888973520
7415771422286
TSS
1010
Ess 1326874 077
dofn doÑ data
p
R simplynoofParamet
F Essn Essai Fssnz R estendt 2
Essnit Essna 10
Fomhute
Ferictical.no rejectnull
F 8 062
Consequence
of Hetroscadasticity
Var Mi of
2 Bestness property
2
Var B ECP B
EE
E Enini E Mi of
all 1
2 2
n µ ph roscadastc underhomoscedasdh
Var B ME Ri valid
In
o
2
Eni
Or i
EISEI
of Oi
Var Bmeiosa Em
ENE
m oi
2
Eni
Enioi In in
I Eni 4m
as n s
Goldfeld Quandtest
Breusch Pagan fodfrey test
detect beltroscedasticity
Step 1 Estimate I Both I the byors and obtaintheresidual
Regress ME on
M to 1 1 9
homoscedasticity
Retro
Stehm Compute LM nR where n is noofobs Used to
estimate the ausatiary Regression model and R is the
determination the aurahary model
co efficient
of of regression
This LM stat
follow ftp.figihfuuendentvanaue used tocentimetres
is significant evidence
of hetroscadastudyundata
Goldfeld Quant test
2
Ho Variance Me Xi
HA Var Milk of
H
fit byOLS first and LastStehof
Scharate regression tothe
observation
5 compute residual sum Samares
of oftwo regression
and comfult Fstat
F E552 dL
Essi dfi
Matiollenealth
Yi Bo Biri Bnaki Mi
III Ii.IE
in
min U'll β xx X'Y
Variov matrix
Van B E BB BB
x1 x f u'm x1
62 X
CRACK inflationfactor
puanance
Bj 02 WIFI
SST 1 Ri 5
jan
02 E ME
SST
Ef nsi ñi
SST Var ni XR
Endogenity problems
UP Paability till
violated
educ but this get
5hPMassumption µ
Cov Raability M educ o
Bo BatM
y
B 0
n
Cov n Bot Bath
B B 104,4
ECB B Since couln.nl
ErrorinVariahhty
Properties
ofthe instrument
Relevance
1 Cov z my to
0
2 Cov ZIM Exogenity
o
EMI
to
yi
BoI
β J FIVE
Both M
g
B1 1
4221
E GE
Y
21 2 m n
his instrument
ofitself
ECB o β BIV.EC I
nt.YY
Bau Bit
EI
E BTV β E Mi M 2L 2
E 21 2 Nc x̅
β
Since Could 21 0
Weak Instrument couca n 0
L t
C thiswill absords this
willalso
corrcn.nl allaretve
avg.es
weak instrument then itis possible
Ifwe using
OLS Bias in less than
FUBiasoffice
com
2n
moments
Generalised method
of
Two stage least Savare
Cov 42 µ to
Toufya m to
but
couly M o
HO AR Akito c
If no
of instrument in 1 then IV and 2525 are the same
Bo Biya M
Proof
y 0
00
92 M
First stage
not A 2 E
92
y at Az
Second stage
BotBigit µ
y
Picasis
C0Yf
couly nitric
V Yi
AT Cov y z
FF var a
c rivance vary
couY
Masn
T
Q y BotBint Banath
ou n 1m27 0
and min unobserved
Error in variables
reported
y
y Actual
BotBrant Ranat M
y Actual value
y Reheted value
y
y Bot Binit Bama M E
covenaM7 cov mm o
yo y e
POTBIRA M
y e ni nit
y Pot Bilni c M
Bo Biguilt U Ble
Coulmu O
If eou m e no endogentlyproblem
cuu ni e e 0
Cov mile oe
TÑÑÉÉÉ
cov nie o
coven e of
Ifhaveof
one the explanatory
Variableis related with error term we
endogenity problem
β
E
β E2om
AE
ne ilimBi Bi
oez
Attenuation Bias
at
e
Plin β OBI
ability is unobserved
tests bserve d
rialulityte test2
kablitytez assyinfaT.es
Cov test 2 M e
by CFV assumption
Cov ability o
e
cs
e
Cov test 1 e 62