4.
4
Strong Law of Large Numbers
Definition: A sequence of r.vs is said to satisfy the strong law of large
numbers (SLLN) if
as
We state the following theorems without proof which are useful in checking
whether a given sequence satisfies SLLN or not.
Theorem1: (Kolmogorov’s SLLN)
This theorem is helpful when the r.vs in the sequence are independent but not
identically distributed.
Statement: Let be a sequence of independent r.vs with and
k2
for . If k2
, then the SLLN holds for the
k 1
sequence .
Theorem 2:
This theorem is helpful when the r.vs in the sequence are independent and
identically distributed (i.i.d).
Statement: The sequence of i.i.d.r.vs holds SLLN iff exists.
Theorem 3: (Borel’s SLLN):
This theorem is helpful when the sequence consists of Bernoulli trials.
Statement: For a sequence of Bernoulli trials with constant probability of
success, the SLLN holds.
Example 1: Let be a sequence of independent random variables with p.m.f.
given by
Does the SLLN hold for ?
Solution: We have and
n2 1 1
Further,
n1 n
2
n1 n
2
converges (
n1 n
p converges if ).
Hence, the SLLN holds for .
Example 2: For what value of does the SLLN hold for the sequence
Solution: We have and
k2 k 2 1
Further,
k 1
k 2 k 1 k 2 k 1 k 22
converges if
1
(
k 1 k
p
converges if ).
Thus, SLLN holds if .
Example 3: Let be a sequence of independent r.vs with p.m.f. given by
Check whether SLLN holds for or not.
Solution: We have and
n2 1
Further,
n1
1
n 2 n1 n 4
converges (
k 1 k
p converges if ).
Therefore, obeys SLLN.
Example 4: Let be a sequence of independent r.vs with p.m.f. given by
Check whether SLLN holds or not.
Solution: Here and
k2 1 1
Further
k 1 k
2
22 k
k 1
k 2 k 1 k 2 22 k
converges. Therefore, obeys the SLLN.
Example 5: Let be i.i.d.r.vs with mean and variance and as ,
for some constant , then find .
Solution: Here and .
Let . Then
By Theorem 2,
, where .
Example 6: If the i.i.d.r.vs assume the value with probability for
, examine if the SLLN holds for the sequence .
Solution: By Theorem 2, SLLN holds for i.i.d.r.vs if exists .
Here we have to verify whether is finite or not.
We have
which converges.
Thus, is finite and hence the SLLN holds for .