COMP233 Probability and Statistics Summer 2023 Lecture Notes 3 - Distributions
COMP233 Probability and Statistics Summer 2023 Lecture Notes 3 - Distributions
Page 1 of 36
PLEASE REFER TO MOODLE FOR NOTES ON “DISTRIBUTIONS”.
Page 3 of 36
EXAMPLE SET 9.
Solutions.
1. Experiment. Given a biased coin. P(head) = 0.8.
Coin is tossed 10 times.
P(X ≤ 7)?
P(X ≤ 7) = ∑7𝑖𝑖=0 𝑝𝑝(𝑖𝑖) = ∑7𝑖𝑖=0 𝐵𝐵(𝑖𝑖; 𝑁𝑁, 𝑝𝑝) = ∑7𝑖𝑖=0 𝐵𝐵(𝑖𝑖; 10, 0.8)
= ∑7𝑖𝑖=0�10
𝑖𝑖
� 0.8 𝑖𝑖
(0.2)10−𝑖𝑖
= 0.3222 = 1 − ∑10
𝑖𝑖=8 𝐵𝐵 (𝑖𝑖; 10, 0.8).
Page 4 of 36
𝑃𝑃(0 < 𝑋𝑋 < 5) = ∑4𝑖𝑖=1 𝑝𝑝(𝑖𝑖) = ∑4𝑖𝑖=1 𝐵𝐵(𝑖𝑖; 𝑁𝑁, 𝑝𝑝) = ∑4𝑖𝑖=1 𝐵𝐵(𝑖𝑖; 10, 0.8)
= ∑4𝑖𝑖=1�10
𝑖𝑖
� 0.8𝑖𝑖 (0.2)10−𝑖𝑖 = 0.0064. (or use Binomial table)
If these conditions are true, then X is a Poisson random variable, and the
distribution of X is a Poisson distribution.
The Poisson Dist. is the dist. of rare events. The number of earthquakes,
wars, wrong phone calls/person, or aircraft disasters in a region,
country, city, etc. per time period, are just some of the rare events.
Page 5 of 36
Let X: Poisson random variable.
𝑒𝑒 −𝜆𝜆 𝜆𝜆𝑥𝑥
P(X = x) = p(x) = p(x; λ) = x = 0, 1, 2, ….
𝑥𝑥!
E[X] = λ; Var(X) = λ.
Page 6 of 36
THEOREM. Sum of two Poisson Distributed random variables.
Let 𝑋𝑋1 : Poisson Distributed random variable with parameter 𝜆𝜆1 .
𝑋𝑋2 : Poisson Distributed random variable with parameter 𝜆𝜆2 .
If X = ∑𝑁𝑁 𝑁𝑁
𝑖𝑖=1 𝑋𝑋𝑖𝑖 then X is Poisson Distributed with parameter ∑𝑖𝑖=1 𝜆𝜆𝑖𝑖 .
E[X] =∑𝑁𝑁 𝑁𝑁
𝑖𝑖=1 𝜆𝜆𝑖𝑖 ; Var(X) =∑𝑖𝑖=1 𝜆𝜆𝑖𝑖 .
Page 7 of 36
EXAMPLE SET 10.
Problems.
1. On the average, there are 5 assembly-line failures/day. The
number of failures on different days are independent.
Let X: be the R.V. denoting the number of failures on any day.
Assume X is a Poisson R.V.
Page 8 of 36
3. It is a fact that the number of people falling out of a certain roller
coaster/day, is Poisson Dist., with mean 5.
Number of people who fall on any given day is independent of day,
and independent on number who fall on other days. Over a two-day
span, what is the prob. that the number of fallen people does not
exceed 4?
Page 9 of 36
EXAMPLE SET 10.
Solutions.
1. On the average, there are 5 assembly-line failures/day. The
number of failures on different days are independent.
Let X: be the R.V. denoting the number of failures on any day.
Assume X is a Poisson R.V.
λ = 5.
−5 5𝑖𝑖
3 𝑒𝑒
P(X < 4) = ∑3𝑖𝑖=0 𝑝𝑝(𝑖𝑖; 5) = ∑𝑖𝑖=0 = 0.265. (or use Poisson
𝑖𝑖!
table)
Over the long run, 26.5% of days will have less than 4 failures.
P(X = 4)?
𝑒𝑒 −5 54
P(X = 4) = p(4; 5) = = 0.1755. (or use Poisson
4!
table)
Page 10 of 36
D. What is the prob. there will be 4 assembly-line failures in
exactly 6 of the next 8 days? In other words, 6 of the next 8
days must each have 4 failures/day.
𝑒𝑒 −5 51
P(X = 1) = p(1; 5) = = 0.0337.
1!
∴,
B(2; 5, 0.0337) = �52� (0.0337)2 (0.9663)3 = 0.01.
P(X = 5)?
Page 11 of 36
λ = (length of highway) (prob. of exactly 1 fault on 1mi. stretch)
λ = (3000) (1/1000) = 3.
∴,
𝑒𝑒 −3 35
P(X = 5) = p(5; 3) = = 0.101.
5!
P(X ≤ 4)?
−10 10𝑖𝑖
4 𝑒𝑒
P(X ≤ 4) = ∑4𝑖𝑖=0 𝑝𝑝(𝑖𝑖; 10) = ∑𝑖𝑖=0 = 0.0293. (or use Poisson
𝑖𝑖!
table)
Page 12 of 36
EXAMPLE.
Page 13 of 36
CONTINUOUS DISTRIBUTIONS (P.D.F.’s).
EXPONENTIAL DISTRIBUTION. Parameter λ, λ > 0. e(𝜆𝜆).
The Exponential Dist. is the dist. of the time until the next earthquake,
or next war, or next wrong phone call, or next aircraft disaster. It is
the time from now. It could also be the waiting time between events
(between two people arriving), in a Poisson Process (same λ is used as
in the Poisson Process).
−𝜆𝜆𝜆𝜆
P(X = x) = f(x) = � 𝜆𝜆𝑒𝑒 𝑖𝑖𝑖𝑖 𝑥𝑥 ≥ 0
0 𝑜𝑜𝑜𝑜ℎ𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒𝑒.
Page 14 of 36
EXAMPLE SET 11.
Problems.
1. Let the R.V. X denote the number of fish caught/hour at a certain
radioactive lake.
Assume X has a Poisson Distribution with mean 1.8 fish/hour.
Compute the probability a person fishing at this lake for 1 hour:
Page 15 of 36
EXAMPLE SET 11.
Solutions.
1. Let the R.V. X denote the number of fish caught/hour at a certain
radioactive lake.
Assume X has a Poisson Distribution with mean 1.8 fish/hour.
Compute the probability a person fishing at this lake for 1 hour:
P(X = 0)?
P(X ≥ 4)?
P(X ≤ 2)?
1/3
= ∫0 1.8𝑒𝑒 −1.8𝑡𝑡 𝑑𝑑𝑑𝑑
Page 17 of 36
Page 18 of 36
Let X: Normal random variable.
1 𝑥𝑥 − 𝜇𝜇 2
1 − � �
P(X = x) = f(x) = 𝑒𝑒 2 𝜎𝜎 − ∞ < 𝑥𝑥 < ∞.
√2𝜋𝜋 𝜎𝜎
Page 19 of 36
THEOREM. Standardizing.
Let X: random variable.
E[X] = 𝜇𝜇.
Var(X) = 𝜎𝜎 2 .
𝑋𝑋− 𝜇𝜇
Z= .
𝜎𝜎
NOTA BENE.
Assume X ~ N(𝜇𝜇, 𝜎𝜎 2 ).
To compute any probabilities, P(X < x), P(X ≥ x), etc., Normal Probability
tables are required.
There are no Normal Probability tables with 𝜇𝜇 ≠ 0, 𝜎𝜎 2 ≠ 1.
A Normal Probability table with 𝜇𝜇 = 0, 𝜎𝜎 2 = 1, is called a Standard
Normal Probability table. This is the only table available to compute
probabilities for a Normal R.V.
If X ~ N(𝜇𝜇, 𝜎𝜎 2 ), 𝜇𝜇 ≠ 0, 𝜎𝜎 2 ≠ 1 ⇒ X must be transformed into a
Standard Normal R.V., Z, using the standardizing transformation
Theorem above. After standardizing, the Standard Normal Probability
table may be used to compute required probabilities.
Page 20 of 36
Page 21 of 36
Page 22 of 36
Page 23 of 36
E.G.
Let X ~ N(5, 4). (Read as: X is Normally Dist. with mean 5, and
variance 4).
A. P(X ≤ 6)?
𝑋𝑋 − 𝜇𝜇 6 − 𝜇𝜇
P(X ≤ 6) = 𝑃𝑃 � ≤ �
𝜎𝜎 𝜎𝜎
𝑋𝑋 − 5 6−5
= 𝑃𝑃 � ≤ �
2 2
1
= 𝑃𝑃 �𝑍𝑍 ≤ �
2
P(X ≤ 6) = 0.6915.
𝑋𝑋 − 𝜇𝜇 7 − 𝜇𝜇
P(X > 7) = 𝑃𝑃 � > �
𝜎𝜎 𝜎𝜎
𝑋𝑋 − 5 7−5
= 𝑃𝑃 � > �
2 2
Page 24 of 36
= 𝑃𝑃(𝑍𝑍 > 1)
= 1 – P(Z ≤ 1)
= 1 – 0.8413
C. P(X ≤ 2)?
𝑋𝑋 − 𝜇𝜇 2 − 𝜇𝜇
P(X ≤ 2) = 𝑃𝑃 � ≤ �
𝜎𝜎 𝜎𝜎
𝑋𝑋 − 5 2−5
= 𝑃𝑃 � ≤ �
2 2
−3
= 𝑃𝑃 �𝑍𝑍 ≤ �
2
= 1 – 0.9332.
P(X ≤ 2) = 0.0668.
Page 25 of 36
EXAMPLE SET 12.
Problems.
1. The amount of Marijuana which a filling machine dispenses into 6 oz.
bags is a R.V. X, having a Normal Distribution with 𝜇𝜇 = 6oz., and
𝜎𝜎 = 0.08oz.
Compute the probabilities that:
Page 26 of 36
EXAMPLE SET 12.
Solutions.
1. The amount of Marijuana which a filling machine dispenses into 6 oz.
bags is a R.V. X, having a Normal Distribution with 𝜇𝜇 = 6oz., and
𝜎𝜎 = 0.08oz.
Compute the probabilities that:
P(X ≥ 6.10)?
𝑋𝑋 − 𝜇𝜇 6.10 − 𝜇𝜇
P(X ≥ 6.10) = 𝑃𝑃 � ≥ � (standardizing)
𝜎𝜎 𝜎𝜎
𝑋𝑋 − 6 6.10 − 6
= 𝑃𝑃 � ≥ �
0.08 0.08
= 𝑃𝑃(𝑍𝑍 ≥ 1.25)
= 1 – 0.8944
Page 27 of 36
B. One of these bags will contain less than 5.82oz.?
𝑋𝑋 − 𝜇𝜇 5.82 − 𝜇𝜇
P(X < 5.82) = 𝑃𝑃 � < � (standardizing)
𝜎𝜎 𝜎𝜎
𝑋𝑋 − 6 5.82 − 6
= 𝑃𝑃 � < �
0.08 0.08
= 1 – P(Z ≤ 2.25)
= 1 – 0.9878
5.96 − 𝜇𝜇 𝑋𝑋 − 𝜇𝜇 6.04 − 𝜇𝜇
P(5.96 < X < 6.04) = 𝑃𝑃 � < < �
𝜎𝜎 𝜎𝜎 𝜎𝜎
5.96 − 6 𝑋𝑋 − 6 6.94 − 6
= 𝑃𝑃 � < < �
0.08 0.08 0.08
Page 28 of 36
= 2 P(Z < 0.5) – 1
= 2 (0.6915) – 1
THEOREM.
Let R.V.'s Xi , i = 1, 2, 3, …, n: be Normally Distributed, each with
mean μi , and variance σi2.
𝐼𝐼𝐼𝐼 𝑋𝑋 = ∑𝑛𝑛𝑖𝑖=1 𝑋𝑋𝑖𝑖 , then X is Normally Distributed, with mean
∑𝑛𝑛𝑖𝑖=1 𝜇𝜇𝑖𝑖 , and variance 𝜎𝜎 2 = ∑𝑛𝑛𝑖𝑖=1 𝜎𝜎𝑖𝑖 2 .
Xi and Xj are independent ∀𝑖𝑖𝑖𝑖 , 𝑖𝑖 ≠ 𝑗𝑗.
Page 29 of 36
EXAMPLE.
Page 30 of 36
EXAMPLE.
Page 31 of 36
300 −10𝑛𝑛
𝑃𝑃 �𝑍𝑍 ≥ � ≥ 0.90 [Nota Bene: P(Z ≥ −1.29) = 0.90]
√4𝑛𝑛
∴,
300 −10𝑛𝑛
≤ −1.29 Constraint 1.
√4𝑛𝑛
300 −10(31)
n = 31 violates Constraint 1: = −0.898 > −1.29.
�4(31)
∴,
n ≥ 32. But 𝑃𝑃(𝑆𝑆32 ≥ 300) = 0.9616 ≫ 0.90.
NOTA BENE.
If the problem was rephrased as:
Page 32 of 36
CHI-SQUARE DISTRIBUTION. Parameter n. ℵ2𝑛𝑛
Page 33 of 36
Let X: Chi-Square random variable.
If 𝛽𝛽 ∉ ℕ, 𝛽𝛽 ∈ ℝ ∶
∞
𝛤𝛤 (𝛽𝛽 ) = � 𝑒𝑒 −𝑦𝑦 𝑦𝑦 (𝛽𝛽 − 1) 𝑑𝑑𝑑𝑑.
0
If 𝛽𝛽 ∈ ℕ, 𝛽𝛽 > 0 ∶
Page 34 of 36
𝛤𝛤 (𝛽𝛽 ) = (𝛽𝛽 − 1)! 𝛤𝛤 (1) = 1.
EXAMPLE.
Let 𝑋𝑋𝑖𝑖 ∶ Normally Distributed R.V.’s. 𝐸𝐸[𝑋𝑋𝑖𝑖 ] = 0; 𝑉𝑉𝑉𝑉𝑉𝑉(𝑋𝑋𝑖𝑖 ) = 9.
𝑃𝑃�∑24 2
𝑖𝑖=1 𝑋𝑋𝑖𝑖 > 90�?
Solution.
Standardize.
Let 𝑍𝑍 = ∑24 2
𝑖𝑖=1 𝑍𝑍𝑖𝑖 .
= 𝑃𝑃�9 ∑24 2
𝑖𝑖=1 𝑍𝑍𝑖𝑖 > 90�
= 𝑃𝑃�∑24 2
𝑖𝑖=1 𝑍𝑍𝑖𝑖 > 10�
𝑃𝑃�∑24 2 2
𝑖𝑖=1 𝑋𝑋𝑖𝑖 > 90� = 𝑃𝑃 (ℵ24 > 10).
Page 35 of 36
0.975 < 𝑃𝑃(ℵ224 > 10) < 0.995.
Page 36 of 36