Lecturer 3
Lecturer 3
CHAPTER 3: PROBABILITY
TERMS USED IN PROBABILITY THEORY
• Experiment
In probability term, an experiment is defined as a process
which generates a well-defined outcome that is not
predictable in advance, but where all possible outcomes are
known.
• Sample space, S
When we write down all the possible outcomes of our
experiment, we have defined the sample space of the
experiment. The possible outcomes in S are listed in curly
brackets, { }.
Example:
Experiment Sample space
Selecting an item off an
assembly line for inspection S = {Defective, Non-defective}
Throwing a coin S = {Head, Tail}
Tossing two coins S = {(H,H), (H,T), (T,H), (T,T)} Demand for
a new item S = {0, 1, 2, 3, 4,…, ∞} Rolling a dice once S =
{1, 2, 3, 4, 5, 6}
Rolling a pair of dice S = { (1,1), (1,2), (1,3), (1,4), (1,5), (1,6) (2,1),
(2,2), (2,3), (2,4), (2,5), (2,6)
(3,1), (3,2), (3,3), (3,4), (3,5), (3,6)
(4,1), (4,2), (4,3), (4,4), (4,5), (4,6)
(5,1), (5,2), (5,3), (5,4), (5,5), (5,6)
(6,1), (6,2), (6,3), (6,4), (6,5), 6,6)}
• Events
An event is a set of outcomes which satisfies a given
condition. It is a subset of the sample space. The event is said
to have occurred if the outcome of the experiment (when it is
performed) is contained in the event set.
Chapter 3 – Page 1
Example:
Experiment Possible events
(a) Rolling a die Event A = obtaining a 5 = {5}
Event B = obtaining an even number = {2, 4, 6}
(b) Tossing two Event C = getting at least 1 head = {HT, TH, HH}
coins Event D = getting exactly 1 head = {HT, TH}
• Venn diagram
A Venn diagram is a simple pictorial representation of the
relationships between events.
S
Events
• Complement of an event
The complement of an event A is the event that A does not
occur. It is denoted by contained in event A. Either A
Aand contains all the or
experimental A is
outcomes that are not
certain to occur when the experiment is carried out as both
events together contain all the outcomes in the sample space.
S
AA
Chapter 3 – Page 2
• Union of Events
Let A and B be two events defined in a sample space. The
union of events A and B is the collection of all outcomes that
belong
either to A or B or to both A A B∪ .
and B and is denoted by
S AB
• Intersection of Events
Let A and B be the two events defined in a sample space. The
intersection of A and B represents the collection of all outcomes
that are common to both A A B∩ .
and B and is denoted by
S
A B
PROBABILITY, P
Chapter 3 – Page 3
➢ Two properties of probability
o The sum of the probabilities of all possible outcomes
of an experiment must be one.
o The smallest value that probability can have is 0
(denoting impossibility) and the largest value it can
have is 1 (denoting a certainty). Thus,
0 ≤ P(A) ≤ 1
belong to event A ≡total
Let n(A) n(S) number of outcomes for the
Then, experiment
≡total number of outcomes
n(A)
P(A)
=
The probability of an n(S)
event A, Example:
A fair die is thrown. Let E be the event “the number is odd” and
F be the event “the number is greater than 4”.
(i) State the sample space.
(ii) Find P(E) and P(F).
Solution:
(i) Sample space, S = { 1, 2, 3, 4, 5, 6 } ⇒ n(S) = 6
n(F) 2
F = { 5, 6 } ⇒ n(F) = 2
(ii) E = { 1, 3, 5 } ⇒ n(E) = 3
1
1 P(F)
n(E) 3 P(E)
===
===
n(S) 6 3
n(S) 6 2
Chapter 3 – Page 4
LAWS OF PROBABILITY
If of A then P(
Ais the complementary event A) = 1 – P(A).
Chapter 3 – Page 5
Example:
There are 25 students in a class. 5 of them scored A and 10 of
them scored B while the others scored C in Quantitative Studies. If
a student is selected at random, what is the probability that the
selected student scored A or B in Quantitative Studies?
Solution:
Let A Let B ≡students scoring B in
≡students scoring A in Quantitative Studies
Quantitative Studies
P(A) =
P(B) =
P(A B) =
∪
Example:
In a business course in a college, 90% of the students passed
Statistics, 95% of the students passed Management and 88%
passed both Statistics and Management. A student is selected at
random.
(a) What is the probability that the student passed Statistics or
Management?
(b) What is the probability that the student passed neither
Statistics nor Management?
Solution
Let T M ≡the students
≡the students passed Management
passed Statistics
Chapter 3 – Page 6
Alternative Solution 1:
S
TM
0.88
0.07 0.97 ∪ + + =
C. Conditional Probability
When an event happens is considered with the condition that
another event happens, then the event is a conditional event. The
conditional probability of the occurrence of event B given that
event A has occurred, denoted by P(B | A) is defined by
P(A ∩B) P(A)
P(B | A) =
Example: if P(A) > 0
Solution:
(a)
(b)
Chapter 3 – Page 7
Note: (1) If P(A) = 0 then P(B | A) is not defined. (2) If
A and B are independent then
P(B | A) = P(B )
P(A | B) = P(A)
Note:
(1) In general, if A1 , A2 , … , An are independent events then
P(A1 ∩…∩An ) = P(A1) P(An)
∩A2 x P(A2) x … x
(2) Independent events are not mutually exclusive, i.e. the two
events can occur together.
(3) Dependent events may or may not be mutually exclusive.
Example:
Students take two independent tests. 30% of the students pass
test A and 60% pass test B. Find the probability that a student
selected at random will pass
a) both tests b) only test A c) only one test (Answer: (b) 0.12
(c) 0.54)
Chapter 3 – Page 8
Solution:
A B P(A) = 0.3 P(B) = 0.6
⇨ P( ⇨ P(
pass test A ⇨
≡ pass test B ⇨ A) = 0.7 B) = 0.4
≡
B) = P(A) b) B)
a) P(A ∩ ×P(B) P(A ∩ B) = P(A) ×P(
= 0.3 ×0.6 = 0.3 ×0.4
= 0.18
=
B) + P( A∩ B) = ×P(B) + P( A) ×P(B)
c)
P(A ∩ P(A)
= 0.3 ×0.6
= Example:
×0.4 + 0.7
A bag contains five red balls and eight yellow balls. If two balls are
drawn consecutively and without replacement, what is the
probability that
(a) both are yellow?
(b) both are of different colours?
(c) both are red?
(Answer: (a)14/39, (b) 20/39, (c) 5/39)
Solution:
(a)
(b)
(c)
Chapter 3 – Page 9
Example
Given P(G) = 0.5, P(H) = 0.4 and P(G and H) = 0.1.
(a) Draw a Venn diagram and calculate
i) P(G | H) ii) P(H | G) iii)
P(H )
iv) P(G or H) v) H)
P(G or
b) Are the events G and H mutually exclusive? Explain. c) Are
the events G and H independent? Explain. (Answer: (a) (i) 0.25,
(ii) 0.20, (iii) 0.6, (iv) 0.8, (v) 0.7, (b) No, (c) No)
Solution:
(a)
S
GH
(i) (ii) (iii) (iv) (v)
b)
c)
Chapter 3 – Page 10
TREE DIAGRAM
⇨ Is a graphical aid to help us visualize problems involving
combinations of trials. It can be used whenever the probability
of each stage of the outcomes is dependent on the previous
one or not.
⇨ A useful way for portraying conditional and joint probabilities.
⇨ Each outcome is represented by a branch of the tree.
Example:
Draw the probability tree for the experiment of tossing a coin 3
times. Find the sample space for this experiment.
Solution:
First toss Second toss Third toss Final outcomes
H HHH
HT
HHT
H
T
HTT
H THH
T
H HTH T
HT
THT
T
H TTH
T
TTT
S = { HHH, HHT, HTH, HTT, THH, THT, TTH, TTT }
Chapter 3 – Page 11
Bayes’ Theorem
Suppose that A and B are mutually exclusive events that exhaust
the sample space of an experiment associated with them, i.e. A ∩
B= ∪B = S. P(A) known.
φand A and P(B) are
Example:
In a certain college, the girls constitute 60% of the student
population. 25% of the boys and 10% of the girls are studying
Statistics. If a student is selected at random, determine the
probability that the student is
(a) a girl and studying Statistics,
(b) a boy and studying Statistics,
(c) studying Statistics,
(d) a girl given that the student studying Statistics.
(Answer: (a) 0.06, (b) 0.10, (c) 0.16, (d) 0.375)
Solution:
G
≡the student is a girl ⇨ P(G) = 0.60 B
≡the student is a boy ⇨ P(B) = 0.40
T
≡the student is studying Statistics ⇨ P(T | B) = 0.25 ⇨
P(T | G) = 0.10
Chapter 3 – Page 12
Gender Conditional
��
Probabilitie
��(��|��) = 0.10
s
��
��(��) = 0.60
��̅ ̅
��(�� ∩ ��) = 0.60 × 0.90
̅
��(��|��) = 0.90
�� = 0.54 ��(�� ∩ ��) = 0.40
��(��|��) = 0.25 × 0.25 = 0.10
Joint Probabilities
̅
��(��|��) = 0.75
(c)
(a) ��̅
̅
(d) ��(�� ∩ ��) = 0.40 ×
�� 0.75 = 0.30
(b)
Chapter 3 – Page 13
Example:
A manufacturer purchases a particular component from three
suppliers: A, B, and C. 30% of the components are purchased
from A, 20% from B and 50% from C. It is learned that 3% of the
components from A, 5% from B and 4% from C are defective.
When the components arrive, they are placed directly in a bin and
not inspected or identified by supplier. Draw a well-labelled
probability tree diagram with the joint probabilities calculated to
illustrate this situation. Determine the probability that a randomly
selected component is
Solution:
A ≡ a component selected is purchased from A;
B ≡ a component selected is purchased from B;
C ≡ a component selected is purchased from C;
D ≡ a component is defective.
Chapter 3 – Page 14
Suppliers Conditional
Probabilities
��(�� ∩ ��) = 0.3 ×
�� 0.03 = 0.009
��(��|��) = 0.03 Joint Probabilities
��
��(��) = 0.2
(a)
0.2 × 0.05 = 0.010
̅
��(��|��) =
(c) 0.95 ��(��|��) ��̅ �� ̅
= 0.04 �� ��(�� ∩ ��) =
0.2 × 0.95 = 0.190
̅ ��(�� ∩ ��) =
(d) ��(��|��) = ��̅ 0.5 × 0.04 = 0.020
0.96
̅ ̅
��(��|��) = ��(�� ∩ ��) =
0.97 ��̅ ��
0.3 × 0.97 = 0.291 ̅
��(��|��) = ��(�� ∩ ��) =
��(�� ∩ ��) =
0.05 �� 0.5 × 0.96 = 0.480
Chapter 3 – Page 15
CONTINGENCY TABLE
A contingency table is a table in which all possible events (or
outcomes) for one variable are listed as row headings and all
possible events for a second variable are listed as column
headings. The value entered in each cell of the table is the
observed frequency of each joint occurrence.
Example:
The following contingency table describes 200 customers of an
electrical store according to age and gender.
Age Gender Total
Male (M) Female (F)
Under 30 (U) 60 50 110
30 & over (O) 80 10 90
Total 140 60 200
Probability rules:
1. ̅
P(A) = 1 – P(A)
2. P(A U B) = P(A) + P(B) if A and B are mutually exclusive
4. P(B|A) =P(A ∩ B)
P(A)
Chapter 3 – Page 17
AAMS1773 QUANTITATIVE STUDIES
Tutorial 3 (Probability)
baseball tennis
Chapter 3 – Page 18
(b) Find the probability that a randomly selected member
(i) plays either baseball or tennis but not both; (ii)
plays tennis, given that he/she does not plays golf.
(c) Are the events “play baseball” and “play golf”
independent? Explain.
5. A box contains 20 DVDs, 4 of which are defective. What is
the probability that both are defective if 2 DVDs are
selected consecutively and randomly from this box (a)
with replacement;
(b) without replacement?
Chapter 3 – Page 19
(a) Draw a well-labelled probability tree diagram with
joint probabilities calculated for the above problem. (b)
What is the probability that a particular loan applicant
would have been employed at his or her present job for
less than two years?
(c) Given that a particular loan application has been
employed at his or her present job for only one year,
what is the probability that this person will repay the
loan?
Chapter 3 – Page 20
(b) It was prepared by Z or contained an error. (c) it was
prepared by Z given that it contained an error. (d) it
contained an error given it was prepared by Z. (e) it was
prepared by X or Y given that it contained no error.
(f) It contained no error if it was prepared by X or Y.
Chapter 3 – Page 21
Answers:
1. 0.15, 0.65, No
2.(a) 4/15 (b) 8/15 (c) 2/3
3.(a) 0.13 (b) 0.06 (c) 0.87
4.(b) (i) 0.41 (ii) 0.6528 (c) Yes
5.(a) 1/25 (b) 3/95
6.(b)(i) 0.205 (ii) 0.7098 (iii) 0.9943 (iv) 0.8545 7.(b)
0.4 (c) 0.4688
8.(b) 2/5 (c) 7/10, 3/5, 2/3, No
9.(a) 0.012 (b) 0.421 (c) 0.3636 (d) 0.03 (e) 0.5988 10.(a) (i) 0.525
(ii) 0.3625 (iii) 0.2125 (iv) 0.625 (v) 0.4474 (b) No (c) No
Chapter 3 – Page 22