Chapter 1.

Probability

Nguyễn Văn Hạnh

Department of Applied Mathematics
School of Applied Mathematics and Informatics

First semester, 2023-2024

NV HANH Probability and statistics First semester, 2023-2024 1 / 71

Contents
1 Sample space and Events
2 Events relation
3 Methods of Counting Outcomes
4 Probability of Events
Definition of Probability
Complementary Rule
Probability of the Union of Events – Addition Rule
5 Conditional Probability
Definition of Conditional Probability
Multiplication Rule
Independence
6 Total Probability Rule and Bayes’ Rule
Probability Tree
Total Probability Rule and Bayes’ Rule
7 Bernoulli Rule
NV HANH Probability and statistics First semester, 2023-2024 2 / 71
 Sample space and Events

Random experiment and Sample space

Definition 2.1
A result of an experiment is called an outcome.

NV HANH Probability and statistics First semester, 2023-2024 3 / 71

 Sample space and Events

Random experiment and Sample space

Definition 2.1
A result of an experiment is called an outcome.
An experiment that can result in different outcomes, even though it is
repeated in the same manner every time, is called a random
experiment.

NV HANH Probability and statistics First semester, 2023-2024 3 / 71

 Sample space and Events

Random experiment and Sample space

Definition 2.1
A result of an experiment is called an outcome.
An experiment that can result in different outcomes, even though it is
repeated in the same manner every time, is called a random
experiment.
The set of all possible outcomes of a random experiment is called the
sample space of the experiment. The sample space is denoted as S.

NV HANH Probability and statistics First semester, 2023-2024 3 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.1
Consider the experiment of:
Flipping a coin: the sample space S = {H, T }

NV HANH Probability and statistics First semester, 2023-2024 4 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.1
Consider the experiment of:
Flipping a coin: the sample space S = {H, T }
Tossing a 6-sided die printed with little dots numbering 1, 2, 3, 4, 5,
and 6: the sample space S = {1, 2, 3, 4, 5, 6}

NV HANH Probability and statistics First semester, 2023-2024 4 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.1
Consider the experiment of:
Flipping a coin: the sample space S = {H, T }
Tossing a 6-sided die printed with little dots numbering 1, 2, 3, 4, 5,
and 6: the sample space S = {1, 2, 3, 4, 5, 6}
Tossing a 6-sided die printed with little dots numbering 2, 2, 3, 4, 5,
and 6: the sample space S = {2, 3, 4, 5, 6}.

NV HANH Probability and statistics First semester, 2023-2024 4 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.1
Consider the experiment of:
Flipping a coin: the sample space S = {H, T }
Tossing a 6-sided die printed with little dots numbering 1, 2, 3, 4, 5,
and 6: the sample space S = {1, 2, 3, 4, 5, 6}
Tossing a 6-sided die printed with little dots numbering 2, 2, 3, 4, 5,
and 6: the sample space S = {2, 3, 4, 5, 6}.

Example 2.2
An experiment consists of flipping a coin and then flipping it a second time
if a head occurs, if a tail occurs on the first flip, then a die is tossed once.

NV HANH Probability and statistics First semester, 2023-2024 4 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.1
Consider the experiment of:
Flipping a coin: the sample space S = {H, T }
Tossing a 6-sided die printed with little dots numbering 1, 2, 3, 4, 5,
and 6: the sample space S = {1, 2, 3, 4, 5, 6}
Tossing a 6-sided die printed with little dots numbering 2, 2, 3, 4, 5,
and 6: the sample space S = {2, 3, 4, 5, 6}.

Example 2.2
An experiment consists of flipping a coin and then flipping it a second time
if a head occurs, if a tail occurs on the first flip, then a die is tossed once.
The sample space S = {HH, HT , T 1, T 2, T 3, T 4, T 5, T 6}

NV HANH Probability and statistics First semester, 2023-2024 4 / 71

 Sample space and Events

Random experiment and Sample space

Remark
A sample space is often defined based on the objectives of the analysis.

NV HANH Probability and statistics First semester, 2023-2024 5 / 71

 Sample space and Events

Random experiment and Sample space

Remark
A sample space is often defined based on the objectives of the analysis.

Example 2.3
Consider an experiment in which you select a molded plastic part, such as
a connector, and measure its thickness.

NV HANH Probability and statistics First semester, 2023-2024 5 / 71

 Sample space and Events

Random experiment and Sample space

Remark
A sample space is often defined based on the objectives of the analysis.

Example 2.3
Consider an experiment in which you select a molded plastic part, such as
a connector, and measure its thickness.
The sample space S = R+ = {x|x > 0}.

NV HANH Probability and statistics First semester, 2023-2024 5 / 71

 Sample space and Events

Random experiment and Sample space

Remark
A sample space is often defined based on the objectives of the analysis.

Example 2.3
Consider an experiment in which you select a molded plastic part, such as
a connector, and measure its thickness.
The sample space S = R+ = {x|x > 0}.
If it is known that all connectors will be between 10 and 11
millimeters thick, the sample space could be S = {x|10 < x < 11}.

NV HANH Probability and statistics First semester, 2023-2024 5 / 71

 Sample space and Events

Random experiment and Sample space

Remark
A sample space is often defined based on the objectives of the analysis.

Example 2.3
Consider an experiment in which you select a molded plastic part, such as
a connector, and measure its thickness.
The sample space S = R+ = {x|x > 0}.
If it is known that all connectors will be between 10 and 11
millimeters thick, the sample space could be S = {x|10 < x < 11}.
If the objective of the analysis is to consider only whether a particular
part is low, medium, or high for thickness, then the sample space is
S = {low, medium, high}.

NV HANH Probability and statistics First semester, 2023-2024 5 / 71

 Sample space and Events

Random experiment and Sample space

Definition 2.2
A sample space is discrete if it consists of a finite or countable infinite set
of outcomes.

NV HANH Probability and statistics First semester, 2023-2024 6 / 71

 Sample space and Events

Random experiment and Sample space

Definition 2.2
A sample space is discrete if it consists of a finite or countable infinite set
of outcomes.
A sample space is continuous if it contains an interval (either finite or
infinite) of real numbers.

Example 2.4
In Example 2.3, the choice S = {x|x > 0} is an example of a continuous
sample space, whereas S = {low, medium, high} is a discrete sample
space.

NV HANH Probability and statistics First semester, 2023-2024 6 / 71

 Sample space and Events

Random experiment and Sample space

Definition 2.2
A sample space is discrete if it consists of a finite or countable infinite set
of outcomes.
A sample space is continuous if it contains an interval (either finite or
infinite) of real numbers.

Example 2.4
In Example 2.3, the choice S = {x|x > 0} is an example of a continuous
sample space, whereas S = {low, medium, high} is a discrete sample
space.

Remark
The best choice of a sample space depends on the objectives of the study.

NV HANH Probability and statistics First semester, 2023-2024 6 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.5
Randomly select a camera and record the recycle time of a flash.
Then S = R + = {x|x > 0}, the positive real numbers

NV HANH Probability and statistics First semester, 2023-2024 7 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.5
Randomly select a camera and record the recycle time of a flash.
Then S = R + = {x|x > 0}, the positive real numbers
Suppose it is known that all recycle times are between 1.5 and 5
seconds. Then S = {x|1.5 < x < 5} is continuous.

NV HANH Probability and statistics First semester, 2023-2024 7 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.5
Randomly select a camera and record the recycle time of a flash.
Then S = R + = {x|x > 0}, the positive real numbers
Suppose it is known that all recycle times are between 1.5 and 5
seconds. Then S = {x|1.5 < x < 5} is continuous.
It is known that the recycle time has only three values (low, medium
or high). Then S = {low, medium, high} is discrete.

NV HANH Probability and statistics First semester, 2023-2024 7 / 71

 Sample space and Events

Random experiment and Sample space

Example 2.5
Randomly select a camera and record the recycle time of a flash.
Then S = R + = {x|x > 0}, the positive real numbers
Suppose it is known that all recycle times are between 1.5 and 5
seconds. Then S = {x|1.5 < x < 5} is continuous.
It is known that the recycle time has only three values (low, medium
or high). Then S = {low, medium, high} is discrete.
Does the camera conform to minimum recycle time specifications?
Then S = {yes, no} is discrete.

NV HANH Probability and statistics First semester, 2023-2024 7 / 71

 Sample space and Events

Events
Definition 2.3
An event is a subset of the sample space of a random experiment,
and is denoted by A, B, C , ....
Each outcome is called a simple event.
The entire sample space S is called the certain event. The null event,
denoted by the symbol ∅, is an empty subset of S, and has no
outcomes.

NV HANH Probability and statistics First semester, 2023-2024 8 / 71

 Sample space and Events

Events
Definition 2.3
An event is a subset of the sample space of a random experiment,
and is denoted by A, B, C , ....
Each outcome is called a simple event.
The entire sample space S is called the certain event. The null event,
denoted by the symbol ∅, is an empty subset of S, and has no
outcomes.

Example 2.6
Consider the experiment of tossing a 6-sided die printed with little dots
numbering 1, 2, 3, 4, 5 and 6. The sample space S = {1, 2, 3, 4, 5, 6}.

NV HANH Probability and statistics First semester, 2023-2024 8 / 71

 Sample space and Events

Events
Definition 2.3
An event is a subset of the sample space of a random experiment,
and is denoted by A, B, C , ....
Each outcome is called a simple event.
The entire sample space S is called the certain event. The null event,
denoted by the symbol ∅, is an empty subset of S, and has no
outcomes.

Example 2.6
Consider the experiment of tossing a 6-sided die printed with little dots
numbering 1, 2, 3, 4, 5 and 6. The sample space S = {1, 2, 3, 4, 5, 6}.
Let A be the event that the outcome is divisible by 3: A = {3, 6}

NV HANH Probability and statistics First semester, 2023-2024 8 / 71

 Sample space and Events

Events
Definition 2.3
An event is a subset of the sample space of a random experiment,
and is denoted by A, B, C , ....
Each outcome is called a simple event.
The entire sample space S is called the certain event. The null event,
denoted by the symbol ∅, is an empty subset of S, and has no
outcomes.

Example 2.6
Consider the experiment of tossing a 6-sided die printed with little dots
numbering 1, 2, 3, 4, 5 and 6. The sample space S = {1, 2, 3, 4, 5, 6}.
Let A be the event that the outcome is divisible by 3: A = {3, 6}
Let B be the event that the outcome is an even number: B = {2, 4, 6}

NV HANH Probability and statistics First semester, 2023-2024 8 / 71

 Sample space and Events

Events
Definition 2.3
An event is a subset of the sample space of a random experiment,
and is denoted by A, B, C , ....
Each outcome is called a simple event.
The entire sample space S is called the certain event. The null event,
denoted by the symbol ∅, is an empty subset of S, and has no
outcomes.

Example 2.6
Consider the experiment of tossing a 6-sided die printed with little dots
numbering 1, 2, 3, 4, 5 and 6. The sample space S = {1, 2, 3, 4, 5, 6}.
Let A be the event that the outcome is divisible by 3: A = {3, 6}
Let B be the event that the outcome is an even number: B = {2, 4, 6}
The simple events are Ai = {i}, i = 1, 2, ..., 6
NV HANH Probability and statistics First semester, 2023-2024 8 / 71
 Sample space and Events

Events

Example 2.7
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component.

NV HANH Probability and statistics First semester, 2023-2024 9 / 71

 Sample space and Events

Events

Example 2.7
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component.
S is uncountable, a simple event is any non-negative real number.

NV HANH Probability and statistics First semester, 2023-2024 9 / 71

 Sample space and Events

Events

Example 2.7
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component.
S is uncountable, a simple event is any non-negative real number.
Let A be the event that the component fails before the end of the
fifth year: then A = {t|0 ≤ t < 5}

NV HANH Probability and statistics First semester, 2023-2024 9 / 71

 Sample space and Events

Events

Example 2.7
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component.
S is uncountable, a simple event is any non-negative real number.
Let A be the event that the component fails before the end of the
fifth year: then A = {t|0 ≤ t < 5}
Let B be the event that the component will not fail before the end of
the sixth year: then B = {t|t ≥ 6}

NV HANH Probability and statistics First semester, 2023-2024 9 / 71

 Events relation

Events relation: complement

Definition 2.4
The complement of an event A is the subset of all elements of S
that are not in A and denoted by the symbol Ac or Ā.

NV HANH Probability and statistics First semester, 2023-2024 10 / 71

 Events relation

Events relation: complement

Definition 2.4
The complement of an event A is the subset of all elements of S
that are not in A and denoted by the symbol Ac or Ā.

Venn diagram of complement

NV HANH Probability and statistics First semester, 2023-2024 10 / 71

 Events relation

Events relation: Intersection

Definition 2.5
The intersection of two events A and B, denoted by the symbol
A ∩ B or AB, is the event containing all elements that are common to
A and B.

NV HANH Probability and statistics First semester, 2023-2024 11 / 71

 Events relation

Events relation: Intersection

Definition 2.5
The intersection of two events A and B, denoted by the symbol
A ∩ B or AB, is the event containing all elements that are common to
A and B.
The intersection AB occurs if and only if A and B occur together.

NV HANH Probability and statistics First semester, 2023-2024 11 / 71

 Events relation

Events relation: Intersection

Definition 2.5
The intersection of two events A and B, denoted by the symbol
A ∩ B or AB, is the event containing all elements that are common to
A and B.
The intersection AB occurs if and only if A and B occur together.

Venn diagram of intersection

NV HANH Probability and statistics First semester, 2023-2024 11 / 71

 Events relation

Events relation: Union

Definition 2.6
The union of the two events A and B, denoted by the symbol A ∪ B
or A + B, is the event containing all the elements that belong to A or
B or both.

NV HANH Probability and statistics First semester, 2023-2024 12 / 71

 Events relation

Events relation: Union

Definition 2.6
The union of the two events A and B, denoted by the symbol A ∪ B
or A + B, is the event containing all the elements that belong to A or
B or both.
The union A + B occurs if and only if A occurs or B occurs, or both
occur.

NV HANH Probability and statistics First semester, 2023-2024 12 / 71

 Events relation

Events relation: Union

Definition 2.6
The union of the two events A and B, denoted by the symbol A ∪ B
or A + B, is the event containing all the elements that belong to A or
B or both.
The union A + B occurs if and only if A occurs or B occurs, or both
occur.

Venn diagram of union

NV HANH Probability and statistics First semester, 2023-2024 12 / 71

 Events relation

Events relation: Difference

Definition 2.7
The difference between two events A and B is denoted by A − B is
the event containing elements that are in A but not in B.

NV HANH Probability and statistics First semester, 2023-2024 13 / 71

 Events relation

Events relation: Difference

Definition 2.7
The difference between two events A and B is denoted by A − B is
the event containing elements that are in A but not in B.
The differrence A − B occurs if and only if A occurs and B does not
occur.

NV HANH Probability and statistics First semester, 2023-2024 13 / 71

 Events relation

Events relation: Difference

Definition 2.7
The difference between two events A and B is denoted by A − B is
the event containing elements that are in A but not in B.
The differrence A − B occurs if and only if A occurs and B does not
occur.
Note that A − B = A ∩ B̄

NV HANH Probability and statistics First semester, 2023-2024 13 / 71

 Events relation

Events relation: Difference

Definition 2.7
The difference between two events A and B is denoted by A − B is
the event containing elements that are in A but not in B.
The differrence A − B occurs if and only if A occurs and B does not
occur.
Note that A − B = A ∩ B̄

Venn diagram of difference

NV HANH Probability and statistics First semester, 2023-2024 13 / 71

 Events relation

Events relation

Example 2.8
Consider the experiment of tossing a 6-sided die. The sample space
S = {1, 2, 3, 4, 5, 6}. Let A = {3, 6} (outcome is divisible by 3) and
B = {2, 4, 6} (outcome is even).

NV HANH Probability and statistics First semester, 2023-2024 14 / 71

 Events relation

Events relation

Example 2.8
Consider the experiment of tossing a 6-sided die. The sample space
S = {1, 2, 3, 4, 5, 6}. Let A = {3, 6} (outcome is divisible by 3) and
B = {2, 4, 6} (outcome is even). Then
The complement of A is: Ā = {1, 2, 4, 5}

NV HANH Probability and statistics First semester, 2023-2024 14 / 71

 Events relation

Events relation

Example 2.8
Consider the experiment of tossing a 6-sided die. The sample space
S = {1, 2, 3, 4, 5, 6}. Let A = {3, 6} (outcome is divisible by 3) and
B = {2, 4, 6} (outcome is even). Then
The complement of A is: Ā = {1, 2, 4, 5}
The intersection of A and B is: AB = {6}

NV HANH Probability and statistics First semester, 2023-2024 14 / 71

 Events relation

Events relation

Example 2.8
Consider the experiment of tossing a 6-sided die. The sample space
S = {1, 2, 3, 4, 5, 6}. Let A = {3, 6} (outcome is divisible by 3) and
B = {2, 4, 6} (outcome is even). Then
The complement of A is: Ā = {1, 2, 4, 5}
The intersection of A and B is: AB = {6}
The union of A and B is: A + B = {2, 3, 4, 6}

NV HANH Probability and statistics First semester, 2023-2024 14 / 71

 Events relation

Events relation

Example 2.8
Consider the experiment of tossing a 6-sided die. The sample space
S = {1, 2, 3, 4, 5, 6}. Let A = {3, 6} (outcome is divisible by 3) and
B = {2, 4, 6} (outcome is even). Then
The complement of A is: Ā = {1, 2, 4, 5}
The intersection of A and B is: AB = {6}
The union of A and B is: A + B = {2, 3, 4, 6}
The difference of A and B is: A − B = {3}. The difference of B and
A is: B − A = {2, 4}.

NV HANH Probability and statistics First semester, 2023-2024 14 / 71

 Events relation

Events relation

Example 2.9
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component. Let A = {t|0 ≤ t < 5}, B = {t|3 < t < 8}
and C = {t|t > 4}.

NV HANH Probability and statistics First semester, 2023-2024 15 / 71

 Events relation

Events relation

Example 2.9
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component. Let A = {t|0 ≤ t < 5}, B = {t|3 < t < 8}
and C = {t|t > 4}. Then:
Ā = {t|t ≥ 5}; B̄ = {t|0 ≤ t ≤ 3 or t ≥ 8} and C̄ = {t|0 ≤ t ≤ 4}.

NV HANH Probability and statistics First semester, 2023-2024 15 / 71

 Events relation

Events relation

Example 2.9
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component. Let A = {t|0 ≤ t < 5}, B = {t|3 < t < 8}
and C = {t|t > 4}. Then:
Ā = {t|t ≥ 5}; B̄ = {t|0 ≤ t ≤ 3 or t ≥ 8} and C̄ = {t|0 ≤ t ≤ 4}.
AB = {t|3 < t < 5}, AC = {t|4 < t < 5}; BC = {t|4 < t < 8} and
ABC = {t|4 < t < 5}

NV HANH Probability and statistics First semester, 2023-2024 15 / 71

 Events relation

Events relation

Example 2.9
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component. Let A = {t|0 ≤ t < 5}, B = {t|3 < t < 8}
and C = {t|t > 4}. Then:
Ā = {t|t ≥ 5}; B̄ = {t|0 ≤ t ≤ 3 or t ≥ 8} and C̄ = {t|0 ≤ t ≤ 4}.
AB = {t|3 < t < 5}, AC = {t|4 < t < 5}; BC = {t|4 < t < 8} and
ABC = {t|4 < t < 5}
A + B = {t|0 ≤ t < 8}; A + C = S; B + C = {t|t > 3} and
A + B + C = S.

NV HANH Probability and statistics First semester, 2023-2024 15 / 71

 Events relation

Events relation

Example 2.9
Consider the experiment of observing the life in years of a certain
electronic component. The sample space S = {t|t ≥ 0}, where t is the life
of an electronic component. Let A = {t|0 ≤ t < 5}, B = {t|3 < t < 8}
and C = {t|t > 4}. Then:
Ā = {t|t ≥ 5}; B̄ = {t|0 ≤ t ≤ 3 or t ≥ 8} and C̄ = {t|0 ≤ t ≤ 4}.
AB = {t|3 < t < 5}, AC = {t|4 < t < 5}; BC = {t|4 < t < 8} and
ABC = {t|4 < t < 5}
A + B = {t|0 ≤ t < 8}; A + C = S; B + C = {t|t > 3} and
A + B + C = S.
A − B = {t|0 ≤ t ≤ 3} and B − A = {t|5 ≤ t < 8};

NV HANH Probability and statistics First semester, 2023-2024 15 / 71

 Events relation

Mutually Exclusive Events

Mutually Exclusive Events

Events A and B are mutually exclusive if they share no common
outcomes (A and B cannot occur together).

NV HANH Probability and statistics First semester, 2023-2024 16 / 71

 Events relation

Mutually Exclusive Events

Mutually Exclusive Events

Events A and B are mutually exclusive if they share no common
outcomes (A and B cannot occur together).
Symbolically, A ∩ B = ∅

NV HANH Probability and statistics First semester, 2023-2024 16 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Mutually Exclusive and Exhaustive Events

The set of n events {A1 , A2 , ..., An } are mutually exclusive and exhaustive
if and only if:
Any 2 events Ai , Aj , for all i 6= j, are mutually exclusive (Ai ∩ Aj = ∅).
Union of all events Ai are the sample space: A1 ∪ A2 ∪ ... ∪ An = S.

NV HANH Probability and statistics First semester, 2023-2024 17 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Mutually Exclusive and Exhaustive Events

The set of n events {A1 , A2 , ..., An } are mutually exclusive and exhaustive
if and only if:
Any 2 events Ai , Aj , for all i 6= j, are mutually exclusive (Ai ∩ Aj = ∅).
Union of all events Ai are the sample space: A1 ∪ A2 ∪ ... ∪ An = S.

NV HANH Probability and statistics First semester, 2023-2024 17 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.10
Consider the experiment of tossing a 6-sided die. Then
S = {1, 2, 3, 4, 5, 6}. Let Ai = {i}, i = 1, 2, .., 6 and A = {2, 4, 6};
B = {3, 5}; C = {1, 2, 4, 6}.

NV HANH Probability and statistics First semester, 2023-2024 18 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.10
Consider the experiment of tossing a 6-sided die. Then
S = {1, 2, 3, 4, 5, 6}. Let Ai = {i}, i = 1, 2, .., 6 and A = {2, 4, 6};
B = {3, 5}; C = {1, 2, 4, 6}.
A and B are mutually exclusive but not exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 18 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.10
Consider the experiment of tossing a 6-sided die. Then
S = {1, 2, 3, 4, 5, 6}. Let Ai = {i}, i = 1, 2, .., 6 and A = {2, 4, 6};
B = {3, 5}; C = {1, 2, 4, 6}.
A and B are mutually exclusive but not exhaustive.
B and C are mutually exclusive and exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 18 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.10
Consider the experiment of tossing a 6-sided die. Then
S = {1, 2, 3, 4, 5, 6}. Let Ai = {i}, i = 1, 2, .., 6 and A = {2, 4, 6};
B = {3, 5}; C = {1, 2, 4, 6}.
A and B are mutually exclusive but not exhaustive.
B and C are mutually exclusive and exhaustive.
{A1 , A2 , ..., A6 } are mutually exclusive and exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 18 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.11
Consider the experiment of observing the life in years of a certain
electronic component. Then S = {t|t ≥ 0} and let A = {t|0 ≤ t < 5},
B = {t|5 ≤ t < 8} and C = {t|t ≥ 8}.

NV HANH Probability and statistics First semester, 2023-2024 19 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.11
Consider the experiment of observing the life in years of a certain
electronic component. Then S = {t|t ≥ 0} and let A = {t|0 ≤ t < 5},
B = {t|5 ≤ t < 8} and C = {t|t ≥ 8}. Then:
{A, Ā} are are mutually exclusive and exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 19 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.11
Consider the experiment of observing the life in years of a certain
electronic component. Then S = {t|t ≥ 0} and let A = {t|0 ≤ t < 5},
B = {t|5 ≤ t < 8} and C = {t|t ≥ 8}. Then:
{A, Ā} are are mutually exclusive and exhaustive.
A and C are mutually exclusive but not exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 19 / 71

 Events relation

Mutually Exclusive and Exhaustive Events

Example 2.11
Consider the experiment of observing the life in years of a certain
electronic component. Then S = {t|t ≥ 0} and let A = {t|0 ≤ t < 5},
B = {t|5 ≤ t < 8} and C = {t|t ≥ 8}. Then:
{A, Ā} are are mutually exclusive and exhaustive.
A and C are mutually exclusive but not exhaustive.
{A, B, C } are are mutually exclusive and exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 19 / 71

 Events relation

Laws of Events

Commutative law (event order is unimportant):

A ∩ B = B ∩ A; A ∪ B = B ∪ A

NV HANH Probability and statistics First semester, 2023-2024 20 / 71

 Events relation

Laws of Events

Commutative law (event order is unimportant):

A ∩ B = B ∩ A; A ∪ B = B ∪ A
Distributive law (like in algebra):
(A ∪ B) ∩ C = (A ∩ C ) ∪ (B ∩ C )
(A ∩ B) ∪ C = (A ∪ C ) ∩ (B ∪ C )

NV HANH Probability and statistics First semester, 2023-2024 20 / 71

 Events relation

Laws of Events

Commutative law (event order is unimportant):

A ∩ B = B ∩ A; A ∪ B = B ∪ A
Distributive law (like in algebra):
(A ∪ B) ∩ C = (A ∩ C ) ∪ (B ∩ C )
(A ∩ B) ∪ C = (A ∪ C ) ∩ (B ∪ C )
Associative law (like in algebra):
(A ∪ B) ∪ C = A ∪ (B ∪ C )
(A ∩ B) ∩ C = A ∩ (B ∩ C )

NV HANH Probability and statistics First semester, 2023-2024 20 / 71

 Events relation

Laws of Events

Commutative law (event order is unimportant):

A ∩ B = B ∩ A; A ∪ B = B ∪ A
Distributive law (like in algebra):
(A ∪ B) ∩ C = (A ∩ C ) ∪ (B ∩ C )
(A ∩ B) ∪ C = (A ∪ C ) ∩ (B ∪ C )
Associative law (like in algebra):
(A ∪ B) ∪ C = A ∪ (B ∪ C )
(A ∩ B) ∩ C = A ∩ (B ∩ C )
DeMorgan’s law:
(A ∩ B)c = Ac ∪ B c and (A ∪ B)c = Ac ∩ B c

NV HANH Probability and statistics First semester, 2023-2024 20 / 71

 Events relation

Laws of Events

Commutative law (event order is unimportant):

A ∩ B = B ∩ A; A ∪ B = B ∪ A
Distributive law (like in algebra):
(A ∪ B) ∩ C = (A ∩ C ) ∪ (B ∩ C )
(A ∩ B) ∪ C = (A ∪ C ) ∩ (B ∪ C )
Associative law (like in algebra):
(A ∪ B) ∪ C = A ∪ (B ∪ C )
(A ∩ B) ∩ C = A ∩ (B ∩ C )
DeMorgan’s law:
(A ∩ B)c = Ac ∪ B c and (A ∪ B)c = Ac ∩ B c
Complement law: (Ac )c = A.

NV HANH Probability and statistics First semester, 2023-2024 20 / 71

 Events relation

Laws of Events

Commutative law (event order is unimportant):

A ∩ B = B ∩ A; A ∪ B = B ∪ A
Distributive law (like in algebra):
(A ∪ B) ∩ C = (A ∩ C ) ∪ (B ∩ C )
(A ∩ B) ∪ C = (A ∪ C ) ∩ (B ∪ C )
Associative law (like in algebra):
(A ∪ B) ∪ C = A ∪ (B ∪ C )
(A ∩ B) ∩ C = A ∩ (B ∩ C )
DeMorgan’s law:
(A ∩ B)c = Ac ∪ B c and (A ∪ B)c = Ac ∩ B c
Complement law: (Ac )c = A.
Others: A ∩ ∅ = ∅; A ∪ ∅ = A; A ∩ Ac = ∅; A ∪ Ac = S; S c = ∅; ∅c = S

NV HANH Probability and statistics First semester, 2023-2024 20 / 71

 Methods of Counting Outcomes

Counting Techniques

There are three special rules, or counting techniques, used to

determine the number of outcomes in events.

NV HANH Probability and statistics First semester, 2023-2024 21 / 71

 Methods of Counting Outcomes

Counting Techniques

There are three special rules, or counting techniques, used to

determine the number of outcomes in events.
They are:
1 Multiplication rule
2 Permutation rule
3 Combination rule

NV HANH Probability and statistics First semester, 2023-2024 21 / 71

 Methods of Counting Outcomes

Counting Techniques

There are three special rules, or counting techniques, used to

determine the number of outcomes in events.
They are:
1 Multiplication rule
2 Permutation rule
3 Combination rule
Each has its special purpose that must be applied properly – the right
tool for the right job.

NV HANH Probability and statistics First semester, 2023-2024 21 / 71

 Methods of Counting Outcomes

Counting – Multiplication Rule

Multiplication rule:
Let an operation consist of k steps and there are:
n1 ways of completing step 1,
n2 ways of completing step 2, . . . and
nk ways of completing step k.

NV HANH Probability and statistics First semester, 2023-2024 22 / 71

 Methods of Counting Outcomes

Counting – Multiplication Rule

Multiplication rule:
Let an operation consist of k steps and there are:
n1 ways of completing step 1,
n2 ways of completing step 2, . . . and
nk ways of completing step k.
Then, the total number of ways to perform k steps is n1 .n2 . . . nk

NV HANH Probability and statistics First semester, 2023-2024 22 / 71

 Methods of Counting Outcomes

Counting – Multiplication Rule

Example 2.12 - Web Site Design

In the design for a website, we can choose to use among:
4 colors,
3 fonts, and
3 positions for an image.
How many designs are possible?

NV HANH Probability and statistics First semester, 2023-2024 23 / 71

 Methods of Counting Outcomes

Counting – Multiplication Rule

Example 2.12 - Web Site Design

In the design for a website, we can choose to use among:
4 colors,
3 fonts, and
3 positions for an image.
How many designs are possible?
Answer: via the multiplication rule, there are 4.3.3 = 36 possible
designs.

NV HANH Probability and statistics First semester, 2023-2024 23 / 71

 Methods of Counting Outcomes

Counting – Permutation Rule

Permutation Rule:
A permutation is a unique sequence of distinct items.

NV HANH Probability and statistics First semester, 2023-2024 24 / 71

 Methods of Counting Outcomes

Counting – Permutation Rule

Permutation Rule:
A permutation is a unique sequence of distinct items.
If S = a, b, c, then there are 6 permutations:
Namely: abc, acb, bac, bca, cab, cba (order matters)

NV HANH Probability and statistics First semester, 2023-2024 24 / 71

 Methods of Counting Outcomes

Counting – Permutation Rule

Permutation Rule:
A permutation is a unique sequence of distinct items.
If S = a, b, c, then there are 6 permutations:
Namely: abc, acb, bac, bca, cab, cba (order matters)
Number of permutations for a set of n items is:
Pn = n! = n(n − 1)(n − 2) . . . 2.1

NV HANH Probability and statistics First semester, 2023-2024 24 / 71

 Methods of Counting Outcomes

Counting – Permutation Rule

Permutation Rule:
A permutation is a unique sequence of distinct items.
If S = a, b, c, then there are 6 permutations:
Namely: abc, acb, bac, bca, cab, cba (order matters)
Number of permutations for a set of n items is:
Pn = n! = n(n − 1)(n − 2) . . . 2.1
7! = 7.6.5.4.3.2.1 = 5040
By definition: 0! = 1

NV HANH Probability and statistics First semester, 2023-2024 24 / 71

 Methods of Counting Outcomes

Counting–Subset Permutations
Subset Permutations
For a sequence of r items from a set of n items:
n!
Arn = n(n − 1)(n − 2) . . . (n − r + 1) =
(n − r )!

Example 2.13: Printed Circuit Board

A printed circuit board has eight different locations in which a
component can be placed. If four different components are to be
placed on the board, how many designs are possible?
Answer: Order is important, so use the permutation formula with
n = 8, r = 4
8! 8.7.6.5.4!
A48 = = = 8.7.6.5 = 1680
(8 − 4)! 4!
NV HANH Probability and statistics First semester, 2023-2024 25 / 71
 Methods of Counting Outcomes

Counting - Similar Item Permutations

Similar Item Permutations

Used for counting the sequences when some items are identical.
The number of permutations of: n = n1 + n2 + . . . + nr items of
which n1 , n2 , . . . , nr are identical is calculated as:
n!
n1 !n2 ! . . . nk !

NV HANH Probability and statistics First semester, 2023-2024 26 / 71

 Methods of Counting Outcomes

Counting - Similar Item Permutations

Example 2.14: Hospital Schedule

In a hospital, an operating room needs to schedule three knee
surgeries and two hip surgeries in a day. The knee surgery is denoted
as k and the hip as h.
How many sequences are there?
Since there are 2 identical hip surgeries and 3 identical knee surgeries,
then
5! 5.4.3!
= = 10
3!2! 2.1.3!
What is the set of sequences?
{kkkhh, kkhkh, kkhhk, khkkh, khkhk, khhkk, hkkkh, hkkhk,
hkhkk, hhkkk}

NV HANH Probability and statistics First semester, 2023-2024 27 / 71

 Methods of Counting Outcomes

Counting – Combination Rule

Combination Rule
A combination is a selection of r items from a set of n where order
does not matter.
If S = {a, b, c}, n = 3, then
– If r = 3, there is 1 combination, namely: abc
– If r = 2, there are 3 combinations, namely ab, ac, and bc
# of permutations ≥ # of combinations
Since order does not matter with combinations, we are dividing the #
of permutations by r !, where r ! is the # of arrangements of r
elements.:
n!
Cnr =
r !(n − r )!

NV HANH Probability and statistics First semester, 2023-2024 28 / 71

 Methods of Counting Outcomes

Counting – Combination Rule

Example 2.15: Sampling w/o Replacement-1

A bin of 50 parts contains 3 defectives and 47 non-defective parts. A
sample of 6 parts is selected from the 50 without replacement. How
many samples of size 6 contain 2 defective parts?
First, how many ways are there for selecting 2 parts from the 3
defective parts?
Answer:
3!
C32 = = 3 different ways
2!1!

NV HANH Probability and statistics First semester, 2023-2024 29 / 71

 Methods of Counting Outcomes

Counting – Combination Rule

Example 2.15: Sampling w/o Replacement-1

Now, how many ways are there for selecting 4 parts from the 47
non-defective parts?
Answer:

4 47! 47.46.45.44.43!
C47 = = = 178365 different ways
4!43! 4.3.2.1.43!
Now, how many ways are there to obtain:
– 2 from 3 defectives, and
– 4 from 47 non-defectives?
Answer:
C32 C47
4
= 3.178365 = 535095 different ways

NV HANH Probability and statistics First semester, 2023-2024 30 / 71

 Probability of Events Definition of Probability

Introduction to Probability

It is often necessary to “guess” about the outcome of an event in order to

make a decision:
Politicians study polls to guess their likelihood of winning an election.
Doctors choose the treatments needed for various diseases based on
their assessment of likely results.
You may have visited a casino where people play games chosen
because of the belief that the likelihood of winning is good.
You may have chosen your course of study based on the probable
availability of jobs.
Probability deals with the chance of an event occurring (Probability is a
numerical measure of the likelihood that an event will occur).

NV HANH Probability and statistics First semester, 2023-2024 31 / 71

 Probability of Events Definition of Probability

Approaches to Determine Probability

Approaches to Determine Probability:

The way that we calculate the probability of an event depends on the
situation we are analyzing.
Classical Method Approach to Probability
Empirical Method Approach to Probability

NV HANH Probability and statistics First semester, 2023-2024 32 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Classical Method Approach to Probability:

The classical method approach requires that an experiment results n
equally like outcomes (equally likely means that each outcome of the
experiment occurs with equal probability of n1 ).
When all outcomes in the sample space are equally likely, calculate
the probability of an event A as follow:

number of outcomes in event A #A

P(A) = =
total number of outcomes in the sample space S n

Note that the outcomes in the sample space S must be mutually

exclusive and exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 33 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.16
Consider the experiment of tossing a fair 6-sided die printed with little
dots numbering 1, 2, 3, 4, 5, and 6.

NV HANH Probability and statistics First semester, 2023-2024 34 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.16
Consider the experiment of tossing a fair 6-sided die printed with little
dots numbering 1, 2, 3, 4, 5, and 6.
The sample space is S = {1, 2, 3, 4, 5, 6}.

NV HANH Probability and statistics First semester, 2023-2024 34 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.16
Consider the experiment of tossing a fair 6-sided die printed with little
dots numbering 1, 2, 3, 4, 5, and 6.
The sample space is S = {1, 2, 3, 4, 5, 6}.
The 6 outcomes are equally likely.

NV HANH Probability and statistics First semester, 2023-2024 34 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.16
Consider the experiment of tossing a fair 6-sided die printed with little
dots numbering 1, 2, 3, 4, 5, and 6.
The sample space is S = {1, 2, 3, 4, 5, 6}.
The 6 outcomes are equally likely.
Let A be the event that the outcome is divisible by 3: A = {3, 6}.
The probability of A is
#A 2 1
P(A) = = =
n 6 3

NV HANH Probability and statistics First semester, 2023-2024 34 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.16
Consider the experiment of tossing a fair 6-sided die printed with little
dots numbering 1, 2, 3, 4, 5, and 6.
The sample space is S = {1, 2, 3, 4, 5, 6}.
The 6 outcomes are equally likely.
Let A be the event that the outcome is divisible by 3: A = {3, 6}.
The probability of A is
#A 2 1
P(A) = = =
n 6 3

Let B be the event that the outcome is even: B = {2, 4, 6}. The
probability of B is
#B 3 1
P(B) = = =
n 6 2
NV HANH Probability and statistics First semester, 2023-2024 34 / 71
 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.17
A fair coin is tossed twice. What is the probability of getting "exactly one
head"? What is the probability that at least one head occurs?

NV HANH Probability and statistics First semester, 2023-2024 35 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.17
A fair coin is tossed twice. What is the probability of getting "exactly one
head"? What is the probability that at least one head occurs?
The sample space is S = {HH, HT , TH, TT }.

NV HANH Probability and statistics First semester, 2023-2024 35 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.17
A fair coin is tossed twice. What is the probability of getting "exactly one
head"? What is the probability that at least one head occurs?
The sample space is S = {HH, HT , TH, TT }.
The 4 outcomes are equally likely.

NV HANH Probability and statistics First semester, 2023-2024 35 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.17
A fair coin is tossed twice. What is the probability of getting "exactly one
head"? What is the probability that at least one head occurs?
The sample space is S = {HH, HT , TH, TT }.
The 4 outcomes are equally likely.
Let A be the event of "getting exactly one head": A = {HT , TH}.
The probability of A is P(A) = #A 2
n = 4 = 0.5

NV HANH Probability and statistics First semester, 2023-2024 35 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.17
A fair coin is tossed twice. What is the probability of getting "exactly one
head"? What is the probability that at least one head occurs?
The sample space is S = {HH, HT , TH, TT }.
The 4 outcomes are equally likely.
Let A be the event of "getting exactly one head": A = {HT , TH}.
The probability of A is P(A) = #A 2
n = 4 = 0.5
Let B be the event that at least one head occurs:
#B 3
B = {HH, HT , TH}. The probability of B is P(B) = n = 4 = 0.75

NV HANH Probability and statistics First semester, 2023-2024 35 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

When the outcomes are not equally likely and we can assign
Pa probility to
each outcome. Then probability of an event A is: P(A) = ω∈A P(ω).

Example 2.18
Consider the experiment of tossing a fair 6-sided die that 2 faces printed
with 2 dots and the other 4 faces printed with 3, 4, 5, and 6 dots
respectively.

NV HANH Probability and statistics First semester, 2023-2024 36 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

When the outcomes are not equally likely and we can assign
Pa probility to
each outcome. Then probability of an event A is: P(A) = ω∈A P(ω).

Example 2.18
Consider the experiment of tossing a fair 6-sided die that 2 faces printed
with 2 dots and the other 4 faces printed with 3, 4, 5, and 6 dots
respectively.
The sample space S = {2, 3, 4, 5, 6}.

NV HANH Probability and statistics First semester, 2023-2024 36 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

When the outcomes are not equally likely and we can assign
Pa probility to
each outcome. Then probability of an event A is: P(A) = ω∈A P(ω).

Example 2.18
Consider the experiment of tossing a fair 6-sided die that 2 faces printed
with 2 dots and the other 4 faces printed with 3, 4, 5, and 6 dots
respectively.
The sample space S = {2, 3, 4, 5, 6}.
2 1
The 5 outcomes are not equally likely: P({2}) = 6 and P({i}) = 6
for i = 3, .., 6

NV HANH Probability and statistics First semester, 2023-2024 36 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

When the outcomes are not equally likely and we can assign
Pa probility to
each outcome. Then probability of an event A is: P(A) = ω∈A P(ω).

Example 2.18
Consider the experiment of tossing a fair 6-sided die that 2 faces printed
with 2 dots and the other 4 faces printed with 3, 4, 5, and 6 dots
respectively.
The sample space S = {2, 3, 4, 5, 6}.
2 1
The 5 outcomes are not equally likely: P({2}) = 6 and P({i}) = 6
for i = 3, .., 6
Let A be the event of "getting an even number": A = {2, 4, 6}. The
probability of A is
2 1 1 2
P(A) = P({2}) + P({4}) + P({6}) = + + =
6 6 6 3
NV HANH Probability and statistics First semester, 2023-2024 36 / 71
 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.19
An experiment consists of flipping a fair coin and then flipping it a second
time if a head occurs, if a tail occurs on the first flip, then a fair die is
tossed once.

NV HANH Probability and statistics First semester, 2023-2024 37 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.19
An experiment consists of flipping a fair coin and then flipping it a second
time if a head occurs, if a tail occurs on the first flip, then a fair die is
tossed once.
The sample space S = {HH, HT , T 1, T 2, T 3, T 4, T 5, T 6}

NV HANH Probability and statistics First semester, 2023-2024 37 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.19
An experiment consists of flipping a fair coin and then flipping it a second
time if a head occurs, if a tail occurs on the first flip, then a fair die is
tossed once.
The sample space S = {HH, HT , T 1, T 2, T 3, T 4, T 5, T 6}
1
The outcomes are not equally likely: P(HH) = P(HT ) = 4 and
1
P(Ti) = 12 for i = 1, .., 6

NV HANH Probability and statistics First semester, 2023-2024 37 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.19
An experiment consists of flipping a fair coin and then flipping it a second
time if a head occurs, if a tail occurs on the first flip, then a fair die is
tossed once.
The sample space S = {HH, HT , T 1, T 2, T 3, T 4, T 5, T 6}
1
The outcomes are not equally likely: P(HH) = P(HT ) = 4 and
1
P(Ti) = 12 for i = 1, .., 6
Let A be the event that the second toss is tail or an even number:
A = {HT , T 2, T 4, T 6}.

NV HANH Probability and statistics First semester, 2023-2024 37 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Example 2.19
An experiment consists of flipping a fair coin and then flipping it a second
time if a head occurs, if a tail occurs on the first flip, then a fair die is
tossed once.
The sample space S = {HH, HT , T 1, T 2, T 3, T 4, T 5, T 6}
1
The outcomes are not equally likely: P(HH) = P(HT ) = 4 and
1
P(Ti) = 12 for i = 1, .., 6
Let A be the event that the second toss is tail or an even number:
A = {HT , T 2, T 4, T 6}.
The probability of A is
1 1+1+1 1
P(A) = P(HT ) + P(T 2) + P(T 4) + P(T 6) = + =
4 12 2

NV HANH Probability and statistics First semester, 2023-2024 37 / 71

 Probability of Events Definition of Probability

Classical Method Approach to Probability

Practice 2.1
Choose randomly two ball from a box that consists of 4 red balls and 6
white balls with the same size. Find the probability of the following events.

Two balls chosen are red.

Exactly one ball is red.
At least one ball is red.

NV HANH Probability and statistics First semester, 2023-2024 38 / 71

 Probability of Events Definition of Probability

Empirical Method Approach to Probability

Empirical Method Approach to Probability:

The empirical or relative frequency approach to probability uses
results from identical previous experiments that have been performed
many times.
Probabilities are based on historical or previously recorded data by
determining the proportion of times an event occurs within the data.

number of times A occurs

P(A) ≈ fn (A) =
total number of trials
To get an accurate probability using this approach, it is important
that the experiment is repeated a very large number of times.
The law of large numbers: as the number of repetitions of an
experiment increases, the relative frequency obtained in the
experiment tends to the theoretical probability.
NV HANH Probability and statistics First semester, 2023-2024 39 / 71
 Probability of Events Definition of Probability

Empirical Method Approach to Probability

Example 2.20
An online retailer wants to know the probability that a transaction will be
less than $30. Suppose that in 2000 transactions, 650 are less than $30.

NV HANH Probability and statistics First semester, 2023-2024 40 / 71

 Probability of Events Definition of Probability

Empirical Method Approach to Probability

Example 2.20
An online retailer wants to know the probability that a transaction will be
less than $30. Suppose that in 2000 transactions, 650 are less than $30.
We approximate that
650
P(a transaction will be less than$30) = = 0.325
2000

NV HANH Probability and statistics First semester, 2023-2024 40 / 71

 Probability of Events Definition of Probability

Empirical Method Approach to Probability

Example 2.20
An online retailer wants to know the probability that a transaction will be
less than $30. Suppose that in 2000 transactions, 650 are less than $30.
We approximate that
650
P(a transaction will be less than$30) = = 0.325
2000

Example 2.21
A computer shop tracks the number of desktop computer systems it sold
over a month (30 days) and there are 12 days it sold 3 desktops per day.

NV HANH Probability and statistics First semester, 2023-2024 40 / 71

 Probability of Events Definition of Probability

Empirical Method Approach to Probability

Example 2.20
An online retailer wants to know the probability that a transaction will be
less than $30. Suppose that in 2000 transactions, 650 are less than $30.
We approximate that
650
P(a transaction will be less than$30) = = 0.325
2000

Example 2.21
A computer shop tracks the number of desktop computer systems it sold
over a month (30 days) and there are 12 days it sold 3 desktops per day.
We can approximate that
12
P(the shop will sell 3 desktops on a given day) = = 0.4
30
NV HANH Probability and statistics First semester, 2023-2024 40 / 71
 Probability of Events Complementary Rule

Probability of Complementary Events

The Complementary Rule:

In any experiment, an event A or its complement Ā must occur. This
means that P(A) + P(Ā) = 1.
Probability of the complementary event: P(Ā) = 1 − P(A).

NV HANH Probability and statistics First semester, 2023-2024 41 / 71

 Probability of Events Complementary Rule

Probability of Complementary Events

The Complementary Rule:

In any experiment, an event A or its complement Ā must occur. This
means that P(A) + P(Ā) = 1.
Probability of the complementary event: P(Ā) = 1 − P(A).

Example 2.22:
An online retailer knows that 30% of customers spend more than $100 per
transaction. What is the probability that a customer spends at most $100
per transaction?

NV HANH Probability and statistics First semester, 2023-2024 41 / 71

 Probability of Events Complementary Rule

Probability of Complementary Events

The Complementary Rule:

In any experiment, an event A or its complement Ā must occur. This
means that P(A) + P(Ā) = 1.
Probability of the complementary event: P(Ā) = 1 − P(A).

Example 2.22:
An online retailer knows that 30% of customers spend more than $100 per
transaction. What is the probability that a customer spends at most $100
per transaction?
Let A be the event of spending more than $100 per transaction.

NV HANH Probability and statistics First semester, 2023-2024 41 / 71

 Probability of Events Complementary Rule

Probability of Complementary Events

The Complementary Rule:

In any experiment, an event A or its complement Ā must occur. This
means that P(A) + P(Ā) = 1.
Probability of the complementary event: P(Ā) = 1 − P(A).

Example 2.22:
An online retailer knows that 30% of customers spend more than $100 per
transaction. What is the probability that a customer spends at most $100
per transaction?
Let A be the event of spending more than $100 per transaction.
The event of spending at most $100 per transaction is the
complement of A.

NV HANH Probability and statistics First semester, 2023-2024 41 / 71

 Probability of Events Complementary Rule

Probability of Complementary Events

The Complementary Rule:

In any experiment, an event A or its complement Ā must occur. This
means that P(A) + P(Ā) = 1.
Probability of the complementary event: P(Ā) = 1 − P(A).

Example 2.22:
An online retailer knows that 30% of customers spend more than $100 per
transaction. What is the probability that a customer spends at most $100
per transaction?
Let A be the event of spending more than $100 per transaction.
The event of spending at most $100 per transaction is the
complement of A.
Then P(Ā) = 1 − P(A) = 1 − 0.3 = 0.7.

NV HANH Probability and statistics First semester, 2023-2024 41 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Addition Rule:
The probability of the union of event A and B is
P(A + B) = P(A) + P(B) − P(AB)
If A and B are mutually exclusive then P(A + B) = P(A) + P(B)
P(A + B + C ) = P(A) + P(B) + P(C ) − P(AB) − P(BC )
−P(CA) + P(ABC )

NV HANH Probability and statistics First semester, 2023-2024 42 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Addition Rule:
The probability of the union of event A and B is
P(A + B) = P(A) + P(B) − P(AB)
If A and B are mutually exclusive then P(A + B) = P(A) + P(B)
P(A + B + C ) = P(A) + P(B) + P(C ) − P(AB) − P(BC )
−P(CA) + P(ABC )
In generral, P( ni=1 Ai ) = ni=1 P(Ai ) − i<j P(Ai Aj ) +
P P P
n−1 P(A A ...A )
P
i<j<k P(Ai Aj Ak ) − ... + (−1) 1 2 n

NV HANH Probability and statistics First semester, 2023-2024 42 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Addition Rule:
The probability of the union of event A and B is
P(A + B) = P(A) + P(B) − P(AB)
If A and B are mutually exclusive then P(A + B) = P(A) + P(B)
P(A + B + C ) = P(A) + P(B) + P(C ) − P(AB) − P(BC )
−P(CA) + P(ABC )
In generral, P( ni=1 Ai ) = ni=1 P(Ai ) − i<j P(Ai Aj ) +
P P P
n−1 P(A A ...A )
P
i<j<k P(Ai Aj Ak ) − ... + (−1) 1 2 n

Since AB̄ = A − B = A − AB then P(AB̄) = P(A) − P(AB).

NV HANH Probability and statistics First semester, 2023-2024 42 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.23:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school.

NV HANH Probability and statistics First semester, 2023-2024 43 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.23:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08

NV HANH Probability and statistics First semester, 2023-2024 43 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.23:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08
The probability that he/she is learning Spanish or German is
P(A + B) = P(A) + P(B) − P(AB) = 0.4 + 0.2 − 0.08 = 0.52

NV HANH Probability and statistics First semester, 2023-2024 43 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.23:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08
The probability that he/she is learning Spanish or German is
P(A + B) = P(A) + P(B) − P(AB) = 0.4 + 0.2 − 0.08 = 0.52
The probability that he/she is learning Spanish but is not learning
German is P(AB̄) = P(A) − P(AB) = 0.4 − 0.08 = 0.32

NV HANH Probability and statistics First semester, 2023-2024 43 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.24:
Suppose that 4 guests check their hats when they arrive at a restaurant,
and that these hats are returned to them in a random order when they
leave. Determine the probability that no guest will receive the proper hat.

NV HANH Probability and statistics First semester, 2023-2024 44 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.24:
Suppose that 4 guests check their hats when they arrive at a restaurant,
and that these hats are returned to them in a random order when they
leave. Determine the probability that no guest will receive the proper hat.
Let A be the event that no guest will receive the proper hat and let
Ai be the event that the i th guest receives his proper hat.

NV HANH Probability and statistics First semester, 2023-2024 44 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.24:
Suppose that 4 guests check their hats when they arrive at a restaurant,
and that these hats are returned to them in a random order when they
leave. Determine the probability that no guest will receive the proper hat.
Let A be the event that no guest will receive the proper hat and let
Ai be the event that the i th guest receives his proper hat.
Then Ā is the event that at least one guest will receive the proper hat
and A = A1 + A2 + A3 + A4 .

NV HANH Probability and statistics First semester, 2023-2024 44 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.24:
Suppose that 4 guests check their hats when they arrive at a restaurant,
and that these hats are returned to them in a random order when they
leave. Determine the probability that no guest will receive the proper hat.
Let A be the event that no guest will receive the proper hat and let
Ai be the event that the i th guest receives his proper hat.
Then Ā is the event that at least one guest will receive the proper hat
and A = A1 + A2 + A3 + A4 .
So P(Ā) = 4i=1 P(Ai ) − i<j P(Ai Aj ) + i<j<k P(Ai Aj Ak )
P P P
−P(A1 A2 A3 A4 ).

NV HANH Probability and statistics First semester, 2023-2024 44 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.24:
Suppose that 4 guests check their hats when they arrive at a restaurant,
and that these hats are returned to them in a random order when they
leave. Determine the probability that no guest will receive the proper hat.
Let A be the event that no guest will receive the proper hat and let
Ai be the event that the i th guest receives his proper hat.
Then Ā is the event that at least one guest will receive the proper hat
and A = A1 + A2 + A3 + A4 .
So P(Ā) = 4i=1 P(Ai ) − i<j P(Ai Aj ) + i<j<k P(Ai Aj Ak )
P P P
−P(A1 A2 A3 A4 ).
We have P(Ai ) = 3! 1
4! = 4 ; P(Ai Aj ) =
2!
4! = 1
12 ; P(Ai Aj Ak ) = 1!
4! =
1 1 1
24 ; P(A1 A2 A3 A4 ) = 4! = 24 .

NV HANH Probability and statistics First semester, 2023-2024 44 / 71

 Probability of Events Probability of the Union of Events – Addition Rule

Probability of the Union of Events – Addition Rule

Example 2.24:
Suppose that 4 guests check their hats when they arrive at a restaurant,
and that these hats are returned to them in a random order when they
leave. Determine the probability that no guest will receive the proper hat.
Let A be the event that no guest will receive the proper hat and let
Ai be the event that the i th guest receives his proper hat.
Then Ā is the event that at least one guest will receive the proper hat
and A = A1 + A2 + A3 + A4 .
So P(Ā) = 4i=1 P(Ai ) − i<j P(Ai Aj ) + i<j<k P(Ai Aj Ak )
P P P
−P(A1 A2 A3 A4 ).
We have P(Ai ) = 3! 1
4! = 4 ; P(Ai Aj ) =
2!
4! = 1
12 ; P(Ai Aj Ak ) = 1!
4! =
1 1 1
24 ; P(A1 A2 A3 A4 ) = 4! = 24 .
Then P(Ā) = 4. 41 − 6. 12
1 1
+ 4. 24 − 1
24 = 5
8 and P(A) = 1 − P(Ā) = 38 .

NV HANH Probability and statistics First semester, 2023-2024 44 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

We frequently need to know how two events are related. In particular,

we would like to know the probability of one event given the
occurrence of another related event.

NV HANH Probability and statistics First semester, 2023-2024 45 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

We frequently need to know how two events are related. In particular,

we would like to know the probability of one event given the
occurrence of another related event.
For example, we would certainly like to know the probability that a
person has lung disease given that he smokes. This is called a
conditional probability.

NV HANH Probability and statistics First semester, 2023-2024 45 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

We frequently need to know how two events are related. In particular,

we would like to know the probability of one event given the
occurrence of another related event.
For example, we would certainly like to know the probability that a
person has lung disease given that he smokes. This is called a
conditional probability.
Definition 2.8: A conditional probability is the probability of an
event A given that another event B has already occurred, and
denoted by P(A|B).

NV HANH Probability and statistics First semester, 2023-2024 45 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

NOTE:
The conditional probability P(A|B) is NOT the same as P(AB).

NV HANH Probability and statistics First semester, 2023-2024 46 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

NOTE:
The conditional probability P(A|B) is NOT the same as P(AB).
In the conditional probability P(A|B), we want to find the probability
of A occurring after B has already happened. In the conditional
probability the sample space is restricted to just event B before we
calculate the probability of A in the restricted sample space.

NV HANH Probability and statistics First semester, 2023-2024 46 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

NOTE:
The conditional probability P(A|B) is NOT the same as P(AB).
In the conditional probability P(A|B), we want to find the probability
of A occurring after B has already happened. In the conditional
probability the sample space is restricted to just event B before we
calculate the probability of A in the restricted sample space.
In P(AB) we want to find the probability of events A and B
happening at the same time in the unrestricted sample space.

NV HANH Probability and statistics First semester, 2023-2024 46 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

NOTE:
The conditional probability P(A|B) is NOT the same as P(AB).
In the conditional probability P(A|B), we want to find the probability
of A occurring after B has already happened. In the conditional
probability the sample space is restricted to just event B before we
calculate the probability of A in the restricted sample space.
In P(AB) we want to find the probability of events A and B
happening at the same time in the unrestricted sample space.

Conditional Probability Rule:

The conditional probability of event A given event B is

P(AB)
P(A|B) =
P(B)

NV HANH Probability and statistics First semester, 2023-2024 46 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

Example 2.25:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school and
suppose that he is learning Spanish. What is the probability that he is also
learning German.

NV HANH Probability and statistics First semester, 2023-2024 47 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

Example 2.25:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school and
suppose that he is learning Spanish. What is the probability that he is also
learning German.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08

NV HANH Probability and statistics First semester, 2023-2024 47 / 71

 Conditional Probability Definition of Conditional Probability

Conditional Probability

Example 2.25:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school and
suppose that he is learning Spanish. What is the probability that he is also
learning German.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08
The probability that he is learning German given that he is learning
Spanish is
P(AB) 0.08
P(B|A) = = = 0.2
P(A) 0.4

NV HANH Probability and statistics First semester, 2023-2024 47 / 71

 Conditional Probability Multiplication Rule

Multiplication Rule

Multiplication Rule:
From the conditional probability rule:

P(AB) P(AB)
P(A|B) = and P(B|A) =
P(B) P(A)

we have
P(AB) = P(A)P(B|A) = P(B)P(A|B)
(is called the Multiplication Rule).

NV HANH Probability and statistics First semester, 2023-2024 48 / 71

 Conditional Probability Multiplication Rule

Multiplication Rule

Multiplication Rule:
From the conditional probability rule:

P(AB) P(AB)
P(A|B) = and P(B|A) =
P(B) P(A)

we have
P(AB) = P(A)P(B|A) = P(B)P(A|B)
(is called the Multiplication Rule).

In general, we have

P(A1 A2 ...An ) = P(A1 )P(A2 |A1 )P(A3 |A1 A2 )...P(An |A1 ...An−1 )

NV HANH Probability and statistics First semester, 2023-2024 48 / 71

 Conditional Probability Multiplication Rule

Multiplication Rule

Example 2.26:
An aerospace company has submitted bids on two separate federal
government defense contracts. The company president believes that there
is a 40% probability of winning the first contract. If they win the first
contract, the probability of winning the second is 70%. What is the
probability that they win both contracts?

NV HANH Probability and statistics First semester, 2023-2024 49 / 71

 Conditional Probability Multiplication Rule

Multiplication Rule

Example 2.26:
An aerospace company has submitted bids on two separate federal
government defense contracts. The company president believes that there
is a 40% probability of winning the first contract. If they win the first
contract, the probability of winning the second is 70%. What is the
probability that they win both contracts?
Let A be the event winning the first contract and let B be the event
winning the second contract.
We have P(A) = 0.4; P(B|A) = 0.7

NV HANH Probability and statistics First semester, 2023-2024 49 / 71

 Conditional Probability Multiplication Rule

Multiplication Rule

Example 2.26:
An aerospace company has submitted bids on two separate federal
government defense contracts. The company president believes that there
is a 40% probability of winning the first contract. If they win the first
contract, the probability of winning the second is 70%. What is the
probability that they win both contracts?
Let A be the event winning the first contract and let B be the event
winning the second contract.
We have P(A) = 0.4; P(B|A) = 0.7
The probability that that they win both contracts is

P(AB) = P(A)P(B|A) = 0.4 ∗ 0.7 = 0.28

NV HANH Probability and statistics First semester, 2023-2024 49 / 71

 Conditional Probability Independence

Independence

Independent events:
Definition 2.9: Two events A and B are said to be independent if the
probability of one event is not affected by the occurrence of the other
event:
P(A|B) = P(A) or P(B|A) = P(B)

NV HANH Probability and statistics First semester, 2023-2024 50 / 71

 Conditional Probability Independence

Independence

Independent events:
Definition 2.9: Two events A and B are said to be independent if the
probability of one event is not affected by the occurrence of the other
event:
P(A|B) = P(A) or P(B|A) = P(B)

Hence, for independent events: P(AB) = P(A)P(B)

NV HANH Probability and statistics First semester, 2023-2024 50 / 71

 Conditional Probability Independence

Independence

Independent events:
Definition 2.9: Two events A and B are said to be independent if the
probability of one event is not affected by the occurrence of the other
event:
P(A|B) = P(A) or P(B|A) = P(B)

Hence, for independent events: P(AB) = P(A)P(B)

The events A1 , A2 , ..., An are called independent in pairs if
P(Ai Aj ) = P(Ai )P(Aj ), ∀i 6= j.

NV HANH Probability and statistics First semester, 2023-2024 50 / 71

 Conditional Probability Independence

Independence

Independent events:
Definition 2.9: Two events A and B are said to be independent if the
probability of one event is not affected by the occurrence of the other
event:
P(A|B) = P(A) or P(B|A) = P(B)

Hence, for independent events: P(AB) = P(A)P(B)

The events A1 , A2 , ..., An are called independent in pairs if
P(Ai Aj ) = P(Ai )P(Aj ), ∀i 6= j.
The events A1 , A2 , ..., An are called totally independent if for any
events Ai1 , Ai2 , ..., Aik , k ≥ 2, we have

P(Ai1 Ai2 ...Aik ) = P(Ai1 )P(Ai2 )...P(Aik )

NV HANH Probability and statistics First semester, 2023-2024 50 / 71

 Conditional Probability Independence

Independence

Example 2.27:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school and
suppose that he is learning Spanish. What is the probability that he is also
learning German.

NV HANH Probability and statistics First semester, 2023-2024 51 / 71

 Conditional Probability Independence

Independence

Example 2.27:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school and
suppose that he is learning Spanish. What is the probability that he is also
learning German.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08

NV HANH Probability and statistics First semester, 2023-2024 51 / 71

 Conditional Probability Independence

Independence

Example 2.27:
At a local language school, 40% of the students are learning Spanish, 20%
of the students are learning German, and 8% of the students are learning
both Spanish and German. Select at random a student at this school and
suppose that he is learning Spanish. What is the probability that he is also
learning German.
Let A be the event that he/she is learning Spanish and let B be the
event that he/she is learning German.
We have P(A) = 0.4; P(B) = 0.2 and P(AB) = 0.08
The probability that he is learning German given that he is learning
Spanish is P(B|A) = P(AB) 0.08
P(A) = 0.4 = 0.2 = P(B)
So A and B are independent.

NV HANH Probability and statistics First semester, 2023-2024 51 / 71

 Conditional Probability Independence

Independent events
Example 2.28:
A fair coin is tossed tiwce. Let A be the event that the fist toss is head, B
is the event that the second toss is head and C be the event that all two
tosses are the same. Are the events A, B, C independent in pairs or totally
independent?

NV HANH Probability and statistics First semester, 2023-2024 52 / 71

 Conditional Probability Independence

Independent events
Example 2.28:
A fair coin is tossed tiwce. Let A be the event that the fist toss is head, B
is the event that the second toss is head and C be the event that all two
tosses are the same. Are the events A, B, C independent in pairs or totally
independent?
The sample sapce S = {HH, HT , TH, TT } and A = {HH, HT };
B = {HH, TH} and C = {HH, TT }. So
P(A) = P(B) = P(C ) = 0.5.

NV HANH Probability and statistics First semester, 2023-2024 52 / 71

 Conditional Probability Independence

Independent events
Example 2.28:
A fair coin is tossed tiwce. Let A be the event that the fist toss is head, B
is the event that the second toss is head and C be the event that all two
tosses are the same. Are the events A, B, C independent in pairs or totally
independent?
The sample sapce S = {HH, HT , TH, TT } and A = {HH, HT };
B = {HH, TH} and C = {HH, TT }. So
P(A) = P(B) = P(C ) = 0.5.
We have AB = BC = CA = ABC = {HH}, then
P(AB) = P(BC ) = P(CA) = P(ABC ) = 0.25

NV HANH Probability and statistics First semester, 2023-2024 52 / 71

 Conditional Probability Independence

Independent events
Example 2.28:
A fair coin is tossed tiwce. Let A be the event that the fist toss is head, B
is the event that the second toss is head and C be the event that all two
tosses are the same. Are the events A, B, C independent in pairs or totally
independent?
The sample sapce S = {HH, HT , TH, TT } and A = {HH, HT };
B = {HH, TH} and C = {HH, TT }. So
P(A) = P(B) = P(C ) = 0.5.
We have AB = BC = CA = ABC = {HH}, then
P(AB) = P(BC ) = P(CA) = P(ABC ) = 0.25
Hence, P(AB) = P(A)P(B); P(BC ) = P(B)P(C ) and
P(AC ) = P(A)P(C ), then A, B, C are independent in pairs.

NV HANH Probability and statistics First semester, 2023-2024 52 / 71

 Conditional Probability Independence

Independent events
Example 2.28:
A fair coin is tossed tiwce. Let A be the event that the fist toss is head, B
is the event that the second toss is head and C be the event that all two
tosses are the same. Are the events A, B, C independent in pairs or totally
independent?
The sample sapce S = {HH, HT , TH, TT } and A = {HH, HT };
B = {HH, TH} and C = {HH, TT }. So
P(A) = P(B) = P(C ) = 0.5.
We have AB = BC = CA = ABC = {HH}, then
P(AB) = P(BC ) = P(CA) = P(ABC ) = 0.25
Hence, P(AB) = P(A)P(B); P(BC ) = P(B)P(C ) and
P(AC ) = P(A)P(C ), then A, B, C are independent in pairs.
Since P(ABC ) = 0.25 6= P(A)P(B)P(C ) = 0.125, then A, B, C are
not totally independent.
NV HANH Probability and statistics First semester, 2023-2024 52 / 71
 Conditional Probability Independence

Practice

Practice 2.2:
Suppose that out of all customers entered a bookstore, there are 30% of
them who asked the salesperson, 20% of them who bought books and
15% of them who did both of these 2 things. Select at random a customer
entered the store.
What is the probability that he/she did not neither ask the
salesperson nor buy books?
What is the probability that he/she did not buy books given that
he/she has asked the salesperson?

NV HANH Probability and statistics First semester, 2023-2024 53 / 71

 Conditional Probability Independence

Practice
Practice 2.3: The personnel department of an insurance company has
compiled data on promotion, classified by gender. The joint probability
table based on the data collected from 200 managers for the investigation
are given below:
Manager Promoted Not promoted
Male 0.17 0.68
Female 0.03 0.12
Select at random a manager.
What is the probability that the manager selected is promoted?
What is the probability that the manager selected is not promoted or
a female?
What is the probability that the manager selected is a male given that
he is promoted ?
Are promotion and gender dependent on each another?
NV HANH Probability and statistics First semester, 2023-2024 54 / 71
 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

An effective and simpler method of applying the probability rules is

the probability tree, wherein the events in an experiment are
represented by lines.

NV HANH Probability and statistics First semester, 2023-2024 55 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

An effective and simpler method of applying the probability rules is

the probability tree, wherein the events in an experiment are
represented by lines.
The resulting figure resembles a tree, hence the name.

NV HANH Probability and statistics First semester, 2023-2024 55 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

An effective and simpler method of applying the probability rules is

the probability tree, wherein the events in an experiment are
represented by lines.
The resulting figure resembles a tree, hence the name.
We can extend the tree diagram to two tosses of a coin:

NV HANH Probability and statistics First semester, 2023-2024 55 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Example 2.29:
It is known that 83% of regularly scheduled flights depart on time. Of
those flights depart on time, 90% of them arrive on time and of those
flights do not depart on time, 40% them arrive on time.
Find the probability that a plane arrives on time.
Find the probability that a plane departed on time, given that it has
arrived on time.

NV HANH Probability and statistics First semester, 2023-2024 56 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Aanlysis of Example 2.29:

When we observe a flight, there are outcomes: the flight departs on
time or not.

NV HANH Probability and statistics First semester, 2023-2024 57 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Aanlysis of Example 2.29:

When we observe a flight, there are outcomes: the flight departs on
time or not.
Given that the flight has departed on time or not, it will arrive on
time or not.

NV HANH Probability and statistics First semester, 2023-2024 57 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Aanlysis of Example 2.29:

When we observe a flight, there are outcomes: the flight departs on
time or not.
Given that the flight has departed on time or not, it will arrive on
time or not.
We have the following probability tree:

NV HANH Probability and statistics First semester, 2023-2024 57 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Problem:
Solution:
Let A be the event that "the flight departs on time" and let B be the
event that "the flight arrives on time".

NV HANH Probability and statistics First semester, 2023-2024 58 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Problem:
Solution:
Let A be the event that "the flight departs on time" and let B be the
event that "the flight arrives on time".
Then the system {A, Ā} is mutually exclusive and exhaustive.

NV HANH Probability and statistics First semester, 2023-2024 58 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Problem:
Solution:
Let A be the event that "the flight departs on time" and let B be the
event that "the flight arrives on time".
Then the system {A, Ā} is mutually exclusive and exhaustive.
We have B = B ∩ S = B ∩ (A + Ā) = AB + ĀB, then
P(B) = P(AB) + P(ĀB) = P(A)P(B|A) + P(Ā)P(B|Ā)

NV HANH Probability and statistics First semester, 2023-2024 58 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Problem:
Solution:
Let A be the event that "the flight departs on time" and let B be the
event that "the flight arrives on time".
Then the system {A, Ā} is mutually exclusive and exhaustive.
We have B = B ∩ S = B ∩ (A + Ā) = AB + ĀB, then
P(B) = P(AB) + P(ĀB) = P(A)P(B|A) + P(Ā)P(B|Ā)
So the probability that a plane arrives on time is
P(B) = 0.83 ∗ 0.9 + 0.17 ∗ 0.4 = 0.815
81.5% of flights will arrive on time.

NV HANH Probability and statistics First semester, 2023-2024 58 / 71

 Total Probability Rule and Bayes’ Rule Probability Tree

The Probability Tree

Problem:
Solution:
Let A be the event that "the flight departs on time" and let B be the
event that "the flight arrives on time".
Then the system {A, Ā} is mutually exclusive and exhaustive.
We have B = B ∩ S = B ∩ (A + Ā) = AB + ĀB, then
P(B) = P(AB) + P(ĀB) = P(A)P(B|A) + P(Ā)P(B|Ā)
So the probability that a plane arrives on time is
P(B) = 0.83 ∗ 0.9 + 0.17 ∗ 0.4 = 0.815
81.5% of flights will arrive on time.
The probability that a plane departed on time, given that it has
arrived on time is
P(AB) P(A)P(B|A) 0.83 ∗ 0.9
P(A|B) = = = = 0.917
P(B) P(B) 0.815
NV HANH Probability and statistics First semester, 2023-2024 58 / 71
 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

The formula:
P(B) = P(AB) + P(ĀB) = P(A)P(B|A) + P(Ā)P(B|Ā) is called the
Total Probability Rule .
P(A)P(B|A)
The formula: P(A|B) = P(B) is called the Bayes’ Rule.

NV HANH Probability and statistics First semester, 2023-2024 59 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

The formula:
P(B) = P(AB) + P(ĀB) = P(A)P(B|A) + P(Ā)P(B|Ā) is called the
Total Probability Rule .
P(A)P(B|A)
The formula: P(A|B) = P(B) is called the Bayes’ Rule.

In general:
Let {A1 , ..., An } be a system of mutually exclusive and exhautive events.
Total Probability Rule:
P(B) = P(A1 )P(B|A1 ) + ... + P(An )P(B|An ) = ni=1 P(Ai )P(B|Ai )
P
P(Aj )P(B|Aj ) P(Aj )P(B|Aj )
Bayes’ Rule: P(Aj |B) = P(B) = Pn
i=1 P(Ai )P(B|Ai )

NV HANH Probability and statistics First semester, 2023-2024 59 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Example 2.30:
In a certain assembly plant, three machines, B1 , B2 , and B3 , make
30%, 45%, and 25%, respectively, of the products. It is known from past
experience that 2%, 3%, and 2% of the products made by each machine,
respectively, are defective. Now, suppose that a finished product is
randomly selected.
What is the probability that it is defective?
If a product was chosen randomly and found to be defective, what is
the probability that it was made by machine B3 ?

NV HANH Probability and statistics First semester, 2023-2024 60 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Let Bi be the event that "the product chosen is made by machine Bi ;

with i = 1, 2, 3" and let A be the event that "the product chosen is
defective".

NV HANH Probability and statistics First semester, 2023-2024 61 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Let Bi be the event that "the product chosen is made by machine Bi ;

with i = 1, 2, 3" and let A be the event that "the product chosen is
defective".
We have: {B1 , B2 , B3 } is a system of mutually exclusive and
exhautive events and: P(B1 ) = 0.3; P(B2 ) = 0.45; P(B3 ) = 0.25 and
P(A|B1 ) = 0.02; P(A|B2 ) = 0.03; P(A|B3 ) = 0.02

NV HANH Probability and statistics First semester, 2023-2024 61 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Let Bi be the event that "the product chosen is made by machine Bi ;

with i = 1, 2, 3" and let A be the event that "the product chosen is
defective".
We have: {B1 , B2 , B3 } is a system of mutually exclusive and
exhautive events and: P(B1 ) = 0.3; P(B2 ) = 0.45; P(B3 ) = 0.25 and
P(A|B1 ) = 0.02; P(A|B2 ) = 0.03; P(A|B3 ) = 0.02
We have the following probability tree:

NV HANH Probability and statistics First semester, 2023-2024 61 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

By the Total Probability Rule, the probability that "the product

chosen is defective" is
P(A) = P(B1 )P(A|B1 ) + P(B2 )P(A|B2 ) + P(B3 )P(A|B3 )
= 0.3 ∗ 0.02 + 0.45 ∗ 0.03 + 0.25 ∗ 0.02 = 0.0245

NV HANH Probability and statistics First semester, 2023-2024 62 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

By the Bayes’ Rule, the probability that the product chosen was made
by machine B3 , given that it was found to be defective is:

P(B3 )P(A|B3 ) 0.25 ∗ 0.02 10

P(B3 |A) = = =
P(A) 0.0245 49

NV HANH Probability and statistics First semester, 2023-2024 63 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Practice 2.4:
A paint-store chain produces and sells latex and semigloss paint. Based on
long-range sales, the probability that a customer will purchase latex paint
is 0.75. Of those that purchase latex paint, 60% also purchase rollers. But
only 30% of semigloss paint buyers purchase rollers. A randomly selected
buyer purchases a roller and a can of paint. What is the probability that
the paint is latex?

NV HANH Probability and statistics First semester, 2023-2024 64 / 71

 Total Probability Rule and Bayes’ Rule Total Probability Rule and Bayes’ Rule

Total Probability Rule and Bayes’ Rule

Practice 2.5:
Researchers have developed statistical models based on financial ratios
that predict whether a company will go bankrupt over the next 12 months.
In a test of one such model, the model correctly predicted the bankruptcy
of 85% of firms that did in fact fail, and it correctly predicted
nonbankruptcy for 74% of firms that did not fail. Suppose that we expect
8% of the firms in a particular city to fail over the next year.
What is the probability that model predicts bankruptcy for a firm that
you own?
Suppose that the model predicts bankruptcy for a firm that you own.
What is the probability that your firm will fail within the next 12
months?

NV HANH Probability and statistics First semester, 2023-2024 65 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Trial:
A Bernoulli trial is a random experiment that
results two posibble outcomes labeled by "success" and "failure"

NV HANH Probability and statistics First semester, 2023-2024 66 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Trial:
A Bernoulli trial is a random experiment that
results two posibble outcomes labeled by "success" and "failure"
the probability of success is a constant p and the probability of failure
is a constant q = 1 − p.

NV HANH Probability and statistics First semester, 2023-2024 66 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Trial:
A Bernoulli trial is a random experiment that
results two posibble outcomes labeled by "success" and "failure"
the probability of success is a constant p and the probability of failure
is a constant q = 1 − p.

Exapmle 2.31:
Tossing a fair coin is a Bernoulli trial:
results two posibble outcomes: Head (labeled by "success") or Tail
(labeled by "failure")
P(success) = p = 0.5 and P(failure) = q = 1 − p = 0.5.

NV HANH Probability and statistics First semester, 2023-2024 66 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.32:
The defective rate in a production line is 5%; testing an item is a Bernoulli
trial:
results two posibble outcomes: the item is defective (labeled by
"success") or it is non-defective (labeled by "failure")
P(success) = p = 0.05 and P(failure) = q = 1 − p = 0.95.

NV HANH Probability and statistics First semester, 2023-2024 67 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.32:
The defective rate in a production line is 5%; testing an item is a Bernoulli
trial:
results two posibble outcomes: the item is defective (labeled by
"success") or it is non-defective (labeled by "failure")
P(success) = p = 0.05 and P(failure) = q = 1 − p = 0.95.

Exapmle 2.33:
"A salesperson called to a customer" is a Bernoulli trial:
results two posibble outcomes: she closed a sale (labeled by
"success") or she did not close a sale (labeled by "failure")
P(success) = p = 0.6 and P(failure) = q = 1 − p = 0.4.

NV HANH Probability and statistics First semester, 2023-2024 67 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Rule
Consider a Bernoulli trial where P(success) = p and
P(failure) = q = 1 − p

NV HANH Probability and statistics First semester, 2023-2024 68 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Rule
Consider a Bernoulli trial where P(success) = p and
P(failure) = q = 1 − p
Repeat the Bernoulli trial n times.

NV HANH Probability and statistics First semester, 2023-2024 68 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Rule
Consider a Bernoulli trial where P(success) = p and
P(failure) = q = 1 − p
Repeat the Bernoulli trial n times.
The probability that there are exactly k successes out n trials is Pn (k)

NV HANH Probability and statistics First semester, 2023-2024 68 / 71

 Bernoulli Rule

Bernoulli Rule

Bernoulli Rule
Consider a Bernoulli trial where P(success) = p and
P(failure) = q = 1 − p
Repeat the Bernoulli trial n times.
The probability that there are exactly k successes out n trials is Pn (k)
The Bernoulli rule: Pn (k) = Cnk p k q n−k

NV HANH Probability and statistics First semester, 2023-2024 68 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.34:
Consider the Bernoulli trial of tossing a fair coin: p = P(Head) = 0.5
and q = P(Tail) = 0.5
The probability that there are exactly three heads out of 4 tosses is
P4 (3) = C43 0.53 0.51 = 0.25

NV HANH Probability and statistics First semester, 2023-2024 69 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.34:
Consider the Bernoulli trial of tossing a fair coin: p = P(Head) = 0.5
and q = P(Tail) = 0.5
The probability that there are exactly three heads out of 4 tosses is
P4 (3) = C43 0.53 0.51 = 0.25

Explanation:
The event "there are exactly three heads out of 4 tosses" = HHHT +
HHTH + HTHH + THHH.

NV HANH Probability and statistics First semester, 2023-2024 69 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.34:
Consider the Bernoulli trial of tossing a fair coin: p = P(Head) = 0.5
and q = P(Tail) = 0.5
The probability that there are exactly three heads out of 4 tosses is
P4 (3) = C43 0.53 0.51 = 0.25

Explanation:
The event "there are exactly three heads out of 4 tosses" = HHHT +
HHTH + HTHH + THHH.
Then P4 (3) = P(HHHT ) + P(HHTH) + P(HTHH) + P(THHH) =
C43 0.53 0.51 = 0.25

NV HANH Probability and statistics First semester, 2023-2024 69 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.35:
The defective rate in a production line is supposed to be 5%. Tested 10
items from the production line.

NV HANH Probability and statistics First semester, 2023-2024 70 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.35:
The defective rate in a production line is supposed to be 5%. Tested 10
items from the production line.
The probability that there are exactly 2 defective items out of 10
2 0.052 0.958 = 0.075
selected items is: P10 (2) = C10

NV HANH Probability and statistics First semester, 2023-2024 70 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.35:
The defective rate in a production line is supposed to be 5%. Tested 10
items from the production line.
The probability that there are exactly 2 defective items out of 10
2 0.052 0.958 = 0.075
selected items is: P10 (2) = C10
The probability that there are at least one defective item out of 10
0 0.050 0.9510 = 0.401
selected items is: 1 − P10 (0) = 1 − C10

NV HANH Probability and statistics First semester, 2023-2024 70 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.36:
Suppose that the probability that a salesperson closed a sale in each call to
a customer is 70%. How many calls will she have to make such that the
probability that she will close at least one sale is more than 0.99?

NV HANH Probability and statistics First semester, 2023-2024 71 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.36:
Suppose that the probability that a salesperson closed a sale in each call to
a customer is 70%. How many calls will she have to make such that the
probability that she will close at least one sale is more than 0.99?
Suppose that she will have to make at leat n calls.

NV HANH Probability and statistics First semester, 2023-2024 71 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.36:
Suppose that the probability that a salesperson closed a sale in each call to
a customer is 70%. How many calls will she have to make such that the
probability that she will close at least one sale is more than 0.99?
Suppose that she will have to make at leat n calls.
The probability she will close at least one sale out of n calls is
1 − Pn (0) = 1 − Cn0 0.70 0.3n = 1 − 0.3n > 0.99 ⇔ 0.3n < 0.01 ⇔ n >
3.82

NV HANH Probability and statistics First semester, 2023-2024 71 / 71

 Bernoulli Rule

Bernoulli Rule

Exapmle 2.36:
Suppose that the probability that a salesperson closed a sale in each call to
a customer is 70%. How many calls will she have to make such that the
probability that she will close at least one sale is more than 0.99?
Suppose that she will have to make at leat n calls.
The probability she will close at least one sale out of n calls is
1 − Pn (0) = 1 − Cn0 0.70 0.3n = 1 − 0.3n > 0.99 ⇔ 0.3n < 0.01 ⇔ n >
3.82
So she will have to make at leat n = 4 calls.

NV HANH Probability and statistics First semester, 2023-2024 71 / 71