Probability Concepts and Applications
Probability Concepts and Applications
Probability Concepts and Applications
Applications
Learning Objectives
1. Understand the basic foundations of
probability analysis.
2. Describe statistically dependent and
independent events.
3. Use Bayes’ theorem to establish posterior
probabilities.
4. Describe and provide examples of both
discrete and continuous random variables.
5. Explain the difference between discrete and
continuous probability distributions.
6. Calculate expected values and variances and
use the normal table.
Outline
2.1 Introduction
2.2 Fundamental Concepts
2.3 Mutually Exclusive and Collectively
Exhaustive Events
2.4 Statistically Independent Events
2.5 Statistically Dependent Events
2.6 Revising Probabilities with Bayes’
Theorem
2.7 Further Probability Revisions
Outline
2.8 Random Variables
2.9 Probability Distributions
2.10 The Binomial Distribution
2.11 The Normal Distribution
2.12 The F Distribution
2.13 The Exponential Distribution
2.14 The Poisson Distribution
Introduction
0 P (event) 1
Total 1
Drawing a Card
MUTUALLY COLLECTIVELY
DRAWS
EXCLUSIVE EXHAUSTIVE
1. Draws a spade and a club Yes No
2. Draw a face card and a Yes Yes
number card
3. Draw an ace and a 3 Yes No
4. Draw a club and a nonclub Yes Yes
5. Draw a 5 and a diamond No No
6. Draw a red card and a No No
diamond
Adding Mutually Exclusive Events
P (A and B)
P (A or B) = P (A) + P (B)
P (A or B) = P (A) + P (B)
– P (A and B)
Figure 2.1 Figure 2.2
Statistically Independent Events
4 balls
White (W) 4
and Probability (WL) =
10
Lettered (L)
2 balls
The urn White (W) 2
contains 10 Probability (WN) =
and 10
balls: Numbered (N)
3 balls
Yellow (Y) 3
Probability (YL) =
and 10
Lettered (L)
Figure 2.3
1 ball Yellow (Y) 1
and Numbered (N) Probability (YN) =
10
When Events Are Dependent
P (YL) 0.3
P (L | Y) = = = 0.75
P (Y) 0.4
Prior
Probabilities
Bayes’ Posterior
Process Probabilities
New
Information
Figure 2.4
Posterior Probabilities
A cup contains two dice identical in appearance but
one is fair (unbiased), the other is loaded (biased).
The probability of rolling a 3 on the fair die is 1/6 or 0.166.
The probability of tossing the same number on the loaded
die is 0.60.
We select one by chance,
toss it, and get a 3.
What is the probability that
the die rolled was fair?
What is the probability that
the loaded die was rolled?
Posterior Probabilities
We know the probability of the die being fair or
loaded is:
P (fair) = 0.50 P (loaded) = 0.50
And that
P (3 | fair) = 0.166 P (3 | loaded) = 0.60
Table 2.2
Given a 3 was rolled:
STATE OF P (B | STATE PRIOR JOINT POSTERIOR
NATURE OF NATURE) PROBABILITY PROBABILITY PROBABILITY
Table 2.3
General Form of Bayes’ Theorem
P ( B | A) P ( A)
P( A | B)
P ( B | A) P ( A) P ( B | A ) P ( A )
where
A the complement of the event A ;
for example, if A is the event “fair die”,
then A is “loaded die”.
General Form of Bayes’ Theorem
RANGE OF
EXPERIMENT OUTCOME RANDOM VARIABLES RANDOM
VARIABLES
Students Strongly agree (SA) 5 if SA 1, 2, 3, 4, 5
respond to a Agree (A) 4 if A..
questionnaire Neutral (N) X = 3 if N..
Disagree (D) 2 if D..
Strongly disagree (SD) 1 if SD
One machine Defective Y= 0 if defective 0, 1
is inspected 1 if not defective
Not defective
Consumers Good 3 if good…. 1, 2, 3
respond to Average Z= 2 if average
how they like a Poor 1 if poor…..
product
Table 2.5
Probability Distribution of a
Discrete Random Variable
For discrete random variables a
probability is assigned to each event.
0.4 –
0.3 –
P (X)
0.2 –
0.1 –
0 –| | | | | |
Figure 2.5
1 2 3 4 5
X
Probability Distribution for
Dr. Shannon’s Class
0.2 –
0.1 –
Figure 2.5 0 –| | | | | |
1 2 3 4 5
X
Expected Value of a Discrete
Probability Distribution
The expected value is a measure of the central
tendency of the distribution and is a weighted
average of the values of the random variable.
n
E X X i P X i
i 1
X 1 P X 1 X 2 P ( X 2 ) ... X n P ( X n )
where
X i = random variable’s possible values
P ( X i ) = probability of each of the random variable’s
n possible values
i 1
= summation sign indicating we are adding all n
possible values
E ( X ) = expected value or mean of the random sample
Expected Value of a Discrete
Probability Distribution
For Dr. Shannon’s class:
n
E X X i P X i
i 1
where
X i = random variable’s possible values
E ( X ) = expected value of the random variable
[ X i E ( X )]= difference between each value of the random
variable and the expected mean
P ( X i ) = probability of each possible value of the
random variable
Variance of a
Discrete Probability Distribution
σ Variance σ 2
where
= square root
σ = standard deviation
Variance of a
Discrete Probability Distribution
σ Variance σ 2
where
= square
Forroot
Dr. Shannon’s class:
σ = standard deviation
σ Variance
1.29 1.14
Using Excel
Formulas in an Excel Spreadsheet for the Dr.
Shannon Example
Program 2.1A
Using Excel
Excel Output for the Dr. Shannon Example
Program 2.1B
Probability Distribution of a
Continuous Random Variable
Since random variables can take on an infinite
number of values, the fundamental rules for
continuous random variables must be modified.
The sum of the probability values must still
equal 1.
The probability of each individual value of the
random variable occurring must equal 0 or
the sum would be infinitely large.
The probability distribution is defined by a
continuous mathematical function called the
probability density function or just the probability
function.
This is represented by f (X).
Probability Distribution of a
Continuous Random Variable
Probability
| | | | | | |
5.06 5.10 5.14 5.18 5.22 5.26 5.30
Weight (grams)
Figure 2.6
The Binomial Distribution
We let
r = number of successes
q = 1 – p = the probability of a failure
The Binomial Distribution
The binomial formula is:
n!
Probability of r successes in n trials p r q n r
r ! ( n r )!
Thus
5!
P (4 successes in 5 trials ) 0.54 0.55 4
4!(5 4)!
5( 4 )(3)(2)(1)
(0.0625 )(0.5 ) 0.15625
4(3)(2)(1)(1! )
Solving Problems with the
Binomial Formula
Binomial Probability Distribution for n = 5 and p = 0.50.
0.4 –
0.3 –
Probability P (r)
0.2 –
0.1 –
| | | | | | |
0–
Figure 2.7 1 2 3 4 5 6
Values of r (number of successes)
Solving Problems with
Binomial Tables
MSA Electronics is experimenting with the
manufacture of a new transistor.
Every hour a random sample of 5 transistors is
taken.
The probability of one transistor being defective
is 0.15.
What is the probability of finding 3, 4, or 5 defective?
So n = 5, p = 0.15, and r = 3, 4, or 5
Program 2.2A
Using Excel
Excel Output for the Binomial Example
Program 2.2B
The Normal Distribution
The normal distribution is the one of the
most popular and useful continuous
probability distributions.
The formula for the probability density
function is rather complex:
( x )2
1
f (X ) e 2 2
2
| | |
40 µ = 50 60
Smaller µ, same
| | |
µ = 40 50 60
Larger µ, same
| | |
40 50 µ = 60
Figure 2.8
The Normal Distribution
Same µ, smaller
Same µ, larger
Figure 2.9
µ
Using the Standard Normal Table
Step 1
Convert the normal distribution into a standard
normal distribution.
A standard normal distribution has a mean
of 0 and a standard deviation of 1
The new standard random variable is Z
X
Z
where
X = value of the random variable we want to measure
µ = mean of the distribution
= standard deviation of the distribution
Z = number of standard deviations from X to the mean, µ
Using the Standard Normal Table
For example, µ = 100, = 15, and we want to find
the probability that X is less than 130.
X 130 100
Z
15
30
2 std dev µ = 100
15 P(X < 130) = 15
| | | | | | |
X = IQ
55 70 85 100 115 130 145
X
| | | | | | | Z
–3 –2 –1 0 1 2 3
Figure 2.10
Using the Standard Normal Table
Step 2
Look up the probability from a table of normal
curve areas.
Use Appendix A or Table 2.9 (portion below).
The column on the left has Z values.
The row at the top has second decimal
places for the Z values.
AREA UNDER THE NORMAL CURVE
Z 0.00 0.01 0.02 0.03
1.8 0.96407 0.96485 0.96562 0.96638 P(X < 130)
1.9
2.0
0.97128
0.97725
0.97193
0.97784
0.97257
0.97831
0.97320
0.97882
= P(Z < 2.00)
2.1 0.98214 0.98257 0.98300 0.98341 = 0.97725
2.2 0.98610 0.98645 0.98679 0.98713
X 125 100
Z From Appendix A, for Z = 1.25
20 the area is 0.89435.
25 The probability is about
1.25
20 0.89 that Haynes will not
violate the contract.
X 75 100
Z
20
But Appendix A has only
25 positive Z values, and the
1.25
20 probability we are looking for
is in the negative tail.
= 20 days
Program 2.3A
Using Excel
Excel Output for the Normal Distribution Example
Program 2.3B
The Empirical Rule
–1 +1
a µ b
–2 +2
a µ b
F
Figure 2.15
The F Distribution
This means
P(F > 4.39) = 0.05
0.05
F = 4.39
Figure 2.16
Using Excel
Program 2.4A
Using Excel
Excel Output for the F Distribution
Program 2.4B
The Exponential Distribution
The exponential distribution (also called the
negative exponential distribution)
distribution is a
continuous distribution often used in queuing
models to describe the time required to service
a customer. Its probability function is given by:
f ( X ) e x
where
X = random variable (service times)
µ = average number of units the service facility can
handle in a specific period of time
e = 2.718 (the base of natural logarithms)
The Exponential Distribution
1
Expected value Average service time
1 f(X)
Variance 2
Figure 2.17
Arnold’s Muffler Shop
Arnold’s Muffler Shop installs new
mufflers on automobiles and small trucks.
The mechanic can install 3 new mufflers
per hour.
Service time is exponentially distributed.
Figure 2.18
Using Excel
Program 2.5A
Using Excel
Excel Output for the Exponential Distribution
Program 2.5B
The Poisson Distribution
The Poisson distribution is a discrete
distribution that is often used in queuing models
to describe arrival rates over time. Its probability
function is given by:
x e
P( X )
X!
where
P(X) = probability of exactly X arrivals or occurrences
= average number of arrivals per unit of time
(the mean arrival rate)
e= 2.718, the base of natural logarithms
X= specific value (0, 1, 2, 3, …) of the random
variable
The Poisson Distribution
The mean and variance of the distribution are both
.
Expected value =
Variance =
Poisson Distribution
x e
P( X )
X!
2 0 e 2 1(0.1353)
P ( 0) 0.1353
0! 1
21 e 2 2(0.1353)
P (1) 0.2706
1! 1
2 2 e 2 4(0.1353)
P ( 2) 0.2706
2! 2
Poisson Distribution
Figure 2.19
Using Excel
Functions in an Excel 2010 Spreadsheet for the
Poisson Distribution
Program 2.6A
Using Excel
Program 2.6B
Exponential and Poisson
Together
If the number of occurrences per time
period follows a Poisson distribution, then
the time between occurrences follows an
exponential distribution:
Suppose the number of phone calls at a
service center followed a Poisson distribution
with a mean of 10 calls per hour.
Then the time between each phone call would
be exponentially distributed with a mean time
between calls of 6 minutes (1/10 hour).