Chapter15 - Decision Making
Chapter15 - Decision Making
Decision Making
Chapter 15
Decision Analysis
What is decision analysis?
Uncertainty:
What will be the reaction of potential customers?
$
$200,000
$160,000
Revenue = $900 x
Profit
$120,000
Loss
$40,000
Uncertainty:
What will be the weather conditions of the season?
Where are prices headed in the upcoming season?
Some examples
Uncertainty:
How likely is oil there? How much?
Should geologists investigate the site further before
drilling?
Frequently, one question to be addressed with
decision analysis is whether to make the
needed decision immediately or to first do
some testing (at some expense) to reduce the
level of uncertainty about the outcome of the
decision.
15.1 A Prototype Example
Oil Dry
alternative
Chance of Status 1 in 4 3 in 4
Summary
1 2 3 4
category characteristics
Pessimistic methodthe
maximin payoff criterion
State of Nature
Alternative Oil Dry
1. Drill for Oil 700 -100
2. Sell the 90 90
Land
Chance of ? ?
Status
Maximax payoff criterion
For each possible action, find the maximum
payoff over all possible states of nature. Next,
find the maximum of these maximum payoffs.
Choose the action whose maximum payoff gives
this maximum.
State of Nature Maximax
payoff
Alternative Oil Dry
For each possible action, find the minimum payoff over all
possible states of nature. Next, find the maximum of these
minimum payoffs. Choose the action whose minimum
payoff gives this maximum. (Pessimistic method)
Bayes Rule
P782
15.2-2
15.2-3
15.2-2. Jean Clark is the manager of the Midtown
Saveway Grocery Store. She now needs to replenish her
supply of strawberries. Her regular supplier can provide
as many cases as she wants. However, because these
strawberries already are very ripe, she will need to sell
them tomorrow and then discard any that remain unsold.
Jean estimates that she will be able to sell 10, 11, 12, or
13 cases tomorrow. She can purchase the strawberries for
$3 per case and sell them for $8 per case. Jean now
needs to decide how many cases to purchase. Jean has
checked the stores records on daily sales of strawberries.
On this basis, she estimates that the prior probabilities
are 0.2, 0.4, 0.3, and 0.1 for being able to sell 10, 11, 12,
and 13 cases of strawberries tomorrow.
(a) Develop a decision analysis formulation of this
problem by identifying the alternative actions, the states
of nature, and the payoff table.
(b) How many cases of strawberries should Jean
purchase if she uses the maximin payoff criterion?
(c) How many cases should be purchased according to the
maximum likelihood criterion?
(d) How many cases should be purchased according to
Bayes decision rule?
15.2-3.* Warren Buffy is an enormously wealthy investor who
has built his fortune through his legendary investing acumen. He
currently has been offered three major investments and he
would like to choose one. The first one is a conservative
investment that would perform very well in an improving
economy and only suffer a small loss in a worsening economy.
The second is a speculative investment that would perform
extremely well in an improving economy but would do very
badly in a worsening economy. The third is a countercyclical
investment that would lose some money in an improving
economy but would perform well in a worsening economy.
Warren believes that there are three possible scenarios over the
lives of these potential investments: (1) an improving economy,
(2) a stable economy, and (3) a worsening economy. He is
pessimistic about where the economy is headed, and so has
assigned prior probabilities of 0.1, 0.5, and 0.4, respectively, to
these three scenarios. He also estimates that his profits under
these respective scenarios are those given by the following
table:
Which investment should Warren make under each of the
following criteria?
(a) Maximin payoff criterion.
(b) Maximum likelihood criterion.
(c) Bayes decision rule.
Reconsider Prob. 15.2-3. Warren Buffy decides that Bayes
decision rule is his most reliable decision criterion. He believes
that 0.1 is just about right as the prior probability of an
improving economy, but is quite uncertain about how to split the
remaining probabilities between a stable economy and a
worsening economy.
Therefore, he now wishes to do sensitivity analysis with respect
to these latter two prior probabilities.
(a) Reapply Bayes decision rule when the prior probability of a
stable economy is 0.3 and the prior probability of a worsening
economy is 0.6.
(b) Reapply Bayes decision rule when the prior probability of a
stable economy is 0.7 and the prior probability of a worsening
economy is 0.2.
(c) Graph the expected profit for each of the three investment
alternatives versus the prior probability of a stable economy
(with the prior probability of an improving economy fixed at
0.1). Use this graph to identify the crossover points where the
decision shifts from one investment to another.
Sensitivity Analysis with Bayes Decision Rule
Sensitivity analysis commonly is used with various
applications of operations research to study the
effect if some of the numbers included in the
mathematical model are not correct.
State of Nature Expected
payoff
Alternative Oil Dry
1. Drill for Oil 700 -100 100
2. Sell the Land 90 90 90
Prior probability 0.25 0.75 90
Sensitivity analysis
Goferborokes management feels that the true
chances of having oil on the tract of land are likely
to lie somewhere between 15 and 35 percent. In
other words, the true prior probability of having oil
is likely to be in the range from 0.15 to 0.35, so the
corresponding prior probability of the land being
dry would range from 0.85 to 0.65.
State of Nature Expected
payoff
Alternative Oil Dry
1. Drill for Oil 700 -100 20
2. Sell the Land 90 90 90
Prior probability 0.15 0.85
Let
P = prior probability of oil,
then
the expected payoff from drilling for any p is
E[Payoff(drill)] = 700p 100(1-p)= 800p100.
How the expected payoff changes when the probability
changes
Expected
payoff
700
Region where the Drill for oil
decision should
600 be to drill for oil
Region where
the decision
should be to
500 sell the land
400
300
Conclusion:
200 Should sell the land if p < 0.2375.
Should drill for oil if p >0.2375.
100
Sell the land
0.2375
0
0. 0.
0.2 0.4 1
6 8
Crossove
r point
-100
Exercise
P782
15.2-1
15.2-5
15.2-8
15.3 Decision Making with Experimentation
Decision making
0.25(0.6)=0.15 0.15/0.3=0.5
0.6 o il Oil and FSS Oil,given FSS
iv en
S,g
FS
U S S, 0. 4
given 0.25(0.4)=0.1 0.1/0.7=0.14
oil Oil and
5
USS
0.
il
O
0.75(0.2)=0.15 0.15/0.3=0.5
0.7
ve
y
S ,gi
FS 0
.8 0.75(0.8)=0.6 0.6/0.7=0.86
USS,
given
Dry Dry and USS Dry, given USS
Unconditional probabilities:P(FSS)=0.15+0.15=0.3
P(finding) P(USS)=0.1+0.6=0.7
The value of experimentation
How?
Exercise
Expected Value of Perfect Information
State of Nature
0.25 0.75
P785
15.3-1a-d
15.3-3
Expected Value of Experimentation
P790
15.3-1Calculate Posterior Probability
15.4 Decision Trees
Probability
Decision name Event name
Terminal value
Cash flow Cash flow
Probability
Event name
Terminal value
Cash flow
Decision name
Terminal value
Cash flow
Prototype Example
oil
The prototype dr
ill dry
example involves
sel
l
a sequence of two rab
le
fa vo
decisions: un
ic
ora
sm
survey be ble
dr
sei
ill y
dr
conducted before Do
sel
l
an action is
chosen?
oil
2. Which action (drill
ill dry
dr
for oil or sell the No seismic
chosen?
Data prepared for calculation
payoff
3)
0.14 670
il(
-15.7 O
0
80
f
ill Dr 0
Dr y(0
60 0
-10 .85
7) -130
c
9
(0.
7) Se 0
le ll
b
v ora 60
U nfa 0
123
.5) 670
b il(0
270 O 0
ic
0 80
sm
Fa g
v ora ill
sei
0
Dr
-30
ble 270 Dr
Do
(0. 0 y( 0
123 3)
d - 10 .5) -130
a 90
Se
ll
60
5) 700
il (0.2
100 O
0
80
h
ill
Dr Dr 0
100 y(0
0 0 . 75 -100
e - 10 )
No seismic 90
Se
ll
90
The Procedure of Calculation
1. Start at the right side of the decision tree and move left one
column at a time. For each column, perform either step 2 or
step 3 depending upon whether the forks in that column are
chance forks or decision forks.
2. For each chance fork, calculate its expected payoff. Record
this expected payoff for each decision fork in boldface next
to the fork.
3. For each decision fork, compare the expected payoffs of its
branches and choose the alternative whose branch has the
largest expected payoff. In each case, record the choice on
the decision tree by inserting a double dash as a barrier
through each rejected branch.
The Final Decision Tree
payoff
)
0.143 670
il(
-15.7 O
800
f
ill Dr 0
Dr y(0
60 0
-10 .85
7) -130
c
9
(0.
7) Sel 0
b le l
vo ra 60
U nfa 0
123
.5) 670
b il(0
270 O 0
ic
0 80
sm
Fa g
vo
ill
sei
rab 0
Dr
-30
le( 270 Dr
Do
0.3 0 y( 0
123 ) d - 10 .5) -130
a 90
Sel
l
60
) 700
(0 . 25
100 Oi l
800
h
ill
Dr Dr 0
100 y(0
0 0 . 75 -100
e - 10 )
No seismic 90
Sel
l 90
Decision Result
The chosen alternative also is indicated by inserting a double dash as a
barrier through each rejected branch.
The decision result is: Do seismic survey (EP=123) payoff
3)
.14 670
il( 0
-15.7 O
800
l f
il Dr 0
Dr y(0
60 0
-10 .85
7) -130
c
9
(0.
7) Sel 0
ble l
o ra 60
fav
Un 0
123
.5) 670
b
O il(0
270
ic
0 800
sm
Fa g
vo
ill
sei
rab 0
Dr
-30
le( 270 Dr
Do
0.3 0 y( 0
123 ) d - 10 .5) -130
a 90
Sel
l 60
5) 700
0.2
100 Oil(
800
h
ill
Dr Dr 0
100 y(0
0 0 . 75 -100
e - 10 )
No seismic
Do seismic survey Sel
90
l 90
Exercise
P789
15.4-2
15.4-3
15.4-4
15.4-5
15.4-10
15.5 Utility Theory
UTILITY THEORY
15.5 Utility Theory
0
M
$10,000 $30,000 $60,000 $100,000
value obtaining 2
value obtaining 0
M
100,000 twice as much $10,000 $30,000 $60,000 $100,000
as 30,000.
Risk-averse
Fundamental
Property
Step 1
As a starting point in constructing the utility
function, it is natural to let the utility of zero money
be zero, so u(0) = 0.
Construct the utility function
Step 2
What value of p makes you indifferent between two
alternatives?
The decision makers choice: .
If we let u(M) denote the utility of a monetary payoff
of M, this choice of p implies that
By choosing
u(-130) = -150 (a convenient choice since it will make u(M)
approximately equal to M when M is in the vicinity of 0), this
equation then yields u(700) = 600.
Construct the utility function
Step 3
To identify u(-100), a choice of p is made that makes
the decision maker indifferent between a payoff of -
130 with probability p or definitely incurring a
payoff of -100.The choice is p = 0.7, so
Construct the utility function
Step 4
To obtain u(90), a value of p is selected that makes
the decision maker indifferent between a payoff of
700 with probability p or definitely obtaining a
payoff of 90. The value chosen is p = 0.15, so
Construct the utility function
(M)
Step 5
700
e
lin
600
e
through u(-130), u(-100),
lu
va
y
ar
n
et
io
on
ct
500
u(90), and u(700) to obtain
n
fu
ity
til
U
the decision makers utility 400
individual.
Prototype Example
Monetary
Utility
payoff
3)
. 14 670 580
il(0
-45.7 O
f
ill
Dr Dr
y(0
60 . 85
7) -130 -150
c
7) Sel
le (0. l
a b
fa vor 60 60
Un
106.5
.5) 670 580
b il( 0
215 O
ic
sm
Fa g
vo
ill
sei
rab
le( 215 Dr Dr
Do
0.3 y(0
106.5 ) d .5) -130 -150
a
Sel
l 60
60
5) 700 600
il ( 0.2
71.25 O
h
ill
Dr Dr
90 y(0
.75 -100 -105
e )
No seismic
Sel
l 90 90
Final Decision Tree Using Money Payoff
payoff
)
0.143 670
il(
-15.7 O
800
f
ill Dr 0
Dr y(0
60 0
-10 .85
7) -130
c
9
(0.
7) Sel 0
b le l
vo ra 60
U nfa 0
123
.5) 670
b il(0
270 O 0
ic
0 80
sm
Fa g
vo
ill
sei
rab 0
Dr
-30
le( 270 Dr
Do
0.3 0 y( 0
123 ) d - 10 .5) -130
a 90
Sel
l
60
) 700
(0 . 25
100 Oi l
800
h
ill
Dr Dr 0
100 y(0
0 0 . 75 -100
e - 10 )
No seismic 90
Sel
l 90
Discussion
P792
15.5-2
15.5-3