Session - 17-18 - Decision Tree
Session - 17-18 - Decision Tree
By
Nikunj Kumar Jain
Associate Professor – POM, IIM Nagpur
Fellow – IIM Indore, B.Tech - NIT, Bhopal
Room No. 19, Ground Floor; Mob. 9827440301
Email: [email protected]
Session Plan
Decision Making
Certainty
Uncertainty
Risk
Pay-off Matrix
EMV and EOL Criteria
Value of Information
Value of Perfect Information
Value of Imperfect Information
Decision-making Environments
Certainty
Uncertainty
Risks
Five Steps
John wants to use net profits to measure his payoffs. He has already
evaluated the potential profits associated with various combinations
of alternatives and outcomes, as follows:
If John decides to build a large plant, he thinks that with high demand
for sheds, the result would be a net profit of $200,000 to his firm. The
net profit would, however, be only $100,000 if the demand were
moderate. If the demand were low, there would actually a net loss of
$120,000.
If he builds a small plant, the results would be a net profit of $90,000
if there were high demand for sheds, a net profit of $50,000 if there
were moderate demand, and a net loss of $20,000 if there were low
demand.
Thompson Lumber
4. Payoff table
OUTCOMES
HIGH MODERATE LOW
ALTERNATIVES DEMAND DEMAND DEMAND
Build large plant $200,000 $100,000 –$120,000
Build small plant $ 90,000 $ 50,000 –$ 20,000
No plant $ 0 $ 0 $ 0
2. Maximin
3. Criterion of realism
4. Equally likely
5. Minimax regret
Thompson Lumber
Maximax Criterion
Maximizes the maximum payoff
OUTCOMES
HIGH MODERATE LOW
ALTERNATIVES DEMAND DEMAND DEMAND
Build large plant $200,000 $100,000 –$120,000
Build small plant $ 90,000 $ 50,000 –$ 20,000
No plant $ 0 $ 0 $ 0
Maximax
Thompson Lumber
Maximin Criterion
Maximizes the minimum payoff
OUTCOMES
HIGH MODERATE LOW
ALTERNATIVES DEMAND DEMAND DEMAND
Build large plant $200,000 $100,000 –$120,000
Build small plant $ 90,000 $ 50,000 –$ 20,000
No plant $ 0 $ 0 $ 0
Maximin
Thompson Lumber
Criterion of Realism (Hurwicz)
OUTCOMES
HIGH MODERATE LOW WT. AVG.
FOR
ALTERNATIVES DEMAND DEMAND DEMAND
ALTERNATIVE
OUTCOMES
HIGH MODERATE LOW AVERAGE FOR
ALTERNATIVES DEMAND DEMAND DEMAND ALTERNATIVE
Build large plant $200,000 $100,000 –$120,000 $60,000
Build small plant $ 90,000 $ 50,000 –$ 20,000 $40,000
No plant $ 0 $ 0 $ 0 $ 0
Equally
likely
Minmax Regret
OUTCOMES
ALTERNATIVES HIGH DEMAND
Build large plant $200,000 – $200,000 = $ 0
Build small plant $200,000 – $ 90,000 = $110,000
No plant $200,000 – $ 0 = $200,000
MODERATE DEMAND
Build large plant $100,000 – $100,000 = $ 0
Build small plant $100,000 – $ 50,000 = $ 50,000
No plant $100,000 – $ 0 = $100,000
LOW DEMAND
Build large plant $0 – (–$120,000) = $120,000
Build small plant $0 – (–$ 20,000) = $ 20,000
No plant $0 – $ 0 =$ 0
Thompson Lumber
• Minimax Regret Criterion
OUTCOMES
HIGH MODERATE LOW MAXIMUM FOR
ALTERNATIVES DEMAND DEMAND DEMAND ALTERNATIVE
Build large plant $ 0 $ 0 $120,000 $120,000
Build small plant $110,000 $ 50,000 $ 20,000 $110,000
No plant $200,000 $100,000 $ 0 $200,000
Minimax
??? (Decision Making Under Risks)
John decides to consult his father, who has started the business and
he has good knowledge of the storage shed industry. John’s father
suggest that the probabilities of high, moderate and low demand
would be 0.3, 0.5 and 0.2 respectively. With these risky estimates,
determine the alternative that would give John the greatest expected
monetary value (EMV)?
Refer above problem, determine the best alternative for John using
minimizing expected opportunity loss (EOL) criteria.
Under Risk
Decision node
Outcome node
Payoff node
Decision Trees
Thompson Lumber
Payoffs
High Demand
$200,000
Outcome Node
Moderate Demand
1 $100,000
t Low Demand
an
Decision Node Pl –$120,000
a rge
L High Demand
$90,000
Small Plant 2 Moderate Demand
$50,000
No Low Demand
P l an –$20,000
t
All Demands
3 $0
Decision Trees
Thompson Lumber
Probability
Payoffs
High Demand (0.30)
$200,000
Outcome Node $86,000
Moderate Demand (0.50)
1 $100,000
l a nt Low Demand (0.20)
Decision Node eP –$120,000
rg
La High Demand (0.30)
$90,000
$48,000
Small Plant 2 Moderate Demand (0.50)
$50,000
No Low Demand (0.20)
P l an –$20,000
t
$0
All Demands
3 $0
1 EMV = $86,000
t
an
Decision Node e Pl
rg
La
Assume that the probability of competitor choosing low price is 0.6 and
probability of high price is 0.4. AI is looking forward to hire a
consultant to obtain information about the operating philosophy of the
competitor airline. How much should AI pay for this information?
Airline Industry: The Decision Tree
Competitor:$200 $4 million
$300 Pr = 0.6
Fare
6.4
Competitor:$300
Pr = 0.4
$10 million
Airline Industry: Value of Additional
Information
• If no additional information is available, the best strategy is to set the fare at
$200
E(Payoff|200) = (.6)(8)+(.4)(9) = $8.4 million
E(Payoff|300) = (.6)(4)+(.4)(10) = $6.4 million
• With further information, the expected payoff could be:
E(Payoff|Information) = (.6)(8)+(.4)(10)=$8.8 million
• EVPI=8.8-8.4 = $.4 million
New Product Introduction
ABC is thinking to launch a new product. After doing some research, the management
came to the conclusion there is a 75 percent probability of product being successful and
the profits will be $ 100,000 and there is 25 percent probability that the product may
not be success incurring a loss of $ 20,000.
What should ABC do?
Decision Tree: New-Product Introduction
Chance
Chance Final
Final
Decision
Decision Occurrence
Occurrence Outcome
Outcome
Product
successful $100,000
(P = 0.75)
Market
Product -$20,000
unsuccessful
Do not (P = 0.25)
market
$0
Payoff Table and Expected Values of Decisions:
New-Product Introduction
Productisis
Product
Action
Action Successful Not
Successful NotSuccessful
Successful
Marketthe
Market theproduct
product $100,000
$100,000 -$20,000
-$20,000
Donot
Do notmarket
marketthe
theproduct
product $0
$0 $0
$0
Product -$20,000
unsuccessful
(P = 0.25)
Nonoptimal Do not
Nonoptimal
decisionbranch
branch market Expected
decision Expected $0
isisclipped
clipped Payoff
Payoff
$0
$0
New Product Introduction
The management decided to consider the extended possibilities regarding the success of
the new product and came with the following outcomes with their probabilities. What is
the expected payoff of ABC?
ExpectedPayoff:
Expected Payoff: $77,500
$77,500
New-Product Introduction:
Extended-Possibilities Decision Tree
Chance
Chance Payoff
Decision
Decision Occurrence
Occurrence
0.1
$150,000
Expected
Expected 0.2 $120,000
Payoff
Payoff 0.3
$77,500 $100,000
$77,500 0.1
$80,000
0.1 $40,000
Market
0.1 $0
0.05
-$20,000
0.05
-$50,000
Do not
Nonoptimal
Nonoptimal market
decisionbranch
decision branch $0
isisclipped
clipped
Exercise 1
Suppose you can earn a little bit of spending money selling falafel
sandwiches in a busy square on Saturday afternoons. On a normal
Saturday, a day’s worth of effort nets you $150. Unfortunately, there
is a 30 percent chance of rain. If it rains, you will only make $50 (a
few desperate souls will still buy soggy falafel sandwiches). Suppose
you can rent an extra large umbrella for $25/day. In the event it rains,
your falafel sandwiches will not be soggy, and you can expect to
make $100 (exclusive of umbrella costs).
Should you rent the umbrella? You must decide to rent before you find
out whether it rains. Furthermore, you must pay for the umbrella
whether or not it rains.
What is the most you would pay for a perfectly accurate weather
forecasts?
Exercise 2
An individual has $1 million dollars and wishes to make a one-year investment. Suppose his/her
possible actions are:
a1: buy a guaranteed income certificate paying 10%
a2: buy bond with a coupon value of 8%
a3: buy a well-diversified portfolio of stocks
Return on investment in the diversified portfolio depends on the behavior of the interest rate next
year. Suppose there are three possible states of nature:
s1: interest rate increases
s2: interest rate stays the same
s3: interest rate decreases
Suppose further that the subjective probabilities for these states are 0.2, 0.5, and 0.3, respectively.
Pay-off table
S1 50 200 0
S2 0 20 10
S3 80 0 140
EOL 34 50 47
Again A1 is optimal
The Law of Total Probability and Bayes’
Theorem
The law of total probability:
P( A) P( A B) P( A B )
An analyst believes the stock market has a 0.75 probability of going up in the next year
if the economy should do well, and a 0.3 probability of going up if the economy should
not do well during the year. The analyst further believes there is a 0.8 probability that
the economy will do well in the coming year. What is the probability that the stock
market will go up next year (using the analyst’s assessment)?
The Law of Total Probability-
P ( A B)
P ( B A)
P ( A)
P ( A B) Applying the law of total
probability to the denominator
P ( A B) P ( A B )
P ( A B) P ( B)
Applying the definition of
P ( A B) P ( B) P ( A B ) P ( B ) conditional probability throughout
Bayes’ Theorem Extended
P( A B )
P ( B A) 1
P ( A)
1
P( A B ) i
Applying the definition of
P( A B ) P( B ) conditional probability throughout
1 1
P( A B ) P( B )
i i
Bayes’ Theorem Extended -
Example
An economist believes that during periods of high economic growth, the U.S.
dollar appreciates with probability 0.70; in periods of moderate economic
growth, the dollar appreciates with probability 0.40; and during periods of
low economic growth, the dollar appreciates with probability 0.20.
During any period of time, the probability of high economic growth is 0.30,
the probability of moderate economic growth is 0.50, and the probability of
low economic growth is 0.20.
Suppose the dollar has been appreciating during the present period. What is
the probability we are experiencing a period of high economic growth?
Partition: Event A Appreciation
H - High growth P(H) = 0.30 P ( A H ) 0.70
M - Moderate growth P(M) = 0.50 P ( A M ) 0.40
L - Low growth P(L) = 0.20 P ( A L) 0.20
Example (Tree Diagram)
Prior Conditional Joint
Probabilitie Probabilities Probabilities
s P ( A H ) ( 0.30)( 0.70) 0.21
P ( A H ) 0.70
P ( A H ) 0.30
P ( H ) 0.30 P ( A H ) ( 0.30)( 0.30) 0.09
P ( M ) 0.50
P ( A H ) 0.30
P ( H ) 0.30 P ( A H ) ( 0.30)( 0.30) 0.09
P ( M ) 0.50
P( H A)
P( H A)
P( A)
P( H A)
P( H A) P( M A) P( L A)
P( A H ) P( H )
P ( A H ) P ( H ) P ( A M ) P ( M ) P ( A L) P ( L)
( 0.70)( 0.30)
( 0.70)( 0.30) ( 0.40)( 0.50) ( 0.20)( 0.20)
0.21 0.21
0.21 0.20 0.04 0.45
0.467
Bayesian Analysis
• Prior Probabilities
High (HD) P(PS | HD) = 29/30 = 0.967 P(NS | HD) = 1/30 = 0.333
Moderate (MD) P(PS | MD) = 8/15 = 0.533 P(NS | MD) = 7/15 = 0.467
Low (LD) P(PS | LD) = 2/30 = 0.067 P(NS | LD) = 28/30 = 0.933
Revised Probabilities
Positive survey results
CONDITIONAL REVISED
PROB. PRIOR JOINT PROB.
OUTCOME P(PS | OUTCOME) PROB. PROB. P(OUTCOME | PS)
High (HD) 0.967 X 0.30 = 0.290 0.290/0.57 = 0.509
Mod. (MD) 0.533 X 0.50 = 0.267 0.267/0.57 = 0.468
Low (LD) 0.067 X 0.20 = 0.013 0.013/0.57 = 0.023
P(PS) = P(Positive Survey) = 0.570 1.000
Revised Probabilities
CONDITIONAL REVISED
PROB. PRIOR JOINT PROB.
OUTCOME P(NS | OUTCOME) PROB. PROB. P(OUTCOME | NS)
High (HD) 0.033 X 0.30 = 0.010 0.010/0.43 = 0.023
Mod. (MD) 0.467 X 0.50 = 0.233 0.233/0.43 = 0.543
Low (LD) 0.933 X 0.20 = 0.187 0.187/0.43 = 0.434
P(NS) = P(Negative Survey) = 0.430 1.000
Revised Probabilities
CONDITIONAL REVISED
PROB. PRIOR JOINT PROB.
OUTCOME P(NS | OUTCOME) PROB. PROB. P(OUTCOME | NS)
High (HD) 0.033 X 0.30 = 0.010 0.010/0.43 = 0.023
Mod. (MD) 0.467 X 0.50 = 0.233 0.233/0.43 = 0.543
Low (LD) 0.933 X 0.20 = 0.187 0.187/0.43 = 0.434
P(NS) = P(Negative Survey) = 0.430 1.000
CONDITIONAL REVISED
PROB. PRIOR JOINT PROB.
OUTCOME P(NS | OUTCOME) PROB. PROB. P(OUTCOME | NS)
High (HD) 0.033 X 0.30 = 0.010 0.010/0.43 = 0.023
Mod. (MD) 0.467 X 0.50 = 0.233 0.233/0.43 = 0.543
Low (LD) 0.933 X 0.20 = 0.187 0.187/0.43 = 0.434
P(NS) = P(Negative Survey) = 0.430 1.000
Second Decision Payoffs
Point
Multistage Decision
High Demand (0.3)
$200,000
Moderate Demand (0.5)
1 $100,000
t
lan Low Demand (0.2)
Trees La
rg
e P
Small Plant
High Demand (0.30)
Moderate Demand (0.50)
$120,000
$90,000
2 $50,000
No Low Demand (0.20)
Pla $20,000
nt
All Demands
3 $0
ey
rv
First Decision High Demand (0.509)
Su
Point $196,000
o
N
Moderate Demand (0.486)
4 $96,000
t
Plan Low Demand (0.023)
–$124,000
e
rg
La High Demand (0.509)
$86,000
Small Plant Moderate Demand (0.486)
5 $46,000
7)
Co
.5
No Low Demand (0.023)
(0
–$24,000
nd
Pla
lts
uc
nt
su
t
Re
Su
All Demands
rv
ive
6 –$4,000
ey
sit
Po
High Demand (0.023)
$196,000
Moderate Demand (0.543)
Ne
7 $96,000
t
ga
lan Low Demand (0.434)
tive
P –$124,000
e
rg
Re
La High Demand (0.023)
su
$86,000
lts Small Plant Moderate Demand (0.543)
(0
8 $46,000
.4
3)
No Low Demand (0.434)
Pla –$24,000
nt
All Demands
9 –$4,000
Folding Back
• No market survey
EMV (node 1) = EMV (Large plant)
= $200,000 x 0.30 + $100,000 x
0.50
+ (–$120,000) x 0.20
= $86,000
EMV (node 2) = EMV (Small plant)
= $90,000 x 0.30 + $50,000 x 0.50
+ (–$20,000) x 0.20
= $48,000
EMV (node 3) = EMV (No plant)
= $0
Folding Back
• Positive market survey
EMV (node 4) = EMV (Large plant | Positive
result)
= $196,000 x 0.509 + $96,000 x 0.468
+ (–$124,000) x 0.023
= $141,840
EMV (node 5) = EMV (Small plant | Positive
result)
= $86,000 x 0.509 + $46,000 x 0.468
+ (–$24,000) x 0.023
= $64,750
EMV (node 6) = EMV (No plant | Positive
result)
= –$4,000
Folding Back
• Negative market survey
EMV (node 7) = EMV (Large plant | Negative
result)
= $196,000 x 0.023 + $96,000 x 0.543
+ (–$124,000) x 0.434
= $2,820
EMV (node 8) = EMV (Small plant | Negative
result)
= $86,000 x 0.023 + $46,000 x 0.543
+ (–$24,000) x 0.434
= $16,540
EMV (node 9) = EMV (No plant | Negative
result)
= –$4,000
Folding Back
• Node 10 analysis
EMV (node 10) = EMV (Conduct survey)
= $141,840 x 0.57 + $16540 x 0.43
= $87,961
Multistage Decision
High Demand (0.3)
$86,000 $200,000
Moderate Demand (0.5)
1 $100,000
e Low Demand (0.2)
Trees ||
rg $120,000
La ant
Pl High Demand (0.30)
$86,000 $48,000 $90,000
Small Plant Moderate Demand (0.50)
2 $50,000
No Low Demand (0.20)
Pla $20,000
nt
$0
All Demands
3 $0
ey
rv
First Decision High Demand (0.509)
Su
Point $141,000 $196,000
o
N
Moderate Demand (0.486)
4 $96,000
||
Low Demand (0.023)
e –$124,000
rg
La ant High Demand (0.509)
$141,840 Pl $64,750 $86,000
$87,961 Small Plant Moderate Demand (0.486)
5 $46,000
7)
Co
.5
No Low Demand (0.023)
(0
–$24,000
nd
Pla
lts
uc
nt
su
–$4,000
Re
Su
All Demands
rv
ive
6 –$4,000
ey
sit
Po
||
10 High Demand (0.023)
$2,820 $196,000
$87,961 Moderate Demand (0.543)
Ne
7 $96,000
t
ga
lan Low Demand (0.434)
tive
P –$124,000
e
rg
Re
La High Demand (0.023)
su
$16,540 $86,000
lts Small Moderate Demand (0.543)
(0 Plant | | 8 $46,000
.4
3)
No Low Demand (0.434)
$16,540 Pla –$24,000
nt
–$4,000
All Demands
9 –$4,000
Expected Value
Sample Information (EVSI)