1.8 Decision-Making With Risk
1.8 Decision-Making With Risk
3
Decision-making under uncertainty
Reports that say that something hasn’t happened are always
interesting to me, because as we know, there are known knowns;
there are things we know we know. We also know there are known
unknowns; that is to say we know there are some things we do not
know. But there are also unknown unknowns – the ones we don’t
know we don’t know. And if one looks throughout the history of our
country and other free countries, it is the latter category that tend to
be the difficult ones.
4
Quantifying a risky future
• How do agents choose between risky alternatives?
𝑙 = 𝑥! , 𝑥" … 𝑥# ; π! , π" … π#
• Note: people may be able to take actions which affect the likelihood of
different events occurring (LT)
5
Examples of lotteries
• Example 1: flip a coin; Heads you win £10, Tails you lose £1.
1 1
𝑙 = 10, −1; ,
2 2
• Example 2: you have £100 and are considering paying £1 for a lottery ticket.
There is a one in a thousand chance of winning, in which case you win £1000.
Otherwise, you get nothing!
999 1
𝑙 = 99, 1099; ,
1000 1000
• Key questions: what determines whether someone would take these gambles?
Can we rank different lotteries?
6
Evaluating a risky future
• Consider lottery 𝑙 = 𝑥! , 𝑥" … 𝑥# ; π! , π" … π#
𝐸𝑈 𝑙 = 1 π% 𝑢 𝑥%
%&!
A. Lottery 1?
B. Lottery 2?
C. Lottery 3?
D. None – keep the £100?
8
Example
• But people care about the spread of outcomes and are often concerned more
by the downside risk than the upside (more on that later)
9
Example
! ! ! ! ! !
𝑙! = 21, −19; , , 𝑙" = 69, −36; , , 𝑙' = 125, −84; ,
" " " " " "
• Consider David, who has an initial wealth of £100 and his utility function is
U 𝑊 = 𝑊. How would he rank 𝑙! , 𝑙" , 𝑙' ?
! ! !! (
• 𝐸𝑈 𝑙! = 121 + 81 = + = 10
" " " "
! ! !' )
• 𝐸𝑈 𝑙" = " 169 + " 64 = "
+ " = 10.5
• 𝐸𝑈 𝑙' =
!
225 +
!
16 =
!* +
+ = 9.5 Ranks 𝑙" top
" " " "
• If he takes none: 𝑈 100 = 100 = 10
10
Expected utility is subjective
• Outcomes and probabilities often based on individual beliefs about the
future
11
Expected utility is cardinal
• 𝐸𝑈 is a cardinal concept; we rely on the shape of the utility function
• Preferences over lotteries are preserved only with linear transformations
• If David has utility function 𝑢 ; and prefers lottery A to lottery B, then:
# -
• Utility function U 𝑊 :
• Risk averse – concave e.g. U 𝑊 = 𝑊
• Risk loving – convex e.g. U 𝑊 = 𝑊 "
• Risk neutral – linear e.g. U 𝑊 = 5𝑊
13
With lottery 2, your wealth will be £169 with probability 1/2 or £64 with
probability 1/2, giving an expected payoff of £116.5
If I offer to swap this uncertain income for a certain amount, what is the
minimum amount you would be willing to accept?
14
Attitudes to risk
• Your certainty equivalent (CE) to a lottery is the certain amount that makes
you indifferent between CE and the lottery
15
Risk Averse ! !
initial wealth £100; 𝑙" = 69, −36; ,
" "
Utility
13 ● U 𝑊 = 𝑊
𝐸𝑈= 10.5 ●
8 ●
Wealth
0 64 116.5 169
=𝐸 𝑙 16
Risk Averse ! !
initial wealth £100; 𝑙" = 69, −36; ,
" "
Utility
13 ● U 𝑊 = 𝑊
𝑈𝐸 𝑙 ●
𝐸𝑈= 10.5 ●
𝑈 𝐸 𝑙 > 𝐸𝑈 𝑙
8 ●
Jensen’s inequality
Wealth
0 64 116.5 169
=𝐸 𝑙 17
Jensen’s inequality: 𝑈 𝐸 𝑙 > 𝐸𝑈 𝑙
18
Risk Averse initial wealth £100; 𝑙" = 69, −36; ,
! !
" "
Utility
CE < 𝐸 𝑙
13 ● U 𝑊 = 𝑊
Wealth
0 64 CE 116.5 169
=𝐸 𝑙 19
Suppose we gather a group of people and offer them two different lotteries
A and B. Some people prefer A and others prefer B.
Does this necessarily mean those who selected A have a different utility
function to those who prefer B?
A. Yes
B. No
20
Measuring risk aversion
• We can construct measures of risk aversion:
• Exploit the fact that the curvature of the utility function is related to
risk aversion
𝑈′′(𝑊)
𝐴𝑅𝐴 = −
𝑈′(𝑊)
𝑈′′(𝑊)
𝑅𝑅𝐴 = −𝑊
𝑈′(𝑊) 21
Example: U 𝑊 = 𝑊
!
U 𝑊 = 𝑊= 𝑊"
!
! /
⇒ U′ 𝑊 = " 𝑊 "
#
! /
⇒ 𝑈 00 𝑊 = − 𝑊 "
+
1 '
/
𝑈 00 𝑊 −4𝑊 " 1
𝐴𝑅𝐴 = − 0 =− ! =
𝑈 𝑊 1 /" 2𝑊
𝑊
2
𝑈 00 𝑊 1
𝑅𝑅𝐴 = −𝑊 0 =
𝑈 𝑊 2
22
Which of the following lotteries do you prefer?
! ! ! ! " *
𝑙! = 10,20,30; ' , ' , ' , 𝑙" = 10,20,30; ) , ) , )
A. Lottery 1
B. Lottery 2
C. I am indifferent
D. I don’t know
23
Which of the following lotteries do you prefer?
! ! ! !
𝑙! = 50, 150; " , " , 𝑙" = 20, 180; " , "
A. Lottery 1
B. Lottery 2
C. I am indifferent
D. I don’t know
24
How can we compare lotteries more generally?
• Can we more broadly say that one lottery is ‘better’ than another?
! ! ! ! " *
• e.g. 𝑙! = 10,20,30; , , , 𝑙" = 10,20,30; , ,
' ' ' ) ) )
• Every expected utility maximizer would prefer 𝑙!
• 𝑙!‘first order stochastically dominates’ 𝑙" (Appendix for the curious)
! ! ! !
• e.g. 𝑙! = 50, 150; , , 𝑙" = 20, 180; ,
" " " "
• 𝑙! is a ‘mean-preserving spread’ of 𝑙"; same mean, wider variance
• Every risk averse expected utility maximizer would prefer 𝑙"
• 𝑙"‘second order stochastically dominates’ 𝑙! (Appendix for the curious)
25
Mean preserving spread 𝑙! = 50, 150; ,
! !
" "
, 𝑙" = 20, 180; ,
! !
" "
Utility
● ● U 𝑊
𝐸𝑈 𝑙" ●
𝐸𝑈 𝑙! ● Every risk averse
● expected utility
maximizer prefers 𝑙!
●
𝐸 𝑙! =
Wealth
0 20 50 𝐸 𝑙" = 100 150 180 26
Mitigating risk
• If people are risk averse then they will be willing to pay to eliminate or reduce
it - creates demand for insurance
• There might also be incentives for reducing risk by sharing it or pooling it with
others (example in class)
• Risk sharing: decision-makers share a single lottery e.g. joint venture
• Risk pooling: decision-makers each take a lottery and share the proceeds
e.g. agricultural cooperative
𝑥!
0 State of nature 1 28
State contingent income space
State of 𝑥" 𝑥! = 𝑥"
nature 2 𝐸𝑈 𝑙 = 𝜋! 𝑢 𝑥! + 𝜋" 𝑢 𝑥" Certainty line
● 𝑙 = 𝑥! , 𝑥" ; 𝜋! , 𝜋"
𝑥!
0 State of nature 1 29
State contingent income space
State of 𝑥" 𝑥! = 𝑥"
nature 2 𝐸𝑈 𝑙 = 𝜋! 𝑢 𝑥! + 𝜋" 𝑢 𝑥"
Indifferent between
𝑙' 𝑙! , 𝑙" , and 𝑙'
●
𝐶𝐸
𝑥67 ● Certainty
𝑙" Equivalent 𝐶𝐸 of 𝑙! ,
● 𝑙!
● 𝑙" , and 𝑙'
𝑥!
0 𝑥67 State of nature 1 30
State contingent income space
State of 𝑥" 𝑥! = 𝑥"
nature 2 𝐸𝑈 𝑙 = 𝜋! 𝑢 𝑥! + 𝜋" 𝑢 𝑥"
𝜕𝑢 𝑥!
𝜋!
𝜕𝑥!
𝑀𝑅𝑆 =
𝜕𝑢 𝑥"
𝜋"
𝐶𝐸 𝜕𝑥"
●
8!
𝑙! 𝑀𝑅𝑆 = 8 when 𝑥! = 𝑥"
● "
𝜋"
𝑀𝑅𝑆 =
𝜋! 𝑥!
0 State of nature 1 31
State contingent income space
State of 𝑥" 𝑥! = 𝑥"
nature 2 𝐸𝑈 𝑙 = 𝜋! 𝑢 𝑥! + 𝜋" 𝑢 𝑥"
Expected payoff of 𝑙"
• A risk averse agent values risky income less than its expected value:
𝐶𝐸 < 𝐸 𝑙
• If the insurance company is less risk averse than the consumer then it
values the random income being offered at close to its expected value
• Scope for trade; consumer pays a premium to shift risk to the less risk
averse insurance company
33
Insurance
• Suppose Julie, a risk-averse agent, has wealth 𝑤
• Julie can buy insurance: she pays a premium and receives a payout in the
event of loss
• Key questions: What determines how much insurance she will buy? Will
she fully insure i.e. achieve certainty?
34
Insurance
• Let 𝑝 be the premium for every unit of insurance purchased 𝑋
• If things go well: 𝑥! = 𝑤 − 𝑝𝑋
• If things go badly: 𝑥" = 𝑤 − 𝐿 − 𝑝𝑋 + 𝑋
If buys X units of
insurance, moves to B
𝐵
●
𝑋 − 𝑝𝑋
𝑤−𝐿 ●
𝑙 = 𝑤, 𝑤 − 𝐿; 1 − 𝜋, 𝜋
𝑝𝑋
𝑥!
0 𝑤 State of nature 1 36
Premium 𝑝 > 𝜋 per unit of insurance
State of 𝑥" 𝑥! = 𝑥"
nature 2
!"#
Gradient:−
𝐵 #
●
𝑋 − 𝑝𝑋
𝑤−𝐿 ●
𝑙 = 𝑤, 𝑤 − 𝐿; 1 − 𝜋, 𝜋
𝑝𝑋
𝑥!
0 𝑤 State of nature 1 37
Optimal choice of insurance (𝑝 > 𝜋)
State of 𝑥" 𝑥! = 𝑥"
nature 2
!"#
𝑤 − 𝐿 − 𝑝𝑋 ∗ + 𝑋 ∗ ● Gradient:− #
𝑤−𝐿 ●
𝑙 = 𝑤, 𝑤 − 𝐿; 1 − 𝜋, 𝜋
𝑥!
0 𝑤 − 𝑝𝑋 ∗ 𝑤 State of nature 1 38
Optimal choice of insurance if 𝑝 = 𝜋
State of 𝑥" 𝑥! = 𝑥"
nature 2
𝑤 − 𝑝𝐿 ● Gradient:−
!"#
#
𝑤−𝐿 ●
𝑙 = 𝑤, 𝑤 − 𝐿; 1 − 𝜋, 𝜋
𝑥!
0 𝑤 − 𝑝𝐿 𝑤 State of nature 1 39
Key result
• If 𝑝 = 𝜋, full insurance:
• competitive insurance market; “actuarially fair premium”
40
Back to behavioural economics
• Expected utility theory is the conventional model of decision-making
with risk
• We want to:
• Explore some of these anomalies
• Study an alternative theoretical approach: prospect theory
41
Johnny is a risk-averse, expected utility maximiser; he will always turn down
! !
𝑙 = −10,11; " , " .
! !
What is the biggest 𝑌 for which he will turn down 𝑙 = −100, 𝑌; , ?
" "
A. £110
B. £1,100,000
C. £2.5billion
D. Johnny will reject the bet no matter how high 𝑌 is
E. We cannot say without knowing his utility function
42
Johnny’s behaviour…
• Johnny would turn down any bet - but surely he is insane to turn down a
gamble where he stands to gain £2.5bn!
General concern: Under EU theory, risk aversion over modest stakes gives rise
to an absurd degree of risk aversion over very large stakes
43
Johnny’s behaviour…
Utility
●
●
Wealth
0 𝑤 − 10 𝑤 𝑤 + 11 44
Overconfidence
• Often described as the “mother of all psychological biases"
• 93% of drivers in the US think that they are better than average drivers!
• General concern: People have beliefs that put too much weight on states of
the world they believe that they “know”
45
Overconfidence
• Think of as “re-weighting” probabilities in favour of certain outcomes
• Policy response?
• Post 2008: greater regulation of financial products
• Can people be educated to reduce overconfidence? Can some gambles
that people make be banned or taxed?
46
You face the following concurrent decisions:
Decision 1. Choose Between:
A. A sure gain of £240
B. 25% chance to gain £1000 and 75% chance to gain £0
48
What is going on?
You face the following concurrent decisions:
Decision 1. Choose Between:
A. A sure gain of £240
B. 25% chance to gain £1000 and 75% chance to gain £0
50
What is going on?
• Adapted from Tversky and Kahneman (1986), “Rational Choice and the
Framing of Decisions”, Journal of Business
• Kahneman won the 2002 Nobel prize in Economics; Tversky died in 1996
51
Framing and Loss Aversion:
Amos Tversky and Danny Kahneman highlighted the importance of:
1 𝑝(π% )𝑉 𝑥% − 𝑟
%&!
where:
• π! , π" , π' … are probabilities as before
• function 𝑝 is a probability weighting function; no need for ∑#%&! 𝑝(π% ) = 1
• 𝑉 𝑥% − 𝑟 is a value function which diverges from utility
• value of outcome 𝑥$ is evaluated relative to a reference point 𝑟 53
Reference points matter…
54
Example:
• Let 𝑈 𝑥 = 𝑥 (risk neutral agent)
𝑥−𝑟 𝑖𝑓 𝑥 ≥ 𝑟
𝑉 𝑥−𝑟 =W
𝜆 𝑥−𝑟 𝑖𝑓 𝑥 < 𝑟
where 𝜆 > 1
𝑥
𝑟
Region of losses Region of gains
𝑉 𝑥−𝑟 =𝜆 𝑥−𝑟 56
Example:
! !
• Consider lottery 𝑙 = 60,40; " , " , where 𝑟 = 50
• Gamble is around the reference point
• Let 𝑝(π$ ) = π$
10 − 10𝜆
( 𝑝(π! )𝑉 𝑥! − 𝑟 = <0
2
!
• So rejects the gamble!
57
The value function
𝑉 𝑥−𝑟
𝑥−𝑟
Risk neutral with gambles
above and below 𝑟 𝑟 = 50
Behaves as if risk averse
with gambles around 𝑟 10 ●
−10
𝑥
𝑟 10
Region of losses ● Region of gains
● −10𝜆
𝜆 𝑥−𝑟
58
What have we achieved?
• We have presented the standard expected utility model for choice under
uncertainty
59
What have we achieved? (continued)
• We have explored a range of possible biases in decision-making that
arising in the context of decision-making with risk
• Risk aversion over modest stakes implies absurd risk aversion over very
large stakes
• People make inconsistent decisions
• People choose differently depending on how choices are framed
• People tend to be loss-averse; reference point matters
1: ●
8
Wealth
0 10 20 30 62
Second order stochastic dominance ! !
𝑙! = 50, 150; " , "
! !
𝑐𝑑𝑓 𝑙" = 20, 180; ,
" "
1 ● ●
𝑙!
Lottery whose cdf crosses
once from underneath
second order
𝑙" stochastically dominates
1:
2 ● ● Every risk averse
expected utility
maximizer prefers 𝑙!
Wealth
0 20 50 150 180 63
Appendix 2: Risk loving and risk neutral preferences
(for completeness and for those interested)
Risk Loving initial wealth £100; 𝑙" = ! !
69, −36; ,
" "
Utility
U 𝑊
𝐸𝑈 ●
●
Wealth
0 64 116.5 169 65
Risk Loving initial wealth £100; 𝑙" = ! !
69, −36; ,
" "
Utility
𝑈𝐸 𝑙 < 𝐸𝑈 𝑙
U 𝑊
𝐸𝑈 ●
𝑈𝐸 𝑙 ●
●
Wealth
0 64 116.5 169 66
Risk Loving initial wealth £100; 𝑙" = ! !
69, −36; ,
" "
Utility
U 𝑊
Risk Premium =
𝐸 𝑙 − 𝐶𝐸 < 0
● Compensation
required to accept
𝐸𝑈 ● ● certainty
RP
●
Wealth
0 64 116.5 CE 169 67
Risk loving
𝑥" 𝑥! = 𝑥"
𝐸𝑈 = 𝜋"𝑢 𝑥" + 𝜋!𝑢 𝑥!
𝑥67 ● 𝐶𝐸
𝐸 𝑙" ●
𝑙"
●
Wealth
0 64 116.5 169
= CE = 𝐸 𝑙 69
Risk neutral
𝑥" 𝑥! = 𝑥"
𝐸𝑈 = 𝐸 𝑙" = 𝜋"𝑥" + 𝜋!𝑥!
𝐸 𝑙" = 𝑥$% ● 𝐶𝐸
𝑙"
●
Risk Premium = 0
𝑥!
0 𝐸 𝑙" = 𝑥$% 70