Static Games P
Static Games P
complete information
Alex Gershkov
May 2018
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 1 / 50
Game Theory
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 2 / 50
What is game theory
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 3 / 50
Elements of a game
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 4 / 50
The Prisoners’Dilemma
Two suspects are charged with a crime. The police lack su¢ cient evidence to
convict the suspects, unless at least one confesses.
If neither confesses: each is sentenced to 1 month of prison.
If both confess: each is sentenced to 6 months of prison.
If only one confesses: he/she is released immediately but the other is
sentenced to 9 months of prison.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 5 / 50
The Prisoner’s Dilemma as a game
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 6 / 50
The Prisoner’s Dilemma as a game
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 7 / 50
The normal-form representation
De…nition
The normal-form representation of a game speci…es the set of players N, the
players’strategy spaces S1 , ..., Sn and their payo¤ functions π 1 ,...,π n . We denote
this game by G = fN, S1 , ..., Sn , π 1 , ..., π n g.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 8 / 50
Best response
De…nition
Player i’s best response or best reply to the strategies s i chosen by the other
players is the strategy si that yields him/her the greatest payo¤; that is
The best response is called a strong (or strict) best response if no other
strategies are equally good, and weakly best otherwise.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 9 / 50
Dominant strategy equilibrium
De…nition
1. The strategy si is called a dominant strategy if it is a player’s strictly best
response to any strategies the other players might pick, in the sense that whatever
strategies they pick, his payo¤ is highest with si . Mathematically,
2. Strategy si0 is a dominated strategy, if there exists si such that for any possible
strategies of the other players, s i , i’s payo¤ from si0 is strictly less than from si .
Mathematically, there exists si such that
De…nition
A dominant strategy equilibrium is a strategy combination consisting of each
player’s dominant strategy.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 10 / 50
Joint project
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 11 / 50
Duopoly
Two …rms.
Each …rm charges either a high or a low price.
If both choose High, each earns 1000.
If one chooses High and the other chooses Low, the …rst one loses 200, the
second one gets 1200.
If both choose Low, each earns 600.
Each …rm cares only about its pro…t.
High Low
High 1000, 1000 200, 1200
Low 1200, 200 600, 600
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 12 / 50
Other applications
An arms race
Assume that each of two countries can build an arsenal of nuclear bombs, or
can refrain from doing this. Each country’s favorite outcome is that it has
bombs and the other country does not; the next best outcome is that neither
country has any bombs; the next best outcome is that both countries have
bombs; the worst outcome is that only the other country has bombs.
Common property
Two farmers decide to which extent they allow their sheep to graze on the
village common. Each farmer prefers that her sheep graze a lot to a little,
regardless of the other farmer’s action, but prefers that both farmers’sheep
graze a little to both farmers’sheep grazing a lot.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 13 / 50
Rationality
If we assume that the players are rational, then we should expect them to choose
whatever they deem to be best for them.
Claim A rational player will never play a dominated strategy.
Knowledge of the game implies that a player should recognize dominated
strategies, and rationality implies that these strategies will be avoided.
Remember: The solution to a game should always be described as the set of the
players’strategies, not their payo¤s!
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 14 / 50
Evaluating Dominant Strategy equilibrium
Chris
O F
Alice O 2, 1 0, 0
F 0, 0 1, 2
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 15 / 50
Evaluating Dominant Strategy equilibrium
3. Pareto criterion.
The outcome prescribed by this solution concept may not be Pareto optimal (see
the Prisoner’s Dilemma).
The failure of Pareto optimality is not a failure of the solution concept. The
assumption that the players are rational causes them to confess in the Prisoner’s
Dilemma. The failure of Pareto optimality implies that the players would bene…t
from modifying the environment and creating some enforcement mechanism that
will punish those who confess ("ma…a").
Assume that "punishment" from confessing generates disutility of z, then the
modi…ed Prisoner’s Dilemma is represented by
Player 2
S C
Player 1 S 1, 1 9, 0 z
C 0 z, 9 6 z, 6 z
If z > 3, this punishment is su¢ cient to ‡ip the predicted equilibrium outcome of
the game, because then S becomes the dominant strategy (and (S, S ) is the
Pareto optimal outcome).
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 16 / 50
Rationality
Problem
DSE will often fail to exist.
Solution
Alternative approaches that will apply to a variety of games.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 17 / 50
Iterated Elimination of Strictly Dominated Strategies
Illustration
l m r
1
t 0, 0 4, 1 1, 1
m 1, 4 5, 3 3, 2
b 1, 2 0, 3 4, 1
Player 2 has a dominated strategy r. A rational player 2 should never play r.
If player 1 knows that player 2 is rational, he knows that player 2 never
chooses r (Eliminate r).
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 18 / 50
Iterated Elimination of Strictly Dominated Strategies
Illustration
l m r
1
t 0, 0 4, 1 1, 1
m 1, 4 5, 3 3, 2
b 1, 2 0, 3 4, 1
Player 2 has a dominated strategy r. A rational player 2 should never play r.
If player 1 knows that player 2 is rational, he knows that player 2 never
chooses r (Eliminate r).
l m
2
t 0, 0 4, 1
m 1, 4 5, 3
b 1, 2 0, 3
Now player 1 has a dominated strategy - b. In this case, player 1 should
never play b. (Eliminate b).
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 18 / 50
Iterated Elimination of Strictly Dominated Strategies
Illustration (cont.)
l m
3. t 0, 0 4, 1
m 1, 4 5, 3
Player 2 has a dominated strategy m. If P2 is rational and knows that P1 is
rational (and P2 knows that P1 knows that P2 is rational), then P2 shouldn’t
play m. (Eliminate m.)
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 19 / 50
Iterated Elimination of Strictly Dominated Strategies
Illustration (cont.)
l m
3. t 0, 0 4, 1
m 1, 4 5, 3
Player 2 has a dominated strategy m. If P2 is rational and knows that P1 is
rational (and P2 knows that P1 knows that P2 is rational), then P2 shouldn’t
play m. (Eliminate m.)
l
4. t 0, 0
m 1, 4
Now player 1 has a dominated strategy - m. If P1 is rational and knows that
P2 is rational (and P1 knows that P2 knows that P1 is rational . . . ), then P1
shouldn’t play m. (Eliminate m.)
Hence (t, l) is the only strategy-pro…le surviving IESDS and thus the result of
our analysis.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 19 / 50
Iterated Elimination of Strictly Dominated Strategies
De…nition
We will call any strategy pro…le s IESDS = s1IESDS , ..., snIESDS that survives the
process of IESDS an iterated-elimination equilibrium (IEE).
Like the concept of DSE, the IEE starts with the premise of rationality. However,
in addition to rationality it requires a lot more.
We will discuss now the additional requirements.
You can …nd explanations about this solution concepts in most of the game theory
books (including introductory). In particular in
1 Myerson R., "Game Theory: Analysis of Con‡ict," Harvard University Press
1991,
2 Fudenberg D., and J Tirole, :Game Theory," The MIT Press1991.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 20 / 50
Common knowledge
De…nition
X is called common knowledge among i 2 fA, B g if Ki Kj Ki ...X , (n times) i 6= j,
n = 1, 2, 3, ... for as many rounds as required.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 21 / 50
Common knowledge - implication
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 22 / 50
IESDS - a general process
Let Sik denote the strategy set of player i that survives k rounds of IESDS.
Step 1: De…ne Si0 = Si for each i,and set k = 0.
Step 2: Are there players for whom there are strategies si 2 Sik that are
strictly dominated? If yes, go to step 3. If not, go to step 4.
Step 3: For all players i 2 N, remove all strategies si 2 Sik that are strictly
dominated. Set k = k + 1, and de…ne a new game with strategy
sets Sik that do not include the strictly dominated strategies that
have been removed. Go back to step 2.
Step 4: The remaining strategies in Sik survive IESDS.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 23 / 50
Application: Beauty contest
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 24 / 50
Application: Hotelling location game
Two vendors A and B sell some homogenous good; they have n a discrete o
number of possible locations along some ‘linear city’ [0, 1]: 0, γ1 , γ3 , , γγ
for even γ (thus 1/2 is possible).
Vendors choose their location simultaneously.
Consumers populate the city uniformly [0, 1] and buy their good from
whoever is closer (transport cost).
Pro…t of vendors is their volume of trade (for instance, the price per unit is 1
and marginal cost is zero).
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 25 / 50
Application: Hotelling location game
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 26 / 50
Application: Hotelling location game
Through repetition of the above elimination, IESDS eliminates all grid points
except for the middle point.
=) IESDS gives the unique recommendation to play (1/2, 1/2).
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 27 / 50
IESDS - Evaluation
1 Existence. We can apply IESDS to any game (by applying the algorithm). It
does not require the existence of a dominant or dominated strategies.
Existence is a consequence of common knowledge of rationality. We are
giving the players the ability to reason through repeating of the strategic
implications of rationality, while correctly anticipating that other players can
perform similar reasoning. Rationality alone is not su¢ cient.
2 Uniqueness. Consider the Battle of Sexes game
Chris
O F
Alice O 2, 1 0, 0
F 0, 0 1, 2
IESDS cannot restrict the set of strategies. Therefore, "anything can happen".
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 28 / 50
IESDS - Evaluation
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 29 / 50
Nash equilibrium
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 30 / 50
Nash equilibrium
In a Nash equilibrium
1 each player is playing a best response to his/her beliefs
2 players have correct beliefs.
Alternatively, each player is choosing a best response to the equilibrium strategies
of all other players.
De…nition
The (pure) strategy pro…le s = (s1 , ..., sn ) is a Nash equilibrium if si is a best
response to s i , for all i. That is,
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 31 / 50
Nash equilibrium - example
l m r
t 0, 0 4, 1 1, 1
m 1, 4 5, 3 3, 2
b 1, 2 0, 3 4, 1
(t,l) Nash equilibrium, because BR1 (l) =t and BR2 (t) =l.
In this case, player 1 (correctly) believes that player 2 is playing l and hence player
1 is playing t; player 2 (correctly) believes that player 1 is playing t and hence
player 2 is playing l.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 32 / 50
Nash equilibrium - Application 1
S H
S 5, 5 0, 3
H 3, 0 3, 3
There are two (pure strategy) Nash equilibria: (S,S) and (H,H).
However (S,S) Pareto dominates (H,H).
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 33 / 50
Nash equilibrium - Application 2
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 34 / 50
Nash equilibrium - Application 2
If pro…le (k1 , ..., kn ) satis…es that
Therefore
K ∑ j 6 = i kj
BRi (k i ) = .
2
For the two players case
K k2
k1 (k2 ) = ,
2
K k1
k2 (k1 ) = .
2
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 35 / 50
Nash equilibrium - Application 2
Best-response functions (two-player case)
K/2
Nash equilibrium
K/3
K/3 K/2 K
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 37 / 50
Nash equilibrium
Mixed Strategies
We will now allow players to randomize between di¤erent actions.
Consider the following game (Matching Pennies).
Two players, each player puts a coin (penny) on a table. If both coins come
up the same side (heads or tails) then player 1 gets both; otherwise player 2
does.
H T
H 1, 1 1, 1
T 1, 1 1, 1
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 38 / 50
Nash equilibrium
Mixed Strategies
Another game — rock-paper-scissors
R P S
R 0, 0 1, 1 1, 1
P 1, 1 0, 0 1, 1
S 1, 1 1, 1 0, 0
Best response for P 1, when he believes that P 2 will play one of his pure strategies
8
< P if s2 = R
s1 ( s 2 ) = S if s2 = P
:
R if s2 = S.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 39 / 50
Nash equilibrium
Mixed Strategies
Another game — all-pay auction
two players
one prize of value v > 0
players submit their bids simultaneously
the player with the highest bid gets the prize
in case of tie every player gets the prize with probability 1/2
every player pays his/her bids bid
utility of i is 8
< bi if bi < bj
v
π i ( bi , bj ) = b i if bi = bj
: 2
v bi if bi > bj
no pure strategy equilibrium
submitting bid bi > v is dominated by submitting 0
there is no equilibrium in which both players submit bid of v
there is no equilibrium in which both players submit the same bid below v
there is no bid in which agents submit di¤erent bids, and both are below v
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 40 / 50
Nash equilibrium
Mixed Strategies
Mixed strategies for …nite strategy sets
De…nition
Let Si = fsi 1 , si 2 , ..., sim g be player i’s …nite set of pure strategies. A mixed
strategy for player i, σi = fσi (si 1 ) , σi (si 2 ) , ..., σi (sim )g is a probability
distribution over Si , where σi (si ) is the probability that i plays si . The set of
distributions over set Si is denoted by ∆Si .
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 41 / 50
Nash equilibrium
De…nition
A belief for player i is given by a probability distribution pi 2 ∆S i over the
strategies of his opponents. We denote by pi (s i ) the probability player i assigns
to his opponents playing s i 2 S i .
(p1 (r ), p1 (p ), p1 (s ))
with p1 (r ) 0, p1 (p ) 0, p1 (s ) 0 and p1 (r ) + p1 (p ) + p1 (s ) = 1.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 42 / 50
Nash equilibrium - Expected Payo¤s
Recall the Matching Pennies game.
Assume that player 2 chooses σ2 (H ) = 13 and σ2 (T ) = 23 . If player 1 plays H
with probability 13 he will get 1 while with probability 32 he will get 1. If player 1
plays T with probability 32 he will get 1, while with probability 13 he will get 1.
Player 1 faces lotteries and di¤erent actions imply di¤erent lotteries.
Our players evaluate lotteries based on the expected payo¤ they generate.
De…nition
The expected payo¤ of player i when (s)he chooses the pure strategy si 2 Si and
his/her opponents play the mixed strategy σ i 2 ∆S i is
π i ( si , σ i ) = ∑ σ i ( s i ) π i ( si , s i ) .
s i 2S i
The expected payo¤ of player i when (s)he chooses the mixed strategy σi 2 ∆Si
and his/her opponents play the mixed strategy σ i 2 ∆S i is π i (σi , σ i ) =
!
∑ σ i ( si ) π i ( si , σ i ) = ∑ ∑ σ i ( si ) σ i ( s i ) π i ( si , s i ) .
s i 2S i s i 2S i s i 2S i
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 43 / 50
Nash equilibrium - Expected Payo¤s
R P S
R 0, 0 1, 1 1, 1
P 1, 1 0, 0 1, 1
S 1, 1 1, 1 0, 0
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 44 / 50
Mixed-Strategy Nash Equilibrium
De…nition
The mixed-strategy pro…le σ = (σ1 , σ2 , ..., σn ) is a Nash equilibrium if, for each
player, σi is a best response to σ i . That is, for all i 2 N,
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 45 / 50
Mixed-Strategy Nash Equilibrium
De…nition
A pure strategy si 2 Si is in the support of σi if σi (si ) > 0.
Suppose that in the Nash equilibrium pro…le σ the support of i’s mixed strategy
σi contains more than one pure strategy, i.e., si and si0 are both in the support of
σi . Since σi is a best response against σ i player i cannot do better than to
randomize between more than one of his pure strategies, si and si0 . When is the
player willing to randomize between pure strategies?
Claim Assume σ is a Nash equilibrium,
1 if si and si0 are both in the support of σi , then
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 46 / 50
Mixed-Strategy Nash Equilibrium - Example 1
Consider the following game
L R
U 0, 0 3, 5
D 4, 4 0, 3
There are two pure strategy Nash equilibria: (U, R ) and (D, L). However, there is
also mixed strategy Nash equilibrium.
α: the probability that P1 chooses U (1 α is the probability for D)
β: the probability that P2 chooses L (1 β is the probability for R).
Player 1 will mix if
0 β + 3 (1 β ) = 4 β + 0 (1 β ).
Therefore, 8
< α=1 if β < 37 ,
BR1 ( β) = α 2 [0, 1] if β = 37 ,
:
α=0 if β > 37 .
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 47 / 50
Mixed-Strategy Nash Equilibrium - Example 1
0 α + 4 (1 α ) = 5 α + 3 (1 α ).
Therefore, 8
< β=1 if α < 16 ,
BR2 (α) = β 2 [0, 1] if α = 16 ,
:
β=0 if α > 16 .
To …nd a Nash equilibrium we are looking for a pair of choices (α , β ) for which
the two best-responses cross. That is, α = BR1 ( β ) and β = BR2 (α ). This
yields another equilibrium (σ1 , σ2 ) = 1, 5 , 37 , 47 .
6 6
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 48 / 50
Mixed-Strategy Nash Equilibrium - Example 1
We plot the best responses
a
BR1(b)
1
BR2(a)
1/6
3/7 1 b
There are three intersections of the best-responses (1, 0), (0, 1) and (1/6, 3/7).
The …rst two correspond to the pure strategy equilibria (D,L) and (U,R), the third
one - mixed strategy equilibrium.
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 49 / 50
Summary
Alex Gershkov (The Hebrew University of Jerusalem) Game theory May 2018 50 / 50