Dynamic Programming Notes
Dynamic Programming Notes
(Lecture 4)
Stefano DellaVigna
Outline
2. Constrained Maximization
3. Envelope Theorem II
4. Preferences
2
00
00
00
fx,x fy,y fx,y 0
Examples.
1. For which values of a, b, and c is f (x) = ax3 +
bx2 + cx + d is the function concave over R?
Strictly concave? Convex?
2. Is f (x, y) = x2 y 2 concave?
For Example 2, compute the Hessian matrix
fx0 =
, fy0 =
00 =
fx,x
00 =
, fx,y
00 =
fy,x
00 =
, fy,y
Hessian matrix H :
H=
00 =
fx,x
00
fy,x =
00 =
fx,y
00
fy,y =
00 and |H | = f 00 f 00
Compute |H1| = fx,x
2
x,x
y,y
2
00
fx,y
For the proof, we need to check that the secondorder conditions are satisfied.
Constrained Maximization
Ch. 2, pp. 36-42 (3844, 9th Ed)
So far unconstrained maximization on R (or open
subsets)
What if there are constraints to be satisfied?
Example 1: maxx,y x y subject to 3x + y = 5
Substitute it in: maxx,y x (5 3x)
Solution: x =
Example 2: maxx,y xy subject to x exp(y)+y exp(x) =
5
Solution: ?
max f (x, y)
x,y
s.t. h(x, y) = 0
Assume:
continuity and dierentiability of h
h0y 6= 0 (or h0x 6= 0)
What is x ?
h (x , x , ..., x ; p) = 0
n
2 1 2
s.t.
...
Assume:
f and h dierentiable at x
the following Jacobian matrix at x has maximal
rank
h1
(x ) ...
x1
J =
...
...
hm (x) ...
x1
h1
xn (x )
...
hm (x)
xn
m
X
j hj (x; p)
j=0
Case n = 2, m = 1.
First order conditions are
h(x; p)
f (x; p)
=0
xi
xi
for i = 1, 2
Rewrite as
fx0 1
fx0 2
h0x1
= 0
hx2
h (x)
x
1
2
L (x)
2x1
2L (x)
x1x2
h (x)
x
2
2
L (x)
x2x1
2L (x)
x2x2
h (x)
H=
x1
h (x)
x
2
is positive, then x is a constrained maximum.
maxx,y, x2 xy + y 2 (x2 + y 2 p)
F.o.c. with respect to x:
F.o.c. with respect to y:
F.o.c. with respect to :
Candidates to solution?
Maxima and minima?
Envelope Theorem II
Envelope Theorem II: Ch. 2, pp. 42-43 (44, 9th Ed)
Envelope Theorem for Constrained Maximization. In problem above consider F (p) f (x(p); p).
We are interested in dF (p)/dp. We can neglect indirect eects:
m
hj (x(p); p)
f (x(p); p) X
dF
=
j
dpi
pi
pi
j=0
Preferences
Part 1 of our journey in microeconomics: Consumer
Theory
Next Class
Properties of Preferences
From Preferences to Utility
Common Utility Functions