Introduction to Optimization
Introduction to Optimization
Hedge an obligation X œ Rm
Have to pay Xi if state i occurs
Buy/short sell ◊ = (◊1 , . . . , ◊d )€ shares to cover obligation
2
Hedging problem (contd)
Position ◊ œ Rd purchased at time t = 0
◊j = number of shares of asset j purchased, j = 1, . . . , d
qd
Cost of the position ◊ = j=1
pj ◊j = p€ ◊
Payoff y hedges X if y Ø X.
3
Hedging problem (contd)
Optimization problem:
qd
min pj ◊j (© p€ ◊)
qj=1
d
subject to j=1 Sij ◊j Ø Xi , i = 1, . . . , m (© S◊ Ø X)
4
Linear programming duality
Linear program
P = minx c€ x
subject to Ax Ø b
Dual linear program
D = maxu b€ u
subject to A€ u = c
uØ0
Theorem.
Weak Duality: P Ø D
Bound: x feasible for P, u feasible for D, c€ x Ø P Ø D Ø b€ u
Strong Duality: Suppose P or D finite. Then P = D.
Dual of the dual is the primal (original) problem
5
More duality results
Here is another primal-dual pair
minx c€ x = maxu b€ u
subject to Ax = b subject to A€ u = c
P = min{c€ x : Ax Ø b}
Ø min{c€ x ≠ u€ (Ax ≠ b) : Ax Ø b} for all u Ø 0
Ø b€ u + min{(c ≠ A€ u)€ x : x œ Rn }
; €
b u A€ u = c
=
≠Œ otherwise
Ø max{b€ u : A€ u = c}
6
Financial Engineering and Risk Management
Review of nonlinear optimization
2
Unconstrained nonlinear optimization
Optimization problem
Gradient
5 6 C D
2x1 + 3x2 ≠ 94
Òf (x) = =0 ∆ x = 0,
3x1 + 3x22 3
2
5 6
2 3
Hessian at x: H =
3 6x2
5 6
2 3
x = 0: H = . Not positive definite. Not local minimum.
3 0
5 6 5 6
≠ 94 2 3
x= 3 : H= . Positive semidefinite. Local minimum
2
3 9
3
Lagrangian method
Constrained optimization problem
maxxœR2 2 ln(1 + x1 ) + 4 ln(1 + x2 ),
s.t. x1 + x2 = 12
4
Portfolio Selection
Optimization problem
maxx µ€ x ≠ ⁄x€ Vx
s.t. 1€ x = 1
Constraints make the problem hard!
Lagrangian function
L(x, v) = µ€ x ≠ ⁄x€ Vx ≠ v(1€ x ≠ 1)