04 Lecture Single Variable Optimisation
04 Lecture Single Variable Optimisation
Single-variable optimisation
Julia Wirtz
This lecture:
maxx∈S f (x): single variable optimisation.
Lecture 5:
max(x1 ,··· ,xn )∈S n f (x1 , · · · , xn ): multivariate optimisation.
Lecture 6:
max(x1 ,··· ,xn )∈S n f (x1 , · · · , xn ), subject to g(x1 , · · · , xn ) = 0:
multivariate optimisation with equality constraints.
Lecture 7:
max(x1 ,··· ,xn )∈S n f (x1 , · · · , xn ), subject to g(x1 , · · · , xn ) ≤ 0:
multivariate optimisation with inequality constraints.
D −→ f (D)
x −→ f (x)
We want to find an ”action” x ∈ D which maximises (or minimises) the value f (x).
f (x)
Maximum
A maximum point for f on D is a point c ∈ D such that
f (c) ≥ f (x), for all x ∈ D
x
f (x)
Minimum
A minimum point for f on D is a point c ∈ D such that
f (c) ≤ f (x), for all x ∈ D
x
4. Single-variable optimisation ECON10005 7 / 26
Finding a maximum/ minimum
Stationary point
f (x)
A stationary point of f is a point
c ∈ D such that:
f ′ (c) = 0
→ f needs to be differentiable
Corner point
If D = [a, b] is an interval, the
corner points are a and b. x
a b
→ requires finite bounds
f (x)
MAXIMUM
local max
local min
local min
MINIMUM
x
a b
c is a local minimum if
a) f ′′ (c) > 0
b) OR f ′ (c− ) < 0 and f ′ (c+ ) > 0 x
(f ′ is negative just below c and positive just
above)
c is a local maximum if
a) f ′′ (c) < 0
b) OR f ′ (c− ) > 0 and f ′ (c+ ) < 0 x
(f ′ is positive just below c and negative just
above)
c is an inflection point if
1. f ′′ (c) = 0
(
f ′′ (c− ) x
2. AND of different signs.
f ′′ (c+ )
↑ ↑
minimum maximum
Example: f (x) = ex
f (x)
1
Example: f (x) = x with x ∈ [a, b]
f is not continuous at 0. a
x
Neither the maximum nor the minimum b
exist.
Necessary condition
Consider f differentiable over the interval [a, b].
If c is a maximum (or minimum) of f on [a, b], then:
b) or c = a, or c = b [corner point]
f (x)
MAXIMUM
local max
local min
local min
MINIMUM
x
a b
Remarks:
Corner solution: If maximum/ minimum is a corner point (a or b)
Interior solution: otherwise
There may be several maxima/ minima
f (x)
If function f
1. is concave and
2. has a stationary point x
f (x)
Then: The stationary point is the
maximum
x
4. Single-variable optimisation ECON10005 21 / 26
Convex functions
f (x)
If function f
1. is convex and
2. has a stationary point x
f (x)
Then: The stationary point is the
minimum
x
4. Single-variable optimisation ECON10005 22 / 26
Summary: Convex/ concave functions
If f is concave, c is a maximum.
If f is convex, c is a minimum.
Maximum Minimum
a) f concave: f ′′ < 0 a) f convex: f ′′ > 0
b) f ′ > 0 for all x < c and b) f ′ < 0 for all x < c and
f ′ < 0 for all x > c f ′ > 0 for all x > c