Optimization With Equality
Optimization With Equality
Constraints
Optimization
• In mathematics, computer science and economics, an optimization problem is the problem of finding
the best solution from all feasible solutions.
• Optimization problems can be divided into two categories, depending on whether the variables are
continuous or discrete.
• So, Maximizing or minimizing some function relative to some set, often representing a range of
choices available in a certain situation. The function allows comparison of the different choices for
determining which might be “best.”
Examples:
• A consumer chooses how much to buy of each product, such that it satisfies his budget
constraint.
• A firm would look to minimize its cost of production, subject to a given output level.
Optimization with Equality Constraints
Lagrange multiplier method
• Suppose we want to maximize the function f (x, y) where x and y are restricted to satisfy
the equality constraint g (x, y) = c
max f (x, y)
subject to g (x, y) = c
The Lagrangian function, a modified version of the objective function that incorporates the constraint
where the term λ is a(n unknown) constant called a Lagrangian multiplier, associated with
the constraint.
Optimization with Equality Constraints
• So, Z (x, y, λ) is an unconstrained function (in three variables), so we can find its maximum by finding
the first-order conditions:
• So, we obtain the stationary points of the constraint function f (·) (with two choice variables), by
looking at the stationary points of the unconstrained function Z (·) (three choice variables, one of which
is associated with the constraint).
Optimization with Equality Constraints
Example 1