Lecture 13
Lecture 13
• Multi-Objective Optimization
• Unconstrained Multivariable Optimization
Assumptions
Multi-Objective Optimization
compromises
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Conflicting Nature of Multiobjective Optimization
• Some needs to
decrease
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Applications of MOO in Research
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Applications of MOO in Research
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Multi-Objective Optimization (MOO) Problems
maximized
competing objectives
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Mathematical Definition of MOO
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Dominance
function values
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Definition of Dominance
• x1 dominates x2, if
• x1 dominates x2 x2 is dominated by x1
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Example Dominance Test
• 1 Vs 2: 1 dominates 2
• 1 Vs 5: 5 dominates 1
• 1 Vs 4: Neither solution
dominates
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Pareto Optimal Solution
Given a set of solutions, the non-dominated solution set is a set of all the solutions that are not
• The non-dominated set of the entire feasible decision space is called the Pareto-optimal set
• The boundary defined by the set of all point mapped from the Pareto optimal set is called the
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Graphical Depiction of Pareto Optimal Solution
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Goals in MOO
diverse as possible
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Different Pareto Optimal Trade-off Surfaces
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Methods for MOO
• ε-Constraint Method
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Weighted sum method
supplied weight
of the objective
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Weighted sum method
Convex Non-Convex
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Weighted sum method
Advantage
• Simple
Disadvantage
• It is difficult to set the weight vectors to obtain a Pareto-optimal solution in a desired region
• It cannot find certain Pareto-optimal solutions in the case of a nonconvex objective space
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
ε-Constraint Method
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
ε-Constraint Method
• Keep f2 as an objective;
minimize f2(x)
• Treat f1 as a constraint;
f1(x) ≤ ε1
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
ε-Constraint Method
Advantage
Disadvantage
• The εvector has to be chosen carefully so that it is within the minimum or maximum
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Unconstrained Multivariable
Optimization
Problem
Sequence
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Methods for Search Direction
Direct Methods
Indirect Methods
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Direct Methods for Search Direction
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Direct Methods for Search Direction
• A random search method simply selects a starting vector xo, evaluates f(x) at xo , and
then randomly selects another vector x1 and evaluates f(x) at x1. In effect, both a
search direction and step length are chosen simultaneously. After one or more
stages, the value of f (xk) is compared with the best previous value of f(x) from among
the previous stages, and the decision is made to continue or terminate the procedure.
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Direct Methods for Search Direction
Grid Search Method
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Direct Methods for Search Direction
Univariate Search Method
• This method searches one dimension at a time thus optimizing only a single variable per iteration.
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
Direct Methods for Search Direction
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
In Direct Methods for Search Direction
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering
In Direct Methods for Search Direction
• Steepest Descent
Course:
Course: Modeling, Process Modeling
Simulation and Simulation
and Optimization | Lecture:
for Chemical Process Modeling
Engineering