Introduction To Optimization
Introduction To Optimization
Sushil Thakkar
IU1441110174
What is Optimization?
Architecture
Nutrition
Electrical circuits
Economics
Transportation
etc.
What do we optimize?
f ( x1 , x2 ,, xn )
with or without constrains
Unconstrained optimization
min f ( x, y) x 2 y 2 2
Optimization with constraints
min f ( x, y ) x 2 2 y 2
x0
or
min f ( x, y ) x 2 2 y 2
2 x 5, y 1
or
min f ( x, y ) x 2 2 y 2
x y 2
Lets Optimize
Minimize function
f ( x, y ) 0.5( x y )
2 2
11 x, y 11
Minimize function
f ( x, y ) cos( x) cos( y )
4 x, y 4
Gradient Descent Method Examples