RMPC 01
RMPC 01
University of Wisconsin-Madison,
Madison, Wisconsin, July 27, 2017
Outline
Opening
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 1
Robust Model Predictive Control (Part I)
Opening
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 2
Objectives
Repeated games,
Fundamental work in game theory and mathematics, and
Interesting illustration of Understanding.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 3
Robust Model Predictive Control (Part I)
Opening
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 4
Model Predictive Control Paradigm
Goals:
Constraint satisfaction,
Stability, and
Optimized performance.
Tool:
Model predictive control.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 5
Basic DMP = Finite Horizon Optimal Control
PN−1
and which minimize VN (xN , uN−1 ) := k=0 `(xk , uk )+ Vf (xN ) .
(Hereafter, Xf and Vf (·) are terminal constraint set and cost function.)
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 6
Prototype Algorithm and Principal Components
Prototype Algorithm:
At any state x and time t in the control process.
Solve basic DMP to evaluate control u00 (x) and value function VN0 (x).
Implement control action u00 (x).
Principal Components:
Control law u00 (·).
(Possibly set–valued) Feedback implicitly evaluated at current state.
Closed–loop controlled dynamics x + = f (x, u00 (x)).
(Possibly set–valued) Implicitly evaluated at encountered states.
Value function VN0 (·).
Lyapunov certificate for closed–loop controlled dynamics.
Controllability set, the domain of the value function, XN .
Positively invariant set for closed–loop controlled dynamics.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 7
Key Facts
Main properties:
MPC law u00 (·) is feedback implicitly evaluated at current state.
Predictions and optimized predictions are, however, open–loop.
Consistently improving and stabilizing (under mild assumptions).
Theoretical implementation:
Mathematical (nonlinear) programming in general case.
Strictly convex programming in most frequent cases.
Practical implementation:
Online optimization.
Offline parameteric optimization and online look–up tables.
Combinations of the online and offline parameteric optimization.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 8
Main Properties
Under mild assumptions on problem setting and terminal conditions
(e.g., regular continuous–compact-ls–continuous setting) design process is:
Well–posed.
(u00 (·), f (·, u00 (·)), VN0 (·) and XN well defined.)
Consistently improving.
(Increasing N decreases VN0 (·) and enlarges XN , etc.)
Positive invariance–inducing.
(Initial feasibility ⇒ ad–infinitum feasibility.)
Stabilizing.
(Ensures stabilization of the desired equilibrium.)
Optimizing.
(Enhances performance of the induced control process.)
Computationally plausible/effective.
(Systematic implementation via standard optimization techniques.)
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 9
A Few Points
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 10
Uncertainty Sources and Types
Uncertainty Sources:
Modeling. (Approximation, imprecision, etc.)
Sensing. (Imperfection, estimation, etc.)
Computing. (Cyber realm, software limitations, etc.)
...
Uncertainty Types:
Set–membership.
Probabilistic.
Combined.
Systematic analysis of uncertainty and its forms is a topic in its own right!
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 11
Robust Model Predictive Control (Part I)
Opening
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 12
Robust Model Predictive Control Paradigm
Goals:
Robust constraint satisfaction,
Robust stability,
Optimized robust performance, and
Computational practicability.
Tool:
Robust model predictive control.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 13
Pivotal Concerns
Convoluted interaction of uncertainty with:
System evolution,
Constraints, and
Performance.
Conflicting demands:
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 14
Value of Information
Scalar system: x + = x + u + w,
Constraints: X = [−1, 1], U = [−3, 3] and W = [−2, 2],
Target Set: Xf = {0}
Explanation: Inequality supa∈A inf b∈B c(a, b) ≤ inf b∈B supa∈A c(a, b).
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 16
Predicting Without Uncertainty (x + = x + u)
In charge of selecting
states {x0 , x1 , . . . , xN }, and
controls {u0 , u1 , . . . , uN−1 }.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 16
Predicting Under Uncertainty (x + = x + u + w)
States xk depend on:
initial state x0 ,
controls u0 , u1 , . . . , uk−1 , and
disturbances w0 , w1 . . . , wk−1 .
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 17
Predicting Under Uncertainty (x + = x + u + w)
Not in charge of selecting
states {x0 , x1 , . . . , xN }, and
controls {u0 , u1 , . . . , uN−1 }.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 17
Robustness of Conventional MPC
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 18
Fragility of Conventional MPC
Message:
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 19
Computational Complexity of Exact Robust MPC
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 20
Dynamic Programming Based Robust MPC
Richard E. Bellman (1920 – 1984)
Dynamic Programming
Curse of Dimensionality
Minimax optimal control laws uk (·) are the optimizers of the minimax value functions:
∀x ∈ Xk , uk (x) = arg minu {Jk (x, u) : u ∈ U ∧ ∀w ∈ W, f (x, u, w) ∈ Xk−1 }.
Domains of the minimax value functions Xk are the minimax controllability sets:
Xk = F −1 (Xk−1 ) where F −1 (X ) = {x ∈ X : ∃u ∈ U, ∀w ∈ W, f (x, u, w) ∈ X }.
For DP based RMPC, one makes (repetitive) use of (a selection of) uN (·) and VN (·) over XN .
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 21
Dynamic Programming Based Robust MPC
Richard E. Bellman (1920 – 1984)
Dynamic Programming
Curse of Dimensionality
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 21
Dynamic Programming Based Robust MPC
Richard E. Bellman (1920 – 1984)
Dynamic Programming
Curse of Dimensionality
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 21
Closed–Loop Robust MPC
System:
x+ = x + u + w
Uncertainty:
w ∈ [−1, 1]
Prediction horizon:
N=4
System:
x+ = x + u + w
Uncertainty:
w ∈ [−1, 1]
Prediction horizon:
N=4
Opening
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 25
Local Dynamics Under Uncertainty
State sets Xk ,
Control sets Uk .
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 26
Local Behaviour Under Uncertainty
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 27
Equilibrium Under Uncertainty
Generalized dynamics are set–dynamics.
Generalized state is set of states.
Generalized control is set of controls.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 29
Global Dynamics Under Uncertainty
With use of control policy ΠN−1 (·) := {π0 (·, ·) , π1 (·, ·) , . . . , πN−1 (·, ·)}.
State sets Xk ,
Control sets Uk .
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 30
Constraints Under Uncertainty
With use of control policy ΠN−1 (·) := {π0 (·, ·) , π1 (·, ·) , . . . , πN−1 (·, ·)}.
State constraints Xk ⊆ X,
Control constraints Uk ⊆ U,
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 31
Cost Under Uncertainty
Distance function
dist(S, p, S) := inf s∈S |p − s|S .
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 32
Summary of Uncertainty Effect
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 33
Robust Model Predictive Control (Part I)
Opening
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 34
Tube Model Predictive Control Paradigm
State and control tubes play role of state and control sequences.
Tubes are induced from the dynamics, uncertainty and control policy.
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 35
Tubes Evolution
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 36
Tube Optimal Control
Given an integer N ∈ N and a state x ∈ X select finite sequences of
control laws ΠN−1 := {π0 (·, ·) , π1 (·, ·) , . . . , πN−1 (·, ·)},
control sets UN−1 := {U0 , U1 , . . . , UN−1 }, and
state sets XN := {X0 , X1 , . . . , XN−1 , XN },
which, for each k ∈ {0, 1, . . . , N − 1}, satisfy
x0 ∈ X0 ,
F(Xk , πk ) ⊆ Xk+1 ,
G(Xk , πk ) ⊆ Uk ,
Xk ⊆ X,
Uk ⊆ U, and
XN ∈ Xf ,
PN−1
and which minimize VN (XN , UN−1 ) := k=0 `(Xk , Uk )+ Vf (XN ) .
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 38
Robust Model Predictive Control (Part I)
To Be Continued ...
Saša V. Raković, Ph.D. DIC Robust Model Predictive Control (Part I) 1st AMPCSS @ UW–Madison 39