Adaptive Control of Nonlinear Systems Basic Results and Applications
Adaptive Control of Nonlinear Systems Basic Results and Applications
ADAPTIVE CONTROL
OF NONLINEAR SYSTEMS:
BASIC RESULTS AND APPLICATIONS *
Riccardo Marino
Abstract. Adaptive controls for nonlinear systems act cancellation of possibly nonlinear terms which
are defined as nonlinear dynamic (state or output may contain unknown or uncertain parameters. In
feedback) compensators capable of guaranteeing the case of linear systems once the pole placement
asymptotic tracking of an output reference signal theorem was established, the problem of adap-
for any unknown parameter vector and any initial tive pole placement was posed as a Model Ref-
condition for the closed loop system when time erence Adaptive Control (MRAC) : design a state
varying disturbances are not present. The purpose feedback control for controllable systems with un-
of this paper is to collect and illustrate the main known parameters so that the closed loop system
results available for single input single output non- asymptotically follows a linear system with preas-
linear systems in the design of adaptive state feed- signed eigenvalues. In the case of nonlinear sys-
back controls, adaptive observers, adaptive output tems the same problem may be posed. Since 1987
feedback controls and to briefly outline their de- the problem of designing controls for feedback lin-
velopments since 1987. The physical impact of earizable systems with uncertain parameters was
these results is illustrated by means of two clas- investigated in [16, 20 , 19]. In particular in [16, 19]
sical single input single output nonlinear control adaptive versions of feedback linearizing controls
problems containing uncertain parameters: tran- were designed by imposing Lipschitz conditions on
sient stabilization of a synchronous generator con- the nonlinearities while in [20] adaptive feedback
nected to an infinite bus subject to turbine failures linearizing controls were obtained under matching
and short circuits in transmission line; tracking conditions without imposing growth conditions.
control of a single link with unknown mass, iner- The interest of those results is easily illustrated
tia and length rotating on a vertical plane from by the simple example
angular measurements only. This paper is largely
based on examples, applications and results re-
ported in [15] .
Keywords. Nonlinear adaptive control, adaptive
observers, uncertain nonlinear systems. (1)
in which () is an unknown constant parameter. Let
INTRODUCTION B be the estimate of () in the linearizing control
(kl > 0, k2 > 0)
At the beginning of the eigthies two important
classes of non linear systems were defined for which (2)
constructive procedures to design nonlinear state
feedback control were determined: feedback lin- so that the corresponding closed loop system is
earizable systems and input-output feedback lin-
earizable systems. In the first case the state space X2
3
equations can be made linear (in certain state co-
A
869
with for a class of nonlinear systems under persistency
of excitation conditions following essentially the
(4) techniques developed in [8] for linear systems. In
view of the use of adaptive observers for out-
and P the symmetric positive definite solution of put feedback design, persistency of excitation is a
the Lyapunov matrix equation strong assumption. For this reason a more restric-
tive class of nonlinear systems for which adaptive
1
-k2 ]
T p+p [ 0
-kl -t ]=-1
observers may be designed without persistency of
excitation condition was obtained in r9]. The de-
sign procedure is illustrated by the fohowing sim-
ple example
assures that limt ..... oo IIx(t)11 = 0 for any initial con-
dition x(O), 8(0) and for any unknown parameter X2 + Bx~ ]
B, positive or negative. This conclusion may be [ Bx~ +u
drawn using the Lyapunov function
= Ac [ ~~ ] + bBxi + gu
6
whose time derivative is y Xl = Cex . (5)
V = _xT x. The observer is
870
and the error dynamics are Let
x Xlr XZr - k 3 X l r - k4 xz r + U r
XZr = .-k3 X lr - k 4 xzr + U r
Yr = Xlr
Differentiating the function be the reference model which generates the ref-
erence output Yr' The gains kc = (k3, k 4 ) are
chosen so that the characteristic polynomial of
(Ac - bk c) is (s + l)(s + >'c), i.e. there is a zero-
with respect to time and recalling that Pb = c~ pole cancellation in the transfer function cc[sI -
we have (Ac - bkc)]-lb = l/(s + >'c) (>'c is a positive
real). In both zero-pole cancellations we make
use of the crucial property enjoyed by the triples
(Ac - kocc , b, cc) and (Ac -bk c, b, cc) of being mini-
mum phase and of relative degree one. The output
feedback control is designed as
If the output yet) is bounded , it follows that
(9)
lim
t-co
IIx(t)11 = 0
in which the state estimates are provided by the
observer. Both the control and the observer try
and (6), (7) define an adaptive observer. Also to cancel the nonlinearity 8y2 by using the same
in this case the parameter estimation error is not
guaranteed to converge to zero estimate 0 of the unknown parameter 8 which is
On the basis of [9], for the same class of sys- now adjusted according to the update law (ry suf-
tems considered in [1] it was shown in [13, 12] how ficiently large positive real)
to design adaptive observers for equivalent states
via filtered transformations without requiring per-
sistency of excitation . The equivalent states are
related to the original ones through unknown pa- which reacts both to the tracking error y - Yr and
rameters and signals generated by known auxil- to the observer error y - Xl. The stability of the
iary filters (filtered transformations) . This result closed loop system can be assessed by expressing
leads immediately to the construction of adaptive the dynamics of the tracking error e = x - X r ,
output feedback controls for a class of nonlinear observer error x = x - X and estimation error
systems with relative degree one as shown in [12]. 9=8-0
For relative degree one systems the design proce-
dure is not a complex one as shown by the follow- (Ac - bkc)e + by 29+ bkcx
ing example -
x (Ac - kocc)x + by 2-8
[~ ~] x + [ ~ ] (u + 8yz) -y2cc(e + ryx)
and using the function
Acx + b(u + 8y2)
t::.
y [ 1 o ]X = Cc X .
Xz + u + OyZ + kl (y - xd
(Ac - bkcf Pc + Pc(Ac - bkc)
• Z Pc b
u+8y +kz(y-xd
(Ac - kocc)T Po + Po(Ac - koc c)
= yZ(y _ xd (8)
with (>'0 positive real) with Qc and Qo suitable positive definite matrices,
according to Meyer-Kalman-Yacubovich Lemma
[17, 18]. The time derivative of V is in fact
dV _ T T - -T -
dt - -e Qc e + 2e Pcbkc x - ryx Qox .
so that the characteristic polynomial of(Ac-kocc)
is (s + 1)(s + >'0), i.e. there is a zero-pole cancel-
latIOn in the transfer function This allows us to conclude that both the traking
error and the observer error converge to zero while
1 the convergence to zero of the estimation error is
Cc [ sI - (Ac - koc c)]
-1
b =- -.
s + >'0
not guaranteed.
871
As it happened for linear systems once the rel- Definition 2.2 Assume that p ~ n for system
ative degree one case had been solved, the solu- {11}. Let
tion of the relative degree two case readily fol-
lowed while the solution of the general case was M t = {x E Rn : hex) = Yr(t),
considerably harder and led to complex control
algorithms: the complete solution was given in . . . , Lj;lh(x) = y}P-1)(t)}
[14, 12] for a class of nonlinear systems with any
relative degree which contains,as a special case, be the time-varying (n - p )-dimensional integral
minimum phase linear systems with known rel- manifold called tracking manifold. The tracking
ative degree, known sign of the high frequency dynamics are defined as the dynamics constrained
gain, known upper bound of state space dimen- in Mt . 0
sions. In conclusion the basic adaptive result for
linear systems (see [17, 18]) has been generalized Definition 2.3 The disturbance characteristic
to a class of nonlinear systems with non Lipschitz index 11 is defined as the integer such that:
nonlinearities depending, in suitable coordinates , LqL~h(x) = 0, 0 ~ i ~ 11- 2, Tix E Rn , VB E 0 ,
on the output only. A different solution was pre- LqLj- 1h(x) #0, for some 0 E 0 , for some
sented in [5, 3] for a more restrictive class on non-
linear systems with any relative degree. Unlike x E Rn . We set 11 = 00 if LqL~h(x) = 0, i ~ 0,
the case of linear systems for which the solution Tix E Rn, VB E 0. 0
of the adaptive output feedback control problem
was obtained once non adaptive output feedback Definition 2.4 The adaptive tracking problem is
control problems were fully solved by Separation said to be globally solvable for system {11} if for
Theorem, for nonlinear systems the adaptive out- any smooth bounded reference trajectory Yr(t) with
put feedback control designed in [14] solved new bounded time derivatives yP) , . .. , y~p) a dynamic
problems (see [11]) in the non adaptive setting as state feedback control
well, that is for nonlinear systems with known pa-
rameters .
tU = J.l(X , w, Yr" "' Y~p» ) , wE R'
u u ( x , W, Yr , ... , y~p»)
ADAPTIVE STATE FEEDBACK
exists such that:
We consider nonlinear systems
(i) for any initial condition x(O) , w(O), IIx(t)lI,
p Ilw(t)1I are bounded Tit ~ 0,
x f(x) + g(x)u + L Oiqi(X) (ii) limt_oo(y(t) - Yr(t)) = O. 0
i=l
Theorem 2.1 Assume that for system {11}:
fe(x) + g(x)u
y hex) (11) (i) the global relative degree p is well defined and
v ~ p ~ n,
which are affected by an unknown constant pa-
rameter vector (ii) the tracking dynamics are bounded input
bounded state,
(iii) d(LqjL~h) E span{dh , . . . , d(L~h)} , 11-1 ~
i ~ p - 2, 1 ~ j ~ p , Tix E Rn ,
whose nominal value is zero so that the nominal
system is (iv) the vector fields
i: = f(x) + g(x)u
y hex) (12) f
where x E Rn is the state vector , u E R is the
control , h : c oo (Rn , R) is the output function , f ,
g , qi, 1 ~ i ~ p , are smooth vector fields in Rn ,
with g(x) # 0, for every x ERn.
are complete.
Definition 2.1 The global relative degree p is de- Then , the adaptive tracking problem is globally
fined as the integer such that for every 0 E n solvable for system {11}. 0
872
with tP;(x) , p+ 1:5 i:5 n, such that (dtP;, g) = 0, (v) th e vector fields
which transforms (11) into
Uh
J
P j f - gL L P- 1 h
Zj = Zj+1 + LB;Lq.L~-1h(x) 9 J
;=1 1
Co 9 =
Zj+1+ WJ(z)B, 1:5 i:5 p-l
Zp 1
Ljh(x) + L gLj- h(x)u are complete.
P
Then , the adaptive tracking problem zs globally
+ LB;Lq.Lr 1h (x) solvable for system (11). 0
;=1
.
They coincide with the systems identified in The- 0 . .. 1 0 In(Y , u)
orem 2.1 , which were introduced in [10], when the
relative degree is equal to one or equal to n .
~.
l/Ji1(Y, u)
l/Jd y, u)
1
Theorem 2.2 Assume that for system (11):
+ ~(J, .
v :5 p :5 n , = A oz + I (y , u) + W(y , u)(J
(ii) the tracking dynamics are bounded input
y = [0 0 . . . 0 1] Z = Co Z (18)
bounded state, if, and only if, in Rn :
(iii) the distributions 9; = span {g , . .. , a~ g} are (i) rank {dh , . . . , d(Lj-lh)} =n,
involutive and of constant rank i + 1 in Rn
for 0 :5 i :5 p - 1,
(ii) [ad~r, adjr] = 0, 0:5 i , j :5 n - 1,
(iv) ad q .0 C 9j, 1 :5 i :5 p , 0 :5 j :5 p - 2,
Vx E f(n , (iii) [g , adjr] =0, 0:5 j:5 n - 2, Vu E R m ,
873
(iv) [q; , ad~r] = 0, 0 ~ j ~ n-2 , 'Vu E R m , Proof. The error equation is
1 ~ i ~ p,
z Ai + b,BT (y, u, t)O
(v) the vector fields a~r, 0 ~ i ~ n - 1, are
complete,
8 -f,B(y,u,t) coi (22)
874
with ~[i] E Rn-l satisfying for 1 ~ i ~ p Theorem 3.5 applies to a realization in observer
form of (28) and guarantees the existence of a
[! 1~[i]
0 0 filtered transformation into an adaptive observer
0 0 -b
-h,2 form (19). Theorem 3.4 applies and leads to the
i[i] 1 0
-~3 construction of an adaptive observer. 0
0 1 -b n- 1
0
1
0
0 -b
-h,2 1 ADAPTIVE OUTPUT FEEDBACK
+ [l 0 1
:
-bn- 1
"pi(Y, u) In this section we consider nonlinear uncertain
systems
(26)
transforms (24) into the adaptive observer form
x = f(x) + [90(X) + tB;g;(X)] u + tB;q;(X)
6.
P f(x) + g(x, B)u + Q(x)B
iJ = Ao77 + ,(y, u) + b l)~n-l[i] + "pin(Y, u))9i Y h(x) (29)
i=1
6.
where x E Rn is the state vector, u E R is the
Ao77 + ,(y, u) + b{3(y, u, ~)9 control, £I = [£1 1 , . .. ,Bpf is the constant uncertain
y = Co 77 (27) parameter vector belonging to f2, a closed subset
in RP, h : Coo (R" , R) is the output function, f, go,
with {3 = L:f-l (~n-l [i] + "pin) bounded for every gi, q;, 1 ~ i ~ p, are smooth vector fields in Rn,
bounded u and y. with go(x) :I 0, for every x E Rn. We assume that
h(O) = 0 and that £I = 0 is the nominal parameter.
Proof. Differentiatin?; (25) with respect to time We will address the design of adaptive tracking
and taking (24) and (26) into account, we obtain controls defined as follows.
P Definition 4.8 A global adaptive output feedback
tracking control for system (29) is a finite dimen-
771 = 'I+Lbl(~n-di]+"pin)9i sional system
;=1
77j Zj-l +,j w
= p( w, y(t) , t), w(O) = Wo, w E R'
P u = u(w, y(t), t), uE R
+ L( -~j-di] + bj(~n_l[i] + "pin))9i such th at for every x(O) E Rn, Wo E R' and for
i=1 every bounded smooth output reference Yr(t) with
P bounded time derivatives, Ilx(t)II, IIw(t)1I and u(t)
77j-l +,j + L bj(~n-di] + "pin)9;, are bounded for every t ~ 0, and
;=1
lim [y(t) - Yr(t)] =0 .
2~j~n t-oo
o
which may be rewritten in matrix form as (27).
For every y and u bounded, ~n-di], 1 ~ i ~ p, Theorem 4.6 Let system (29) be of relative de-
is also bounded and therefore the matrix {3 has gree p for every £I E f2. Then , system (29) is
bounded entries . 0 transformable by a global state space diffeomor-
Theorem 3.5 shows that nonlinear systems (17) phism (independent of B)
satisfying the conditions of Theorem 3.3 are trans- (=T(x), T(O)=O, (ERn
formable into the system (27) in adaptive observer
form whose state 7J is related to the state Z (which into
is in turn related to the original state x by a £1- P
independent transformation) by a £I-dependent fil- ( Ac( + b(B)u(y)u + "po(y) +L "p;(y)B;
tered transformation (25) , (26). If Theorem 3.4
i=l
applies to the transformed system, it provides an
adaptive observer for a state of the system. Y Cc ( (30)
In the case of linear systems with unknown pa- with u: R -> R, "pi : R -> Rn, and (Ac,b,cc) in
rameters we have the following result as a special observer canonical form
case.
0
[~
1 0
J
Remark 3.1 Consider a single input, single out-
put linear system represented by the transfer func- 0 1
tion b(B) = bp(B)
0 0
0 0
bn(B)
[ 1 0 0 o]
875
if and only if: the filters (1 ~ j ~ n - 1, 0 ~ i ~ p)
(i) rank{dh, d(Lfh), ... , d(L,-lh)} = n, 1 . .. 0
-,\2 ... 0
(ii) [ad~r, a~r] = 0, 0 ~ i,j ~ n - 1, itfj]
[T 0
...
-'\;-1
r ] pul
(iii) [q;,ad}r] = 0, 1 ~ i ~ p, 0 ~ k ~ n-2, 0 0 -,\;
~
(iv) there exist a smooth function u : R
---> Rand
n-p+1 reals depending on 0, bp(O), ... , bn(O),
such that +[ ] u(y).
n-p+1
g = (u h) L bn- H1 (0)acfc=J)r ... 0 o ]pfj]
!]
0 yfj] [ 1 0 (33)
i=l 1 0 .. .
[ -d,
-d3 0 1 .. .
with bp(fl)sn- p+ ... +bn_1(fl)s+bn(fl) a Hur-
~[i]
witz polynomial with bp(fl) of known and con-
stant sign for every fl E f.!, -d~_l 0 0 " .
,[I]
-dn 0 0 ...
(v) the vector fields a~r, 0 S i ~ n - 1, are
~ ~,(y)
1 0 0
complete, [ -d,
-d3 0 1 0
z. = Acz + b [U(y)U
- - + oo(y, t) + f..
Lt fl;o;(y , t) 1 + ~6iy(j - 1] + ~ fl;(1/!i1(Y) + 6 [iD)
, ;=1
y = CcZ (35)
in which (Ac, cc) are in observer canonical form , withflo = 1 and(,,6 2 , •.. , 6n , 01 , ... , fl p ) unknown
b = [1 , b2 , • .. , bn]T is a Hurwitz vector, o;(y, t) , parameters. Ify(t) is bounded then y[i](t) , 1 ~ i ~
o ~ i ~ p , and u{y) are known smooth functions , n - 1 are also bounded.
, and 0; , 1 ~ i ~ p , are unknown constant param- Theorem 4.7 Consider system (29) with relative
eters with, > 0, is said to be in adaptive tracking degree p = 1. If assumptions (i)-(v) of Theorem
form . 0
4.6 are satisfied, then there exists a global adap-
tive output feedback tracking control for every un-
Lemma 4.1 Consider the system (30) with p =1 known value of the parameter vector fl for system
(0 0 = 1) (29).
p Proof By virtue of Theorem 4.6, system (29) is
( Ac( + b(fl)u(y)u + L fl; 1/!;(y) transformable into system (30) by a global state
;=0 space diffeomorphism . By virtue of Lemma 4.1 fil-
(31) tered transformations transform system (30) into
the adaptive tracking form (35). Since the triple
Given any constant Hurwitz vector d (Ac , d, cc) is observable , there exists a vector kc
such that for any positive real Ac
[1, d2 , .. . , dnf such that
n-l
det(sI - Ac - dk c) = (s + Ac)
sn-1+d 2 s n- 2 + . +dn _ 1s+dn = IT (s+'\;) (32) (sn-l + d 2 s n- 2 + ... + dn-1s + dn )
;=1 and
with A; , 1 ~ i ~ n - 1 arbitrary positive reals, -1 1
there exists a filtered transformation depending on Cc ( sI - A c - dk c ) d = --\-
s+ Ac
876
is strictly positive real. Define the reference model while the observer error dynamics are
ir = (Ac + dkc)zr + du r , Zr ERn
Yr = CcZr · (36) Z = (Ac+koCc)Z+d(bli7(y)u+t,bjY[j-1]
Note that with zr(O) = 0 we have
fir + >'cYr = U r (37) + tBi(tPil(Y) +~Ili])) .
which gives ur(t). Let e = Z - Zr be the tracking
error whose dynamics are, according to (35), (42)
1 n
e = (Ac + dkc)e + d [ -i7(y)u + L: bjy[j - 1] Since both triples (Ac + dk c , d, cc) and (Ac +
koc c, d, cc) are strictly positive real by Meyer-
, j=2
-Kalman-Yacubovich Lemma there exist two pos-
~Bi(tPil(Y)+6[i])-kcz-ur]
itive definite matrices Pc and Po, two vectors qc
+ (38) and qo, and two positive reals ic and io such that
The state estimate i is provided by the adaptive (Ac + dkcl Pc + Pc(Ac + dk c) -qcq'[ - ic l
observer Pc d cTc
-qoq~ - ioI
Z = Acz + d [8 1 i7(Y)U + ~ 8j y[j - 1] + tPOl(Y)
(Ao + koccf Po + Po(Ac + koc c)
Pod T
Cc •
y ccz (39)
in which 81 is an estimate of 01 = 1h and ko is
chosen so that
whose time derivative is
det(sI - Ac - koc c) = (s + >'0)
(sn-l + d2 s n - 2 + . . . + dn ) v < -iclleW - TJiolliW + 211ellllc'[ kcllllill
which implies that
+2 !: (60 + (y - Yr )i7(Y)(t, 8j y[j - 1]
cc(sI - Ac - k occ)-ld = ~
s+ p
+ L: Bi(tP;I(Y) + 6[i])
Ao
u= __ 8
u(y)
0
[t 8jy[j-1]+t O;(tPil(Y)
j=2 ;=1 n
p
+ I: B;(tP;I(Y) + 6[i])
;=1 ;=1
(41)
877
y)c5o (~c5jy(j - 1]
Proof. Let
-77(Y -
i Acz + bu - ay,
p
Y = cc z , yER
+L B;(~i1(Y) + {di])
;=1 be an observable realization of W( s) with n n*, =
b = [O, ... ,bp, . . . ,bno]T and a =
fa1, . .. , ano]T
-kc z - U r + ~01(Y) + {dO]) unknown vectors. This system satisfies conditions
(i)-(v) of Theorem 4.6, since it is minimum phase
((y - Yr) + 77(Y - y) }~i1(Y) + 6 [i]), and bp is of known sign. Therefore either Theorem
4.7 or Theorem 4.8 apply. 0
lSiSp
((y - Yr) + 77(Y - y))y(j -1], PHYSICAL APPLICATIONS
(44)
Example 5.1 Consider the reduced order model
with of a synchronous generator connected to an infi-
nite bus
77 > 6 = w - w.
W = ()1 - ()2w~1 sin 6 + ()3 sin 6 cos 6
we have ~I vI - ()4w~1 + ()s cos 6 .
(45) The parameters ()1, ()2, ()3 , ()4, ()s may undergo
an abrupt change due to short circuits in the line
connecting the generator to the infinite bus or to
for a suitable ( > O. This implies that e(t) , E(t) , turbine failure affecting ()1 . Those changes are
8i (t), 0 S i S n , B;(t) , 1 S i Spare bounded unknown and the task of the control algorithm is
for every t ? 0 and in particular that yet) - Yr(t) to prevent the generator to go out of step , i.e. to
is bounded which, since Yr(t) is bounded , implies keep 6 as close as possible to the stable operating
that yet) is bounded . Since yet) is bounded, from point 6e with w =
w. by acting on the control
(33)-(34) {i(t) , 0 S i S p and y[i](t) , 1 Si S n-1 input v J. We show how to solve this problem by
are bounded as well. From (41) and (42) it follows a state feedback adaptive control. For simplicity
that Ile(t)11 and lIi(t)11 are bounded . Taking (43), we do not introduce a reference model. Define
(45) into account we may apply Barbalat 's Lemma (A1 > 0)
[17] and conclude that for any initial condition
878
equation (47) may be rewritten as Defining the adaptation laws
5
i = -~ + [-1 1] [ co~ y ] = -~ + cos y
Vj -A3;fij + 02 WW sin 6 - W30 - L W3i Oi which along with a filtered transformation allows
i=l us to transform (49) into
so that
i = Acz + [ ~ ] (~<p + 8~)
5
Jj = -A3;fij +02wwsin6+ L W3i Bi . y = Cc Z (50)
;=1 which may be rewritten as
Consider the function <pO - j ([ Ac 1] [ ~~ ] + O~ - U r)
879
According to the proof of Theorem 4.8 the result- [8] G. Luders and K.S . Narendra. An adaptive
ing adaptive tracking control (S is the estimate of observer and identifier for a linear system.
IEEE '['rans. Automatic Control, 18:496-499 ,
6 = J) is 1973.
880