State Variable Methods
State Variable Methods
State Variable Methods
Prerequisites
Purpose
The aim of this course is to equip the student with essential knowledge and skills in state space
design methods and digital control systems analysis and design
Learning Outcomes
Course Outline
State Variable Methods: state space mode representation, flow graphs and canonical forms; similar-
ity transformations and diagonalization; Characteristic Equation, Eigen values and Eigen-vectors;
Laplace techniques; state transition, time solution by transition matrix and inverse.
Design of Control Systems in State Space: canonical forms in relation to controllability and ob-
servability; simple pole placement design technique, State observer design.
Discrete Systems: sampling, data extrapolators and spectral characteristics; impulse in variance and
hold equivalent; design of Z-transform, Z-transform inversion; pulse transfer functions and block
manipulation; stability and damping; discrete compensator realisation design examples; bilinear
transformation; root space. Frequency domain identification using least squares.
Teaching Methodology
2 hour lectures and 1 hour tutorial per week, and at least five 3-hour laboratory sessions per
semester organized on a rotational basis.
i
Instructional Materials/Equipment
2. Overhead projector
1. Katsuhiko Ogata, Modern Control Engineering, Fourth Edition, Prentice Hall, 2002.
4. Charles L. Phillips, H. Troy Nagel, Digital Control System Analysis and Design, Prentice
Hall, 1989.
References
1. J. Nagrath, M. Gopal, Control Systems Engineering, Fifth Edition, Anshan Publishers, 2008.
ii
Control Engineering III Lecture Notes by A. M. Muhia
1.1.1 Introduction
State space approach is a generalized time-domain method of modelling, analysing and designing
a wide range of control systems.
The approach can deal with
1. Input variables
2. Output variables
3. State variables
1.1.2 Definitions
State: State of dynamic system is the smallest set of variables (state variables) such that knowl-
edge of the variables at time t = to plus knowledge of the inputs for t ≥ to , this information
determines the behaviour of the system for any time t ≥ to .
State variables: These are variables making up the smallest set of variables that determine the
state of the dynamic system.Let a dynamic system have n variables x1 , x2 , . . . ., xn to describe the
behavior of the system while the input is given fort ≥ to and the initial state at t = to is specified.
If the future state of the system is determined, then such variables are a set of state variables.
State vector: The behavior of a given system is described by n state variables and can be
considered to be n components of a vector x. Such a vector is called a state vector. A state is thus
a vector that determines uniquely the system state x (t) for anyt ≥ to once the state at t = to is
given and the input for t ≥ to is specified.
State space: The n dimensional space whose coordinate axis consists of x1 , x2 , . . . ., xn axis is
called state space. Any state can be represented by a point in the state space.
Consider the dynamic system shown below
The above dynamic system has MIMO.
1
Control Engineering III Lecture Notes by A. M. Muhia
The state of the system is described by a set of first order differential equations in terms of the
state variables x1 , x2 , . . . ., xn and input variables u1 , u2 , . . . ., ur as
The output of the system y1 (t) , y2 (t) ,. . .,ym (t) may be a function of input variables, state
variables and time. This may be described as
y1 (t) = (g1 x1 , x2 , . . . , xn ; u1 , u2 , . . . , ur ; t)
ym (t) = gm (x1 , x2 , . . . ., xn ; u1 , u2 , . . . ., ur ; t)
u1 (t)
u2 (t)
.. input vector
u (t) =
.
ur (t)
y1 (t)
y2 (t)
y (t) = .
output vector
..
ym (t)
2
Control Engineering III Lecture Notes by A. M. Muhia
Time invariant systems If the vector functions of f and g do not involve time, then the system
is said to be a time invariant system
Then
ẋt (t) = f (x, u) (5)
Time varying systems If the system is time varying, then equations 3 and 4 result to
where
A (t) – state matrix
B (t) – input matrix
C (t) – output matrix
D (t) – direct transition matrix
In this study, we shall focus on Linear Time Invariant (LTI) Systems. Using equations (7) and (8),
we can model the Linear Time Invariant Systems in block diagrams as follows
3
Control Engineering III Lecture Notes by A. M. Muhia
Example 1.1
Obtain the state space representation of the system described by
d3 y d2 y dy
+ 6 + 11 + 6y = 6u
dt3 dt2 dt
where y is the output andu is the input to the system
Solution
Knowledge of y (0) , ẏ (0)and ÿ(0) together with the input u (t) for t ≥ 0 determines completely the
future of the system. Thus if y (t) , ẏ (t)and ÿ(t)are a set of the state variables then
Defining the state variables as
x1 = y
x2 = ẏ
x3 = ÿ
Then
ẋ1 = ẏ = x2
x2 = ẏ = x3
By use of vector matrix notation, then the 3 first order differential equations can be combined into
one as
ẋ1 0 1 x1
0 0
ẋ2 = 0 0 1 x2 + 0 u
ẋ3 −6 −11 −6 x3 6
x3
Example 1.2
Write the state variable formulation of the parallel RLC network shown below
Solution
Applying KCL at node A then
i = iR + iC + iL
4
Control Engineering III Lecture Notes by A. M. Muhia
ˆ
v (t) dv (t) 1
I sin ωt = +C + v (t) dt
R dt L
d2 v 1 dv 1 ω
+ + v = I cos ωt
dt2 RC dt LC C
Choosing
v (t) = x1 (t)
ẋ1 (t) = x2
1 1 ω
ẋ2 (t) = − x1 − x2 + I cos ωt
LC RC C
The vector-matrix differential form of the state equation can be written as
" # " #" # " #
ẋ1 0 1 x1 0
= 1 1
+ ω
ẋ2 − LC − RC x2 CI cos ωt
NB
Usually in the circuit problem, the current through the inductor and voltage across the capacitor
are chosen as the state variables
Example 1.3
Consider the RLC circuit of Fig 2. The input is the voltage source e(t) and the output is the voltage
across the capacitor. Obtain the state space representation of the circuit.
Solution 1
5
Control Engineering III Lecture Notes by A. M. Muhia
dvc (t)
i(t) = C
dt
dvc (t) 1
= i(t) (12)
dt C
6
Control Engineering III Lecture Notes by A. M. Muhia
" #
h i x (t)
1
y(t) = 0 1 + 0e(t) (16)
x2 (t)
Solution 2
From the circuit, we can also write
ˆ
di(t) 1
e(t) = L + Ri(t) + i(t) dt (17)
dt C
d2 q(t) dq(t) 1
L +R + q(t) = e(t) (18)
dt2 dt C
NB
Equations 15,16 and 22, 23 are the different state space representation of the same circuit of Figure
2. This shows that state space representation of a system is not unique
Example 1.3
Write the state variable formulation of the network shown in Figure 3, given that R1 = R2 = 1 Ω,
L = 1 H, C1 = C2 = 1 F , i(t) as the input and the voltage across R2 as the output
7
Control Engineering III Lecture Notes by A. M. Muhia
Solution
We choose x1 = v1 , x2 = i2 and x3 = v3 as the state variables. The node and loop equations are
obtained as follows
At node n1
dv1
i(t) = i4 + i1 + i2 = v1 + + i2 (24)
dt
At node n2
dv3
i2 = i3 + i5 = v1 + + v3 (25)
dt
For loop l1
di2
v1 = vL + v3 = + v3 (26)
dt
Rearranging these equations
dv1
= −v1 − i2 + i(t) (27)
dt
di2
= v1 − v3 (28)
dt
dv3
= i2 − v3 (29)
dt
The state equation becomes
ẋ1 −1 −1 0 x1 1
ẋ =
2 1 0 −1 x2 + 0 u(t) (30)
ẋ3 0 1 −1 x3 0
y(t) = v3
8
Control Engineering III Lecture Notes by A. M. Muhia
x3
Exercise
1. Consider the circuit of Figure 4. The input is the voltage source e(t). The outputs of the
circuit are the voltage across and current through resistor R2 . Taking the inductor currents
and capacitor voltage to be the states, determine the state space representation of the circuit.
2. Consider the circuit of Figure 5. The output of the circuit is the voltage across resistor R1 .
Determine the state space representation of the circuit.
9
Control Engineering III Lecture Notes by A. M. Muhia
This is realized when one of the variables in the physical system and its derivatives are chosen as
state variables. The state variables are known as phase variables. Usually the output of the system
and its derivatives are chosen as state variables.
The state model can be obtained when the system is described in either differential form or in
transfer function form.
Example
Obtain the phase variable state model of the system defined by the differential equation
Solution
We define the state variables as
Then
ẋ1 (t) = ẏ(t) = x2 (t)
x3 (t)
Example
Obtain the phase variable state model of the system defined by
Y (s) 2
= 3
U (s) s + s2 + 2s + 3
Solution
10
Control Engineering III Lecture Notes by A. M. Muhia
ẋ1 (t) 0 1 x1 (t)
0 0
ẋ2 (t) = 0 0 1 x2 (t) + 0 u(t) (34)
x3 (t)
The state space representation of the system defined by equation 36 and 37 can be presented in
controllable canonical form, observable canonical form, diagonal canonical form and Jordan canon-
ical form;
and
11
Control Engineering III Lecture Notes by A. M. Muhia
x1
x2
..
h i .
y = bn − an b0 bn−1 − an−1 b0 ··· ··· b1 − a1 b0
+ b0 u
.. (39)
.
x
n−1
xn
Example 1.3
Consider the system given by
Y (s) s+3
= 2
U (s) s + 3s + 2
12
Control Engineering III Lecture Notes by A. M. Muhia
ẋ1 0 0 ··· ··· 0 −an x1 bn − an b0
ẋ2 1 0 ··· ··· 0 −an−1 x2 bn−1 − an−1 b0
.. .. .. .. .. ..
. . . . .
.
u
. = . + (40)
.. .. .. .. ..
..
. . . .
ẋ
n−1 0 0 ··· ··· 0 −a2 xn−1 b2 − a2 b0
and
x1
x2
.
h ..
i
y= 0 0 ··· ··· 0 . + b0 u
1 (41)
..
xn−1
xn
Example 1.4
Obtain the observable canonical form of the state space representation for the system with the
transfer function
Y (s) s+3
= 2
U (s) s + 3s + 2
Solution
n = 2 , b0 = 0 ,b1 = 1 ,b2 = 3 ,a1 = 1 , a2 = 2
" # " #" # " #
ẋ1 0 −a2 x1 b2 − a2 b0
= + u
ẋ2 1 −a1 x2 b1 − a1 b0
" #" # " #
0 −2 x1 3
= + u
1 −3 x2 1
" #
h i x
1
y= 0 1 + b0 u
x2
" #
h i x
1
= 0 1
x2
If the denominator polynomial has distinct roots then the transfer function can be written as
13
Control Engineering III Lecture Notes by A. M. Muhia
c1 c2 cn−1 cn
= b0 + + + + (43)
(s + p1 ) (s + p2 ) (s + pn−1 ) (s + pn )
the diagonal canonical form of the state space representation of the system is given by
ẋ1 −p1 0 ··· ··· 0 0 x1 1
ẋ2 0 −p1 ··· ··· 0 x2 1
.. .. .. .. .. .. ..
. . . . . . .
. = . . + . u (44)
.. .. .. .. .. . .
. . . .
.
ẋn−1 0 0 0 ··· −pn−1 0 xn−1 1
and
x1
x2
.
h ..
i
y = c1 c2 ··· ··· cn−1 . + b0 u
cn (45)
..
xn−1
xn
Example1.5
Obtain the diagonal canonical form of the state space representation for the system with the transfer
function
Y (s) s+3
= 2
U (s) s + 3s + 2
Solution
s+3 s+3 c1 c2
= = +
s2 + 3s + 2 (s + 1) (s + 2) (s + 1) (s + 2)
b0 = 0 , c1 = 2 , c2 = −1 , p1 = 1 , p2 = 2
" # " #" # " #
ẋ1 −p1 0 x1 1
= + u
ẋ2 0 −p2 x2 1
" #" # " #
−1 0 x1 1
= + u
0 −2 x2 1
14
Control Engineering III Lecture Notes by A. M. Muhia
" #
h i x
1
y = c1 c2 + b0 u
x2
" #
h i x
1
= 2 −1
x2
If the denominator polynomial involves multiple roots then the state space representation can be
written in Jordan canonical form.
For example, if the pi ‘s are different from one another except that the first three are equal i.e.
p1 = p2 = p3 , then the factored form of the transfer function becomes
Y (s) c1 c2 c3 c4 cn
U (s)
= b0 + 3 + 2 + (s + p ) + (s + p ) + · · · + (s + p ) (47)
(s + p1 ) (s + p1 ) 1 4 n
The state space representation of the system in Jordan canonical form becomes
ẋ1 −p1 1 0 0 0
x1 0
−p1
0 1 0
ẋ2
x2 0
..
ẋ3 0 0 −p1 0 . x 1
3
= + u (48)
ẋ4 0 .. x4 1
. −p4 .
. .
. .. ··· 0
ẋn xn 1
0 ··· ··· ··· ··· −pn
and
x1
x2
h i
..
y = c1 c2 ··· ··· cn .
+ b0 u (49)
.
..
xn
Example
Obtain the state model for the system described by the transfer function
Y (s) s
= 2
U (s) (s + 2) (s + 2)
15
Control Engineering III Lecture Notes by A. M. Muhia
Solution
In partial fraction form
Y (s) 2 1 2
= − −
U (s) s + 1 (s + 1)2 s+2
The state model is obtained as
ẋ1 (t) −1 1 0 x1 (t) 0
ẋ2 (t) = 0 −1 0 x2 (t) + 1 u(t) (50)
x3 (t)
NB
The characteristic equation of a given system remains invariant under different forms of state
variable representation. This can be true for the transfer function also. The choice of the states is
not unique
Example 1.6
Consider the system
...
y + 6ÿ + 11ẏ + 6y = 6u
where y is the output and u is the input. Obtain the state space representation of the system
Solution I
Let
x1 = y
x2 = ẏ
x3 = ÿ
ẋ1 = x2
ẋ2 = x3
ẋ1 0 1 0 x1 0
ẋ2 = 0 0 1 x2 + 0 u
ẋ3 −6 −11 −6 x3 6
16
Control Engineering III Lecture Notes by A. M. Muhia
h i x1
y= 1 0 0 x2
x3
|SI − A| = 0
s3 + 6s2 + 11s + 6 = 0
Solution II
...
y + 6ÿ + 11ẏ + 6y = 6u
Y (s) 6
= 3 2
U (s) s + 6s + 11s + 6
6
=
(s + 1) (s + 2) (s + 3)
Y (s) 3 −6 3
= + +
U (s) (s + 1) (s + 2) (s + 3)
3 −6 3
Y (s) = U (s) + U (s) + U (s)
(s + 1) (s + 2) (s + 3)
Defining
Y (s) = X1 (s) + X2 (s) + X3 (s)
where
3
X1 (s) = U (s) ẋ1 = −x1 + 3u
(s + 1)
−6
X2 (s) = U (s) ẋ2 = −2x2 − 6u
(s + 2)
3
X1 (s) = U (s) ẋ3 = −3x3 + 3u
(s + 3)
17
Control Engineering III Lecture Notes by A. M. Muhia
ẋ1 1 0 0 x1 3
ẋ2 = 0 −2 0 x2 + −6 u
ẋ3 0 0 −3 x3 3
h i x1
y= 1 1 1 x2
x3
|SI − A| = 0
s3 + 6s2 + 11s + 6 = 0
18
Control Engineering III Lecture Notes by A. M. Muhia
It has been stated that the choice of states is not unique for a given system. Suppose that there
exists a set of state variables
h iT
X = x1 x2 ··· xn (52)
h iT
Z = z1 z ··· zn (53)
Ż = P −1 Ẋ (55)
Ẋ = Ax + Bu
y = Cx
Ż = P −1 Ax + P −1 Bu (56)
Ż = P −1 AP z + P −1 Bu (57)
and
y = Cx = CP z (58)
19
Control Engineering III Lecture Notes by A. M. Muhia
y = Ĉx (60)
NB
1. The characteristic equations and hence the Eigen values of A and Âare invariant under simi-
larity transformation
Ax = λx (61)
The values of the scalar λ for which non trivial solutions exist are called Eigen values and the
corresponding solutions x = 0 are called Eigen vectors
Equation (34) can be written in the form
(λI − Ax) = 0 whereI is the identity matrix
|λI − Ax| = 0 is the characteristic equation of A
The roots of the characteristic equation are called Eigen values of the matrix A
Corresponding to each Eigen value is a non-zero solution of x = expi This is called the Eigen vector
of A corresponding to λi
Example 1.7
" #
4 1
Determine the Eigen values and Eigen vectors of Ax = λx where A =
3 2
Solution
|λI − A| = 0
(λ − 4) (λ − 2) − 3 = 0
λ1 = 5, λ2 = 1
20
Control Engineering III Lecture Notes by A. M. Muhia
4x1 + x2 = 5x1
x1 = x2
4x1 + x2 = x1
3x1 + 2x2 = x2
x1 = −3x2
simplest form
We obtain the transformation matrix P from the Eigen vectors as follows
" #
h i 1 1
P = exp1 exp2 =
1 −3
21
Control Engineering III Lecture Notes by A. M. Muhia
Under similarity transformation the characteristic equation does not change i.e.
|λI − A| = λI − Â = λ2 + λs + 5
In some cases, the matrix A will have repeated Eigen values. The Eigen vectors are evaluated as
follows
Example 1.8
3 −3 2
Determine the Eigen values and Eigen vectors of Ax = λx where A = −1 5 −2
−1 3 0
Solution
|λI − A| = 0
λ − 3 3 −2
1 λ−5 2 =0
1 −3 λ
λ3 − 8λ2 + 20λ − 16 = 0
λ1 = 4 λ2 = λ3 = 2
For λ1 = 4
3 −3 2 x1 x1
−1 5 −2 x2 = 4 x2
−1 3 0 x3 x3
This yield
x2 = −x1
and
x3 = −x1
22
Control Engineering III Lecture Notes by A. M. Muhia
1
exp1 = −1
−1
For λ2 = λ3 = 2
3 −3 2 x1 x1
−1 5 −2 x2 = 2 x2
−1 3 0 x3 x3
x1 − 3x2 + 2x3 = 0
x1 − 3α + 2β = 0
x1 = 3α − 2β
0 1
3
For β = 0and α = 1 , exp2 = 1
0
−2
Forβ = 1 and α = 0 ,exp3 = 0
1
The transformation matrix P is obtained as
1 3 −2
P = −1 1 0
−1 0 1
23
Control Engineering III Lecture Notes by A. M. Muhia
−1
1 3 −2 3 −3 2 1 3 −2
 = P −1 AP = −1 1 0 −1 5 −2 −1 1 0
−1 0 1 −1 3 0 −1 0 1
4 0 0
= 0 2 0
0 0 2
|λI − A| = λI − Â = λ3 − 8λ2 + 20λ − 16 = 0
1.3.3 Diagonalization
NB: The matrix P consisting of the Eigen vectors of the state matrix can be used under similarity
transformation to diagnalize the state matrix
λn−1
1
n−1
λ2 ··· λn−1
n
where λ1 , λ2 , · · · , λn are the distinct eigenvalues. The matrix P will transform the matrix A into
diagonal matrix as
λ1 0 0 ··· 0
0 λ2 0 ··· 0
A = P −1 AP =
.. .. .. .. ..
.
. . . .
0 0 0 ··· λn
Example
24
Control Engineering III Lecture Notes by A. M. Muhia
y(t) = CP z(t)
Example 1.9
Obtain the Laplace transform of f (t) = expat
Solution
ˆ ∞
L {f (t)} = exp−st expat dt
0
1
=
s−a
25
Control Engineering III Lecture Notes by A. M. Muhia
Recall II
n 0 o
L f (t) = sL {f (t)} − f (0) (63)
0
L f ” (t) = s2 L {f (t)} − sf (0) − f (0)
(64)
and so on for Laplace transform of higher derivatives(you should be able to prove this with a lot of
ease)
Example 1.10
Use the Laplace transform of second derivative to derive
s
L {cos (at)} =
s2 + a2
Solution
Let
f (t) = cos (at)
0
f (t) = −a sin at
and
0
f (0) = 0
f (0) = 1
0
L f ” (t) = s2 L {f (t)} − sf (0) − f (0)
s2 + a2 L {cos (at)} = s
s
L {cos (at)} =
s2 + a2
26
Control Engineering III Lecture Notes by A. M. Muhia
ẋ = Ax + Bu (65)
y = Cx + Du (66)
Assuming that the initial conditions of the system are zero i.e. X (0) = 0 and rearranging (40) then
−1
X (s) = (SI − A) BU (s) (69)
Y (s) −1
G (s) = = C (SI − A) B + D (71)
U (s)
Example 1.11
Obtain the transfer function of the system whose state space representation is given as
" #" # " #
0 1 x1 0
ẋ = + u
−2 −3 x2 1
" #
h i x
1
y= 1 0
x2
Solution
Y (s) −1
G (s) = = C (SI − A) B + D
U (s)
where
27
Control Engineering III Lecture Notes by A. M. Muhia
" # " #
0 1 0 h i
A= , B= , C= 1 0 and D = 0
−2 −3 1
" #
−1 1 s+3 1
(SI − A) = 3
s + 3s + 2 −2 s
" #" #
1 h i s+3 1 0
−1
C (SI − A) B + D = 1 0
s3 + 3s + 2 −2 s 1
1
=
s3 + 3s + 2
Approach A
Assume a solution of the form
x (t) = b0 + b1 t + b2 t2 + · · · + bk tk (73)
If the assumed solution is to be a true solution, equation (47) must hold true for any value of t
This implies that
b1 = ab0
1 2
b2 = a b0
2
1 k
bk = a b0
k!
The value of b0 is determined by substituting t = 0 into equation (46) i.e.
X (0) = b0
28
Control Engineering III Lecture Notes by A. M. Muhia
1 1
x (t) = 1 + at + a2 t2 + · · · + ak tk x (0)
2 k!
But
1 1
expat = 1 + at + a2 t2 + · · · + ak tk
2 k!
Therefore
Approach B
Using Laplace transform of the homogeneous equation (45)
1
X (s) = X (0)
s−a
Taking the inverse Laplace transform
The approach to the solution of homogeneous scalar equation can be extended to the solution of
homogeneous state equation
−1
X (s) = (sI − A) X (0)
−1
x (t) = L−1 (sI − A) x (0) (77)
29
Control Engineering III Lecture Notes by A. M. Muhia
Where
−1
expAt = L−1 (sI − A)
expAt is called the state transition matrix and contains all information about the free motions of
the system described by (49)
Example 1.12
Obtain the state transition matrix of the following state equation
" # " #" #
ẋ1 0 1 x1
=
ẋ2 −2 −3 x2
Solution
−1
expAt = L−1 (sI − A)
" #
−1 1 s+3 1
(sI − A) = 3
s + 3s + 2 −2 s
" #
1 s+3 1
=
(s + 2) (s + 1) −2 s
" # " #
s+3 1 2 1 1 1
(s+2)(s+1) (s+2)(s+1) (s+1) − s+2 (s+1) − s+2
= −2 s
= −2 2 −1 2
(s+2)(s+1) (s+2)(s+1) (s+1) + s+2 (s+1) − s+2
" #
2 1 1 1
At −1 −1 −1 (s+1) − s+2 (s+1) − s+2
exp =L (sI − A) =L −2 2 −1 2
(s+1) + s+2 (s+1) − s+2
" #
2 exp−t − exp−2t exp−t − exp−2t
=
−2 exp−t +2 exp−2t − exp−t +2 exp−2t
30
Control Engineering III Lecture Notes by A. M. Muhia
d
exp−at x (t) = exp−at Bu (t)
(80)
dt
Integrating equation (53) between0 and t results in
ˆ t
−at
exp x (t) = exp−at Bu (t) dt + x (0)
0
ˆ t
x (t) = expat x (0) + expat exp−aτ Bu (τ ) dτ (81)
0
• The first term on the right hand side is the response to the initial conditions
Extending the same approach to the solution of homogeneous state equation yields
ˆ t
x (t) = expAt x (0) + expA(t−τ ) Bu (τ ) dτ (82)
0
The solution of x (t) is the sum of a term consisting of the transition of the initial state and a term
arising from the input vector
Example 1.13
Obtain the time response of the following system
" # " #" # " #
ẋ1 0 1 x1 0
= + u
ẋ2 −2 −3 x2 1
ˆ t
x (t) = expAt x (0) + expA(t−τ ) Bu (τ ) dτ
0
31
Control Engineering III Lecture Notes by A. M. Muhia
" #
A(t−τ ) A(t−τ ) 0 h i
exp Bu (τ ) = exp 1
1
" #
exp−(t−τ ) −2 exp−2(t−τ )
=
− exp−(t−τ ) +2 exp−2(t−τ )
ˆ t ˆ t
A(t−τ ) exp−(t−τ ) −2 exp−2(t−τ )
exp Bu (τ ) dτ = dτ
0 0 − exp−(t−τ ) +2 exp−2(t−τ )
" #
1
2 − exp−t + 12 exp−2t
=
exp−t − exp−2t
" #
1
− exp−t + 21 exp−2t
x (t) = expAt x (0) + 2
exp−t − exp−2t
" #" # " #
2 exp−t − exp−2t exp−t −2 exp−2t x1 (0) 1
2 − exp−t + 12 exp−2t
= +
−2 exp−t +2 exp−2t − exp−t +2 exp−2t x2 (0) exp−t − exp−2t
These tells us whether it is at all possible to control all the states of the system completely by
suitable choice of input and whether it is possible to reconstruct the states of a system from its
input and outputs
1. Controllability
The system is said to be controllable if it is possible to find some input u (t) that will transfer
the initial state of the system x (0) to the origin of the state space, x (t0 ) = 0 with t0 finite.
The solution of the state equation yields
ˆ t
x (t) = Φ (t) x (0) + Φ (t − τ ) Bu (τ ) dτ (84)
0
32
Control Engineering III Lecture Notes by A. M. Muhia
ˆ t
x (0) = Φ (t0 ) x (0) + Φ (t0 − τ ) Bu (τ ) dτ = 0 (85)
0
with finite t0
A linear time invariant continuous time system is completely controllable iff the RANK of
the controllability matrix M is equal ton
h i
M= B AB A2 B . . . An−1 B (86)
The rank of a matrix A is the maximum number of linearly independent columns of A; that
is, it is the order of the largest non singular matrix contained in A. This implies that the
controllability matrix M must be non singular for the system to be completely controllable.
If a system is not completely controllable, it implies that it has one or more natural modes
that cannot be affected by the input directly or indirectly.
Example 1.14
Determine whether the system represented by the given state space is controllable
Solution
The controllability matrix is given by
h i
M= A AB
ẋ1 = 0.5x1
33
Control Engineering III Lecture Notes by A. M. Muhia
It is evident that whereas x2 can be changed byu (t) the state x1 is unaffected by our choice
of the inputs since it is not coupled either directly to the input or to the state x2 hence this
state of x1 (0) exp−0.5t is uncontrollable
On the other hand if we had
ẋ1 = 0.5x1 + x2
2. Observability
The linear time invariant system is said to be observable if the initial condition x (0)can be
determined from the output function y (t) for 0 < t < t1 where t1 is finite
y (t) = Cx (t)
ˆ t
= CΦ (t) x (0) + C Φ (t − τ ) Bu (τ ) dτ (87)
0
Thus given u (t) and y (t)for 0 < t < t1 with t1 being some finite value, the system is observable
if equation (60) can be solved forx (0)
The system is observable if the observability matrix N is nonsingular i.e. the rank of N is
equal ton
C
CA
N = .
..
CAn−1
34
Control Engineering III Lecture Notes by A. M. Muhia
Example 1.15
Consider the system represented by
" #
C
N=
CA
" # " #
h i 0.5 0 0 1
CA = 0 1 =
0 −2 0 −2
0 1
N = =0
0 −2
35
Control Engineering III Lecture Notes by A. M. Muhia
State space design enables the design of a system having the desired closed loop poles or desired
characteristic equation
It also enables inclusion of initial conditions if necessary
Pole placement design is based on the state model of the system. We assume that all the state
variables are measurable and are available for feedback
State model equations
The plant input u (t) is made a function of the states of the form
Equation (62) is called the control rule or control law. In pole placement design, the control law is
specified as a linear function of the states of the form
36
Control Engineering III Lecture Notes by A. M. Muhia
This control law allows the poles of the closed system to be placed in any desirable location and is
expressed as
The design problem is the specification of the desired root locations of the systems characteristic
equations and the calculations of the gains ki to yield these desired root locations.
A necessary and sufficient condition that the closed-loop poles can be placed at any arbitrary
location in the s-plane is that the system must be completely state controllable.
h i
K = k1 k2 k3 (92)
(s − µ1 ) (s − µ2 ) (s − µ3 )
|[sI − A + BK]|
We equate
(s − µ1 ) (s − µ2 ) (s − µ3 ) = |[sI − A + BK]|
where
0 1 0
A= 0 0 1
−1 −5 −6
37
Control Engineering III Lecture Notes by A. M. Muhia
0
B = 0
The system uses the state feedback control law u (t) = −kx (t). It is desired to have closed
loop poles at s = −2 ± j4 , s = −10.
Determine the state feedback gain matrix K
Solution
We first check for controllability of the system
h i
M= B AB A2 B
0 0 1
M = 0 1 −6 = −1
1 −6 31
The matrix is non singular hence the system is completely state controllable
Next we solve forK
Let h i
K = k1 k2 k3
|[sI − A + BK]|
s 0 0 0 1 0 0 h
i
= 0 s 0 − 0 0 1 + 0 k1 k2 k3
0 0 s −1 −5 −6 1
= s3 + (6 + k3 ) s2 + (5 + k2 ) s + (1 + k1 ) .........(i)
38
Control Engineering III Lecture Notes by A. M. Muhia
k3 = 8 k2 = 55 k1 = 199
h i
K = 199 55 8
|λI − A| = 0
Then
To obtain the inverse of the matrix A we divide equation byA on both sides
−1 n−1
A−1 = + α1 An−2 + α2 An−3 + · · · + αn−1 I
A (95)
αn
Example 1.17
Determine the inverse of the matrix
1 2 7
A = 4 2 3
1 2 1
using Cayley Hamilton Theorem
Solution
|λI − A| = 0
39
Control Engineering III Lecture Notes by A. M. Muhia
λ − 1 −2 −7
−4 λ−2 −3 = 0
−1 −2 λ − 1
λ3 − 4λ2 − 20λ − 35 = 0
−1 2
A−1 =
A − 4A − 20I
35
−4 11 −5
−1
= −1 −6 25
35
6 1 −10
We assume that the system is completely state controllable and that the desired closed loop
poles are at
s = µ1, s = µ2 . . . . . . s = µn
Equation(69) becomes
ẋ = [A − Bk] x (97)
Defining  = A − Bk
Then the desired characteristic equation is
sI − Â = 0
(s − µ1 ) (s − µ2 ) . . . . . . (s − µn ) = 0
Use of Cayley Hamilton theorem which states that  satisfies its own characteristic equation
we obtain
40
Control Engineering III Lecture Notes by A. M. Muhia
Φ Â = Ân + α1 Ân−1 + α2 Ân−2 + · · · + αn−1 Â + αn I = 0 (98)
 = A − Bk (100)
2
Â2 = [A − Bk]
= A2 − 2ABK − B 2 K 2
= A2 − ABK − BK Â (101)
2
Â3 = [A − Bk] [A − BK]
h i
= A2 − ABK − BK Â [A − BK]
Multiplying both sides of equations (72), (73), (74) and (75)with, α3 ,α2 α1 and α0 where
α0 = 0
α3 I = α3 I
α2 Â = α2 [A − Bk]
h i
α1 Â2 = α1 A2 − ABK − BK Â
41
Control Engineering III Lecture Notes by A. M. Muhia
Â3 +α1 Â2 +α2 Â+α3 I = A3 +α1 A2 +α2 A+α3 I−α2 BK−α1 ABK−α1 BK Â−A2 BK−ABK Â−BK Â2
(103)
Since
Â3 + α1 Â2 + α3 I = Φ Â = 0
And
A3 + α1 A2 + α2 A + α3 I = Φ (A) 6= 0
then
h i h i
Φ (A) = B α2 K − α1 K Â − K Â2 + AB α1 K − K Â + A2 BK
2
h i α2 K − α1 K Â − K Â
Φ (A) = B AB A2 B α1 K − K Â (105)
K
h i−1 α2 K − α1 K Â − K Â2
B AB A2 B Φ (A) = α1 K − K Â (106)
K
h i
Premultiplying both sides of (79) by 0 0 1 and rearranging we obtain
h ih i−1
K= 0 0 1 B AB A2 B Φ (A) (107)
h ih i−1
K= 0 0 ... 1 B AB ... An−1 B Φ (A) (108)
Example 1.18
Consider the system
42
Control Engineering III Lecture Notes by A. M. Muhia
where
0 1 0
A= 0 0 1
−1 −5 −6
0
B = 0
The system uses the state feedback control law u (t) = −kx (t). It is desired to have closed
loop poles at
s = −2 ± j4 , s = −10.
Determine the state feedback gain matrix K using Ackermann’s formular
Solution
The desired characteristic equation is given by
where
0 1 0
A= 0 0 1
−1 −5 −6
199 55 8
Φ (A) = −8 159 7
−7 −43 117
h 0 i 0 1
2
B AB A B = 0 1 −6
1 −6 31
h ih i−1
K= 0 0 1 B AB A2 B Φ (A)
h i 0 0 1 199 55 8
K= 0 0 1 0 1 −6 −8 159 7
1 −6 31 −7 −43 117
43
Control Engineering III Lecture Notes by A. M. Muhia
h i
K = 199 55 8
ẋ = Ax + Bu
(a) Check the controllability condition for the system. If the system is completely control-
lable then
(b) Determine the characteristic polynomial of the matrix A
1 −an−1 . . . 0 0
44
Control Engineering III Lecture Notes by A. M. Muhia
Example 1.19
Consider the system
where
0 1 0
A= 0 0 1
−1 −5 −6
0
B = 0
The system uses the state feedback control law u (t) = −kx (t). It is desired to have closed
loop poles at
s = −2 ± j4 , s = −10.
Determine the state feedback gain matrix K using transformation matrix T
Solution
Check the system for controllability
h i
M= B AB A2 B
0 0 1
M = 0 1 −6 = −1
1 −6 31
|[sI − A]|
s 0 0 0 1 0
= 0 s 0 − 0 0 1
0 0 s −1 −5 −6
= s3 + 6s2 + 5s + 1
Comparing with
45
Control Engineering III Lecture Notes by A. M. Muhia
s3 + a1 s2 + a2 s + a3
then
a1 = 6, a2 = 5, a3 = 1
h i
K = α3 − a3 α2 − a2 α1 − a1 T −1
h i
K = 199 55 8
In the pole placement design approach, we assumed that all state variables are available for feedback.
In practice, however, not all the state variables are available for feedback. Then we need to estimate
unavailable state variables. A state observer estimates the state variables based on the measurement
of output and control variables
If a state observer estimates all state variables of the system, regardless of whether some state
variables are available for direct measurement, it is called a full order state observer. A necessary
and sufficient condition for observer design is that the system must be completely state observable.
Consider the system
ẋ = Ax + Bu
y = Cx (110)
The state variables can be estimated from the measured output and control variables
where
G-state observer gain matrix
46
Control Engineering III Lecture Notes by A. M. Muhia
ỹ-estimated output
x̃-estimated state variables
For the observer
˜ = Ax̃ + G (y − ỹ) + Bu
ẋ
ỹ = C x̃ (111)
But y = Cx and ỹ = C x̃
Equation (84) becomes
˜ = Ax̃ + GC (x − x̃) + Bu
ẋ (112)
˜ = A [x − x̃] − GC [x − x̃]
ẋ − ẋ
y − ỹ = C [x − x̃] (113)
˜ = ẋand
Taking x − x̃ = x̂ , ẋ − ẋ ˆ y − ỹ = ŷequation (86) becomes
47
Control Engineering III Lecture Notes by A. M. Muhia
ˆ = [A − GC] x̂
ẋ
ŷ = C x̂ (114)
We can choose appropriate Eigen values of [A − GC] to enable placement of poles of the closed
loop system at desired locations
The control design problem is to determine the matrix G;(n ∗ 1) matrix
where
g1
g2
G=
..
.
gn
g3
|sI − (A − GC)| = (s − µ1 ) (s − µ2 ) (s − µ3 )
By equating the coefficients of the powers on both sides of this equation, we can obtain the values
of g1 , g2 and g3
Example 1.20
Consider the system
ẋ = Ax + Bu
y = Cx
Where
" #
0 20.6
A=
1 0
48
Control Engineering III Lecture Notes by A. M. Muhia
" #
0
B=
1
h i
C= 0 1
Design a full order state observer assuming that the desired Eigen values of the observer matrix
are µ1 = −10 µ2 = −10
Solution
Test the system for observability
Observability matrix " # " #
C 0 1
N= =
CA 1 0
|N | = −1
The system is completely state observable and determination of observer gain matrix is possible
Let " #
g1
G=
g2
|sI − (A − GC)| = 0
s −20.6 + g1
= s2 + g2 s − 20.6 + g1 = 0
−1 s + g2
(s − µ1 ) (s − µ2 ) = (s + 10) (s + 10) = 0
s2 + 20s + 100 = 0
49
Control Engineering III Lecture Notes by A. M. Muhia
−1
0 C
CA 0
G = Φ (A)
.. ..
. .
CAn−1 1
Where
Example 1.21
Determine the observer gain matrix for example 1.20 using Ackermann’s formula
Solution
h i
C= 0 1
(s − µ1 ) (s − µ2 ) = (s + 10) (s + 10)
s2 + 20s + 100
50
Control Engineering III Lecture Notes by A. M. Muhia
1. Check the observability condition for the system. If the system is completely observability
then
3. Determine the transformation matrix Q that can transform the system state equation in
controllable canonical form. If the system is already in observable canonical form then Q=I
Else
Q = WN
an−1 an−2 . . . a1 1
an−2 an−3 . . . 1 0
. . . .
W = . . . .
. . . .
a1 1 . . . 0 0
1 −an−1 . . . 0 0
Example 1.21
Determine the observer gain matrix for example 1.20 using the transformation matrix method
51
Control Engineering III Lecture Notes by A. M. Muhia
Solution
Observability has already been tested
" #
0 20.6
A=
1 0
h i
C= 0 1
" #
s −20.6
|sI − A| = = s2 − 20.6
−1 s
(s − µ1 ) (s − µ2 ) = (s + 10) (s + 10) = 0
s2 + 20s + 100 = 0
52