J Automatica 2006 02 013
J Automatica 2006 02 013
www.elsevier.com/locate/automatica
Brief paper
Tracking control for multi-agent consensus with an active leader
and variable topology夡
Yiguang Hong a,∗ , Jiangping Hu a , Linxin Gao b
a Key Laboratory of Systems and Control, Institute of Systems Science, Chinese Academy of Sciences, Beijing 100080, China
b Institute of Systems Science, Wenzhou University, Zhejiang, China
Received 16 March 2005; received in revised form 4 November 2005; accepted 16 February 2006
Available online 17 April 2006
Abstract
In this paper, we consider a multi-agent consensus problem with an active leader and variable interconnection topology. The state of the
considered leader not only keeps changing but also may not be measured. To track such a leader, a neighbor-based local controller together
with a neighbor-based state-estimation rule is given for each autonomous agent. Then we prove that, with the proposed control scheme, each
agent can follow the leader if the (acceleration) input of the active leader is known, and the tracking error is estimated if the input of the leader
is unknown.
䉷 2006 Elsevier Ltd. All rights reserved.
2. Problem formulation Meanwhile, the connection weight between agent i and the
leader, denoted by bi , is time-varying, too. We assume that there
To solve coordination problems, graph theory is helpful. An are fixed positive constants i (i = 1, . . . , n) such that
undirected graph G on vertex set V = {1, 2, . . . , n} contains
V and a set of unordered pairs E = {(i, j ) : i, j ∈ V}, which i if agent i is connected to the leader at t,
bi (t) = (3)
are called G’s edges. If there is an edge between two vertices, 0 otherwise.
the two vertices are called adjacent. A graph is simple if it
has no self-loops or repeated edges. If there is a path between The next lemma was given to check the positive definiteness of
any two vertices of a graph G, then G is connected, otherwise a matrix (Horn & Johnson, 1985).
disconnected. A subgraph X of G is an induced subgraph if
two vertices of V(X) are adjacent in X if and only if they are Lemma 1. Suppose that a symmetric matrix is partitioned as
adjacent in G. An induced subgraph X of G that is maximal,
E 1 E2
subject to being connected, is called a component of G. E= ,
Here, we consider a system consisting of n agents and a E2T E3
leader. In the sequel, the state of agent i is denoted by xi for
where E1 and E3 are square. E is positive definite if and only
i=1, . . . , n. With regarding the n agents as the vertices in V, the
if both E1 and E3 − E2T E1−1 E2 are positive definite.
relationships between n agents can be conveniently described
by a simple and undirected graph G, which is defined so that
The following result is well-known in algebraic graph theory
(i, j ) defines one of the graph’s edges in case agents i and j are
(Godsil & Royle, 2001) and establishes a direct relationship
neighbors. Ni (t) denotes the set of labels of those agents which
between the graph connectivity and its Laplacian.
are neighbors of agent i (i = 1, . . . , n) at time t. The weighted
adjacency matrix of G is denoted by A = [aij ] ∈ R n×n , where
Lemma 2. Let G be a graph on n vertices with Laplacian
aii =0 and aij =aj i 0 (aij > 0 if there is an edge between agent
L. Denote the eigenvalues of L by 1 (L), . . . , n (L) satisfying
i and agent j). Its degree matrix D = diag{d1 , . . . , dn }∈ R n×n
1 (L) · · · n (L). Then 1 (L) = 0 and 1 = [1, 1, . . . , 1]T ∈
is a diagonal matrix, where diagonal elements di = nj=1 aij
R n is its eigenvector. Moreover, if G is connected, 2 > 0.
for i = 1, . . . , n. Then the Laplacian of the weighted graph is
defined as
In this paper, all the considered agents move in a plane:
L = D − A, (1)
ẋi = ui ∈ R 2 , i = 1, . . . , n, (4)
which is symmetric. In what follows, we mainly concern a
graph Ḡ associated with the system consisting of n agents and where ui is the control input. The leader of this consid-
one leader. In fact, Ḡ contains n agents (related to graph G) and ered multi-agent system is active; that is, its state variables
the leader with directed edges from some agents to the leader. keep changing. Its underlying dynamics can be expressed as
By “the graph, Ḡ, of this system is connected”, we mean that follows:
at least one agent in each component of G is connected to the ⎧
leader. ⎨ ẋ0 = v0 ,
v̇ = a(t) = a0 (t) + (t), x0 , v0 , ∈ R 2 , (5)
For the multi-agent system under consideration, the rela- ⎩ 0
tionships between neighbors (and the interconnection topol- y = x0 ,
ogy) change over time. Suppose that there is an infinite se-
quence of bounded, non-overlapping, contiguous time-intervals where y(t) = x0 (t) is the measured output and a(t) is the (ac-
[ti , ti+1 ), i = 0, 1, . . . , starting at t0 = 0. celeration) input. Note that (5) is completely different from
Denote S = {Ḡ1 , Ḡ2 , . . . , ḠN } as a set of the graphs with the agent dynamics (4). In other words, the agents will track a
all possible topologies, which includes all possible intercon- leader with a different dynamics.
nection graphs (involving n agents and a leader), and denote In our problem formulation, the input a(t) may not be com-
P = {1, 2, . . . , N} as its index set. pletely known. We assume that a0 (t) is known and (t) is
To describe the variable interconnection topology, we de- unknown but bounded with a given upper bound ¯ (that is,
¯ The input a(t) is known if and only if ¯ = 0. On
(t) ).
fine a switching signal : [0, ∞) → P, which is piecewise-
constant. Therefore, Ni and the connection weight aij (i = the other hand, y = x0 is the only variable that can be obtained
1, . . . , n, j = 1, . . . , n) are time-varying, and moreover, Lapla- directly by the agents when they are connected to the leader.
cian Lp (p ∈ P) associated with the switching interconnec- Our aim here is to propose a decentralized control scheme for
tion graph is also time-varying (switched at ti , i = 0, 1, . . .), each agent to follow the leader (i.e., xi → x0 ).
though it is a time-invariant matrix in any interval [ti , ti+1 ). In Since v0 (t) cannot be measured even when the agents are
our problem, we assume that there are fixed positive constants connected to the leader, its value cannot be used in the control
ij (i = 1, . . . , n; j = 1, . . . , n) such that design. Instead, we have to estimate v0 during the evolution.
Note that, each agent has to estimate v0 only by the informa-
= j i if agents i and j are connected at t, tion obtained from its neighbors in a decentralized way. The
aij (t) = ij (2)
0 otherwise. estimate of v0 (t) by agent i is denoted by vi (t) (i = 1, . . . , n).
Y. Hong et al. / Automatica 42 (2006) 1177 – 1182 1179
Therefore, for each agent, the local control scheme consists of follows:
two parts:
0
˙ = F + g, g= (9)
−1 ⊗
• a neighbor-based feedback law:
⎡ ⎤ where
ui = − k ⎣ aij (t)(xi − xj ) + bi (t)(xi − x0 )⎦ x̄ −k(L + B ) In
= , F = ⊗ I2 .
j ∈Ni (t) v̄ −k(L + B ) 0
+ vi , k > 0, i = 1, . . . , n, (6) 3. Main results
where Ni is the set consisting of agent i’s neighbor agents;
• a dynamic neighbor-based system to estimate v0 In this section, the convergence analysis of system (9) is
⎡ given for the consensus problem of multi-agent system (8). If
the information of the input a(t) can be used in local control
v̇i = a0 − k ⎣ aij (t)(xi − xj ) + bi (t) design, we can prove that all the agents can follow the leader,
j ∈Ni (t) though the leader keeps changing. If not, we can also get some
⎤ estimation of the tracking error. We first assume that the in-
terconnection graph Ḡ is always connected, though the inter-
× (xi − x0 )⎦ , i = 1, . . . , n, (7) connection topology keeps changing; and then we consider an
extended case.
for some positive constant < 1. In fact, (7), can be viewed As mentioned above, Ḡ is connected if at least one agent
as an “observer” in some sense. in each of its component is connected with the leader. To be
specific, if there are m 1 components, then the Laplacian Lp
Note that ui in (6) is a local controller of agent i, which only (for any p ∈ P) of the graph associated with n agents have m
depends on the information from its neighbors, and, in fact, zero eigenvalues. For simplicity, we can rearrange the indices
when v0 = 0, a = 0, the proposed control law (6) is consis- of n agents such that Lp can be rewritten as a block diagonal
tent with the one given by Olfati-Saber and Murray (2004). In matrix:
⎛ 1 ⎞
addition, with the neighbor-based estimation rule in a form of Lp
observer (7) to estimate the leader’s velocity, each agent re- ⎜ L2p ⎟
⎜ ⎟
lies only on the locally available information at every moment. Lp = ⎜ . ⎟,
⎝ .. ⎠
In other words, each agent cannot “observe” or “estimate” the
m
Lp
leader directly based on the measured information of the leader
if it is not connected to the leader. In fact, it has to collect the
where each block matrix Lip is also a Laplacian of the corre-
information of the leader in a distributed way from its neighbor
sponding component. For convenience, denote Mp = Lp + Bp ,
agents.
where Lp is the weighted Laplacian and Bp (p ∈ P) is the di-
Take
agonal matrix as defined in Section 2. The next lemma is given
⎛ ⎞ ⎛ ⎞ ⎛ ⎞
x1 v1 u1 for Mp .
. . .
x = ⎝ .. ⎠ , v = ⎝ .. ⎠ , u = ⎝ .. ⎠ .
Lemma 3. If graph Ḡp is connected, then the symmetric matrix
xn vn un
Mp associated with Ḡp is positive definite.
Regarding the switching interconnection graphs, the closed-
loop system can be expressed as Proof. We only need to prove the case when m = 1. Let
1 , . . . , n be the eigenvalues of Laplacian Lp in the increas-
ẋ = u = −k(L + B ) ⊗ I2 x + kB 1 ⊗ x0 + v, ing order. From Lemma 2, 1 = 0 and i > 0, i 2. Denote n
(8)
v̇ = 1 ⊗ a0 − k(L + B ) ⊗ I2 x + k(B 1) ⊗ x0 , eigenvectors of Lp by i , i = 1, . . . , n, with 1 = 1, an eigen-
vector of Lp corresponding to 1 = 0. Then any nonzero vector
where Il ∈ R l×l (for any positive integer l) is the identity z ∈ R n can be expressed by z = ni=1 ci i for some constants
matrix and ⊗ denotes the Kronecker product, : [0, ∞) → ci , i = 1, 2, . . . , n. Moreover, Bp = 0 since there is at least
P={1, 2, . . . , N} is a piecewise-constant switching signal with one agent connected to the leader. Without loss of generality,
successive switching times, B is an n × n diagonal matrix we assume bj > 0 for some j, and it is obvious T1 Bp 1 bj .
whose ith diagonal element is bi (t) at time t, L is the Lapla- Therefore, in either the case when c2 = · · · = cn = 0 (so c1 = 0)
cian for the n agents. Note that, even in the case when the in- or the case when ci = 0 for some i 2, we always have
terconnection graph is connected, bi (t) may be always 0 for
n
some i, and therefore, B may not be of full rank.
Denote x̄ = x − 1 ⊗ x0 and v̄ = v − 1 ⊗ v0 . Because z T M p z = z T Lp z + z T Bp z i ci2 Ti i + zT Bp z > 0
−k(L + B ) ⊗ I2 x + kB 1 ⊗ x0 = −k(L + B ) ⊗ I2 x̄ (in- i=2
voking Lemma 2), we can obtain an error dynamics of (8) as for z = 0, which implies the conclusion.
1180 Y. Hong et al. / Automatica 42 (2006) 1177 – 1182
Based on Lemma 3 and the fact that the set P is finite, in the following forms:
¯ Thus, with t0 = 0,
− T Qp + 2(1 + ), (15)
(1 + )2 ¯
2
−t
where V ((t)) V ((0))e + (1 − e−t ), (19)
(1 − )2
2k(1 − 2 )M p −In
Qp = −(FpT P + P F p ) = ⊗ I2 (16) ¯ Fur-
−In 2In which implies (12) with taking C = ((1 + )/(1 − )).
¯
thermore, if = 0, then (13) is obtained.
is a positive definite matrix because 2I − (1/2k(1 − 2 ))Mp−1
and Mp are positive definite (by virtue of (11), Lemmas 1 Next, we consider an extended case: the interconnection
and 3). graph is not always connected. Let T > 0 be a (sufficient
Let i,j , i=1, . . . , n, j =1, 2 denote the (at most) 2n different large) constant, and then we have a sequence of interval
eigenvalues of Qp though Qp ∈ R 4n×4n defined in (16). Based [Tj , Tj +1 ), j = 0, 1, . . . with T0 = t0 , Tj +1 = Tj + T . Each
on i (Mp ), the eigenvalues of Mp , we have the 2n eigenvalues interval [Tj , Tj +1 ) consists of a number of intervals (still
Y. Hong et al. / Automatica 42 (2006) 1177 – 1182 1181