Adaptive Nonlinear Control of Agile Antiair Missiles Using Neural Networks
Adaptive Nonlinear Control of Agile Antiair Missiles Using Neural Networks
Abstract—Research has shown that neural networks can be other concerns have prompted researchers to look beyond
used to improve upon approximate dynamic inversion controllers the classical methods that have historically dominated the
in the case of uncertain nonlinear systems. In one possible ar- field of missile autopilot design and to robust, nonlinear, and
chitecture, the neural network adaptively cancels linearization
errors through on-line learning. Learning may be accomplished “intelligent” control.
by a simple weight update rule derived from Lyapunov theory, Most nonlinear control techniques are based on linearizing
thus assuring the stability of the closed-loop system. In this paper, the equations of motion by the application of nonlinear feed-
the authors discuss the evolution of this methodology and its back. Known variously as feedback linearization or dynamic in-
application in a bank-to-turn autopilot design for an agile antiair version, this method relies heavily on knowledge of the plant
missile. First, a control scheme based on approximate inversion of
the vehicle dynamics is presented. This nonlinear control system is dynamics. An early application of this theory to the missile
then augmented by the addition of a feedforward neural network autopilot design problem is found in [1], while [2] presents a
with on-line learning. Finally, the resulting control law is demon- more sophisticated approach involving variable structure con-
strated in a nonlinear simulation and its performance is evaluated trol. More recently, neural networks have emerged as a means
relative to a conventional gain-scheduled linear autopilot. of explicitly accounting for uncertainties in the plant dynamics.
Index Terms—Nonlinear systems, adaptive control, Lyapunov Their on-line learning and functional approximation capabili-
methods, robustness, neural networks, missiles. ties make neural networks an excellent candidate for this appli-
cation. [3] is one example in which neural networks are investi-
I. INTRODUCTION gated for nonlinear control of missiles.
This paper concerns a neural-network-based approach to di-
A DVANCES in fighter aircraft technology continue to
create new challenges for designers of antiair weapon
systems. The introduction of low-observable aircraft has
rect adaptive control of nonlinear systems which originated in
[4] and was further developed in [5]. In the proposed architec-
ture, a simple dynamic inversion controller approximately lin-
increased demand for small lightweight missiles. This, in
earizes the vehicle dynamics. This controller is augmented by a
turn, has led to various control problems associated with
neural network which acts to improve the linearization by adap-
air-breathing propulsion, asymmetric airframes, and reduced
tively canceling inversion errors in real-time. The neural-net-
aerodynamic control surface area. Similarly, the development
work implementation features a stable on-line learning algo-
of supermaneuverable aircraft has motivated efforts to extend a
rithm derived from Lyapunov theory. While [4] and [5] dealt
missile’s flight envelope into the high angle of attack regime.
specifically with fighter aircraft and helicopter applications, re-
Accordingly, some proposed next-generation missiles employ
spectively, the work described in this paper adapts these pre-
nonaerodynamic control effectors similar to those associated
vious efforts for use in control of agile missiles. The result is an
with super-maneuverable aircraft. These so-called “agile”
autopilot that combines the best features of dynamic inversion,
missiles possess enhanced range because of their ability to
neural networks, and adaptive control to potentially increase the
execute rapid propulsive heading changes during the boost
effectiveness and versatility of tomorrow’s missile systems.
phase. Furthermore, these weapons can be deployed during
The preliminary study presented in [6] revealed that neural
high angle of attack maneuvers and may even engage targets in
networks are indeed capable of attaining sufficiently high
the rear hemisphere relative to the launch aircraft.
learning rates to make adaptation feasible during even the
The dynamics of an agile missile flying in bank-to-turn
most demanding aerial engagements. In fact, previous work
mode at a high angle of attack are inherently nonlinear and
documented in [7] shows that the methodology considered
may vary rapidly with time. Furthermore, these dynamics are
here compares favorably to traditional gain-scheduled linear
highly uncertain since aerodynamic data for vehicles operating
methods for this application.
under such conditions is difficult to obtain and may in fact
This paper begins with a review of the proposed controller
be a poor approximation to the actual dynamics. These and
architecture and its evolution to date. The methodology in ques-
tion is then applied to an agile antiair missile autopilot design
Manuscript received April 22, 1998; revised April 17, 1999. Recommended problem. First, the baseline control scheme consisting of an ap-
by Associate Editor, K. Wise. This work was sponsored by the U.S. Air Force
Research Laboratory Munitions Directorate under Contract F08630-95-1-0006. proximate inversion of the missile’s six-degree-of-freedom non-
M. B. McFarland is with Raytheon Missile Systems Company, Tucson, AZ linear dynamics is presented. Neural networks are then designed
85734 USA. to enhance this nonlinear controller. Simulation results com-
A. J. Calise is with the School of Aerospace Engineering, Georgia Institute
of Technology, Atlanta, GA 30332 USA. paring this technique to a traditional gain-scheduled implemen-
Publisher Item Identifier S 1063-6536(00)05738-9. tation are presented, and the effects of neural-network topology
1063–6536/00$10.00 © 2000 IEEE
750 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 8, NO. 5, SEPTEMBER 2000
(1)
(2) (7)
where denotes a vector of external commands. Note, how-
ever, that is not necessarily an inverting controller. If, for in- where
stance, the plant dynamics include so-called “beneficial” non-
linearities, these terms need not be canceled by the nonlinear (8)
feedback. This is “lean” nonlinear control as described in [9]
with regard to integrator backstepping.
The mapping represents a nonlinear inver-
To construct a stabilizing control for the uncertain nonlinear
sion error. If is known and its inverse is computed accurately,
system in (1), first define the following error variables:
then and the system is ex-
actly linearized. However, since is uncertain, is generally
nonzero and only approximate linearization is possible. Fig. 2
(3) illustrates this approximate dynamic inversion process.
In the ideal case, integrator backstepping can be used to con-
We may use to close the loop on the subsystem, replacing
struct an expression for which stabilizes both errors and
in the in the equation of (1) with the expression for
. When there is nonzero inversion error, this expression may
from (2). Differentiating (3) and substituting then results in the
be augmented by an adaptive term to compensate for this im-
following error dynamics:
perfect inversion. The result is the following expression for the
pseudocontrol :
(4)
(9)
Note that no time-scale separation has been assumed, and
nowhere is it assumed that tracks perfectly. where is the adaptive control contribution to the pseu-
A technique derived from integrator backstepping will now docontrol. The first term in (9) is included to offset coupling
be used to construct the stabilizing controller for the composite between the and dynamics. It has become commonplace
system (1). We first turn our attention to the subsystem. In in applications of this type to reduce such coupling by enforcing
(1), the subsystem may be rewritten as time-scale separation between and . In that case, the first
term in (9) may be neglected. The second term is simply the
“command derivative” term in model-following control, and is
(5) necessary to achieve tracking of arbitrary continuous trajecto-
ries. For slowly varying commands, this term may also be ne-
where is a pseudocontrol input. If the mapping glected. Fig. 3 depicts the adaptive control architecture for the
is invertible and full-state feedback is available, subsystem.
MCFARLAND AND CALISE: ADAPTIVE NONLINEAR CONTROL OF AGILE ANTIAIR MISSILES USING NEURAL NETWORKS 751
B. Neural-Network-Based Adaptation
Fig. 4. Sigma-Pi neural network.
In [4], the adaptive component of (9) is assigned the form
A. Approximate Dynamic Inversion
The equations of motion of a symmetric missile about its ve-
locity vector are as follows:
(10)
(11)
the last two equations in (13) may be rewritten along with (15) where the function refers to the right-hand-side of (14).
as follows: The missile’s body-axis angular rate dynamics must be approx-
imately inverted to determine the required control input. For an
(17) approximate inversion, the body-axis moments are represented
linearly
Here, and are given by (18) and (19) below.
(18)
sec sec (23)
(24)
The autopilot design methodology presented above will now
be applied to the system described by (17) and (14). First,
where is approximated linearly by introducing
body-axis angular rate commands are computed from (2) as
follows:
(20)
and (25)
The gain matrix may be chosen as diagonal with positive
elements. An integral term may also be included in (20), but has
been omitted for simplicity. No adaptive control is necessary at
this stage of the design, since the nonlinear dynamics are suffi- with
ciently well known. Note that (20) makes use of available accel-
eration and velocity information, as well as estimates of angle
of attack and sideslip angle constructed from inertial data. The (26)
accelerometer measurements are filtered and biased appropri-
ately to account for gravitational effects. Note that may be (27)
inverted, since it is nonsingular except when , which
should not occur in bank-to-turn flight. (28)
Next, a first-order filter is applied to the guidance commands
, and . Its outputs are the filtered commands and their
Performing the approximate dynamic inversion, the control
rates.
input is then given by (29)
(21) (29)
(30)
(22)
MCFARLAND AND CALISE: ADAPTIVE NONLINEAR CONTROL OF AGILE ANTIAIR MISSILES USING NEURAL NETWORKS 753
(31)
Fig. 12. Yaw RCS thrust. Fig. 15. Yaw inversion error comparison.
Fig. 13. Roll RCS thrust. Fig. 16. Roll inversion error comparison.
IV. CONCLUSIONS
A nonlinear bank-to-turn missile autopilot based on approx-
imate dynamic inversion has been proposed. With the aid of
an adaptive neural network, this autopilot tracks guidance com-
mands in angle of attack and bank angle while holding sideslip
angle near zero. A similar development could be carried out for
the skid-to-turn case by replacing the bank angle state with
roll angle and maintaining .
Nonlinear 6-DOF simulation results indicate that the perfor-
mance of the neural-adaptive nonlinear autopilot is comparable
to that of an existing gain-scheduled autopilot. One advantage
of the neural-network-based approach is that it eliminates the
Fig. 14. Pitch inversion error comparison. time-consuming process of designing a different autopilot at
each of numerous flight conditions. Additionally, the use of
basis functions is one way to improve the performance of the neural networks enables the nonlinear controller to effectively
roll network. This was demonstrated using a single hidden-layer adapt on-line to uncertain nonlinear aerodynamic phenomena,
756 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 8, NO. 5, SEPTEMBER 2000
which are difficult to model for purposes of design and simula- [10] K. A. Wise and D. J. Broy, “Agile missile dynamics and control,” in
tion. Proc. AIAA Guidance Navigation Contr. Conf., San Diego, CA, 1996,
paper AIAA-96-3912.
Neural-network-based adaptive control of nonlinear systems [11] M. B. McFarland and A. J. Calise, “Robust adaptive control of non-
is a maturing technology area which promises to be applicable linear systems using neural networks,” in Proc. Amer. Contr. Conf., Al-
to a wide range of systems. The favorable results described here buquerque, NM, 1997, pp. 1996–2000.
[12] , “Multilayer neural networks and adaptive nonlinear control of
have already led to more advanced research, including modi- agile anti-air missiles,” in Proc. AIAA Guidance Navigation Contr.
fications for robustness to input unmodeled dynamics, which Conf., New Orleans, LA, 1997.
are the subject of [11]. The approach has also been extended [13] R. T. Rysdyk, F. Nardi, and A. J. Calise, “Robust adaptive nonlinear
flight control applications using neural networks,” in Proc. Amer. Contr.
to accommodate an important class of neural networks with Conf., CA, 1999, pp. 2595–2599.
one hidden layer as described in [12]. These multilayer feed-
forward networks feature improved approximation capabilities
over their single-layer counterparts, but at the price of nonlin-
Michael B. McFarland (S’94–A’97–M’99) re-
earity in their adjustable parameters. Additional detail regarding ceived the B.S.E. degree in aerospace engineering
robust redesign and nonlinear network parameterizations may (with high honors) from the University of Florida,
also be found in [8]. Moreover, the problem of simultaneous Gainesville, in 1991, and the M.S. degree in hybrid
algorithms for optimal aeroassisted orbit transfer
nonlinear parameterization and robustness to input unmodeled guidance and the Ph.D. degree in adaptive nonlinear
dynamics has been treated in [13]. Each of these advancements control of missiles using neural networks, both
represents another step toward the creation of a design technique from the School of Aerospace Engineering, Georgia
Institute of Technology, Atlanta, in 1992 and 1997,
powerful enough for tomorrow’s demanding flight control ap- respectively.
plications. From 1991 to 1999, he was a Research Aerospace
Engineer with the Air Force Research Laboratory Munitions Directorate
(AFRL/MN), Eglin Air Force Base. He is a Senior Systems Engineer with
REFERENCES Raytheon Missile Systems Company, Tucson, AZ. His research interests
[1] M. Tahk, M. Briggs, and P. K. A. Menon, “Application of plant inver- include applications of nonlinear and adaptive control, as well as neural
sion via state feedback to missile autopilot design,” in Proc. IEEE Conf. networks.
Decision Contr., Austin, TX, 1986, pp. 730–735.
[2] M. Innocenti and A. Thukral, “Simultaneous reaction jet and aerody-
namic control of missile systems,” in Proc. AIAA Guidance Navigation
Contr. Conf., Monterey, CA, 1993, pp. 347–354. Anthony J. Calise (M’72) received the B.S. degree
[3] D. M. McDowell, G. W. Irwin, and G. McConnell, “Online neural con- from Villanova University, Philadelphia, PA, in 1964,
trol applied to a bank-to-turn missile autopilot,” in Proc. AIAA Guidance and the M.S. and Ph.D. degrees from the University
Navigation Contr. Conf., Baltimore, MD, 1995, pp. 1286–1294. of Pennsylvania, Philadelphia, in 1966 and 1968, re-
[4] B. S. Kim and A. J. Calise, “Nonlinear flight control using neural net- spectively, all in electrical engineering.
works,” AIAA J., vol. 20, pp. 26–33, Jan.–Feb. 1997. He was a Professor of Mechanical Engineering at
[5] J. Leitner, A. J. Calise, and J. V. R. Prasad, “Analysis of adaptive neural Drexel University, Philadelphia, for eight years. He
networks for helicopter flight controls,” AIAA J., vol. 20, pp. 972–979, also worked in industry for ten years at Raytheon
Sept.–Oct. 1997. Missile Systems Company, Tucson, AZ, where he
[6] M. B. McFarland and A. J. Calise, “Neural networks for stable adap- was involved with analysis and design of inertial
tive control of air-to-air missiles,” in Proc. AIAA Guidance, Navigation navigation systems, optimal missile guidance, and
Contr. Conf., Baltimore, MD, 1995, pp. 1280–1285. aircraft flight path optimization. He is currently with the School of Aerospace
[7] , “Neural-adaptive nonlinear autopilot design for an agile anti-air Engineering, Georgia Institute of Technology, Atlanta. His research intrests
missile,” presented at the AIAA Guidance Navigation Contr. Conf., San include optimal control theory, aircraft flight control, optimal guidance of
Diego, CA, 1996, paper AIAA-96-3914. aerospace vehicles, adaptive control using neural networks, robust linear
[8] M. B. McFarland, “Adaptive nonlinear control of missiles,” Ph.D. dis- control, and control of flexible structures.
sertation, Georgia Inst. Technol., Atlanta, GA, 1997. Dr. Calise received the USAF Systems Command Technical Achievement
[9] M. Krstic, I. Kanellakopoulos, and P. Kokotovic, Nonlinear and Adap- Award and the AIAA Mechanics and Control of Flight Award. He is a Fellow
tive Control Design. New York: Wiley, 1995. of the AIAA.