An Algorithm to Track Multiple Targets
An Algorithm to Track Multiple Targets
Abstmd-An algorithm for tracking mulliple targets in a cluttered algorithms. Clustering is the process of dividing the entire
set of targets and measurements into independent groups
environment is developed. ”le algorithm is capable of initiating tracks,
~ceountlng for false or missing reports, and processing sets of dependent
(orclusters). Instead of solving one largeproblem, a
reports As e a& measwement is received, probabilities are calculated for
number of smallerproblems are solved in parallel. Fi-
the hypolheses that the measurement came from previously known targ&
nally, it is desirable for an algorithm to be recursive so
in a target file, or from a new target, or that the measurement is false.
Target states areestimated from each such data-association h y p o W ithat all the previous data do not have to be reprocessed
wing a galma0 filter. As more measuTements are received, the p rowhenever a new data set is received.
ba
bi li-
ties ofjotnt hypotheses are calculated recnrsively using all availableThe algorithm can use measurements from two differ-
information swh as density of nnkoown t a r g e density of false targets,
ent generic types of sensors. The first type is capable of
probability of detection, and location uncertainty. ’Ibis branching tech-
nique allows correlation of ameasurement with its source based on sending information which can be used to infer the num-
ber of targets within the area of coverage of the sensor.
snbseqnent, as well as previons, data. To keep the number of hypoUleses
reawnable, unlikely hypotheses are eliminated and hypotheses with similar
Radar is an example of this type of sensor. This type of
target estimates are oombined.To 8 compocational requirements,
sensorgenerates a data setconsisting of oneormore
the entire set of targets and measurements is divided into clusters that are
reports, and no target can originate more than one report
solved independently. In an illustrative example of ahcraft bacldng, the
algorithm successfully hacks targets over a wide range of conditions. per data set. (The terms “data set” and “scan” are used
interchangeably in this paper to mean a set of measure-
ments at the same time. It is not necessary that they come
INTRODUCTION
I.
from a sensor that scans.) The second type of sensor does
HE SUBJECT of multitarget tracking has application not contain this “number-of-targets” type of information.
T in both military and civilian areas. For instance, ap- A radar detector, for example, would not detect a target
plication areas include ballistic missile defense (reentry unless the target’s radar were on. In this case, very little
vehicles), air defense (enemy aircraft), air traffic control can be implied about a target’s existence or nonexistence
(civil air traffic), ocean surveillance(surfaceships and by the fact that the target is not detected. Also, for the
submarines), and battlefield surveillance (ground vehicles second type of sensor, individual reports are transmitted
and military units). The foremost difficulty in the applica- and processed one at a time, instead of in a data set. The
tion of multiple-target tracking involves the problem of multiple-target tracking algorithm developed
here
associatingmeasurements with the appropriate tracks, accounts for these factors by using the detection and
especially when there are missing reports (probability of false-alarm statistics of the sensors, the expected density
detection less than unity), unknown targets (requiring of unknown targets, and the accuracy of the target esti-
track initiation), and false reports (from clutter). The key mates.
development of this paper is a method for calculating the A number of complicating factors not considered in this
probabilities of various data-association hypotheses. With paper include nonlinear measurements, nonlinear dy-
thisdevelopment,thesynthesis of anumber of other namics, maneuvering targets (abrupt and unknown
features becomes possible. change in target dynamics), requirement for an adaptive
In addition to the above data-association capabilities, algorithm (to account for unknown statistics),
some
the algorithm developed in this paper contains the desir- aspects of multiple sensors (problems of sensor configura-
able features of multiple-scan correlation, clustering, and tions, registration, and different types of information),
recursiveness.Multiple-scan correlation is the capability and time-delayed or out-of-sequence measurements. The
to use later measurements to aid in prior correlations first four factors have already been investigatedexten-
(associations) of measurements with targets. This feature sively in the single-target case,and donot aid in illuminat-
is usually found in batch-processing or track-splitting ing the multiple-target problem. The inclusion of the last
two factors would greatly increase the scope of this paper.
Manuscript received April25, 1978;revised June21,1979.Paper
In addition, the real-world constraints involved in imple-
recommended by J. L. Speyer, Chairman of theStochasticControl menting this algorithm are not explicitly considered.
Committee. This work was supported by theLockheed“Automatic
Multisensor/Multisouce Data Correlation”IndependentDevelopment References [l]-[S] are the basic reference papers that
Program. illustrate previouslyknown techniques for solving the
The author is with the Lockheed Palo Alto Research Laboratory, Palo
Alto, CA 94304. multiple-target tracking problem. The scope of each of
where
z(k)=Hx(k)+u(k)
t
(2)
z
I
1
Receive New Data Set
Perform
Target
Time
Update
CLUSTR
I
+
simplifyhypothesismatrix
ofeachcluster.Transfer
blASH
i
( stop )
Fig. 1. Flow diagram of multipletarget tracking algorithm.
When a measurement is received, the conditional mean f
and covariance are given by the following “measure-
ment update” equations: 111. HYPOTHESISGENERATIONTECHNIQUE
The basic approach used in this paper is to generate a
f(k)=F(k)+K[z(k)-HF(k)]
set of data-association hypotheses to account for all possi-
ble origins of every measurement. The filter in this paper
~(k)=P-PHT(HPH=+R)-’HP
generates measurement-oriented hypotheses, in contrast to
K = . P ~ H ~- I R
. (4) target-oriented hypotheses developed in [2] and [3]. In the
target-oriented approach, everypossible measurement is
listed for each target and vice versa for the measurement-
oriented approach. Although both approaches are equiv-
alent, a simpler representation is possible with the target-
A flow diagram of the tracking algorithm is shown in
oriented approach if there is no requirement for track
Fig. 1. Most of the processingis done within the four
initiation. However,with a track initiation requirement,
subroutines showninthefigure. The CLUSTR subroutine
the measurement-oriented approachappears simpler.
associates measurements with previous clusters. If two or
more previously independent clusters are associated be- -
Let ~ ( ke){ ~ , ( k ) ,m = 1,2, . ,Mk} denote the set of
cause of a measurement, then the two clusters are com- measurements in data set k ; Z k { Z(l),Z(2); ,Z(k)} -
bined into a “super cluster.” A new cluster is formed for denote the cumulative set of measurements up through
any measurement not associated with a prior cluster. As data set k ; Qk {Q;,i = 1,2, -
,Ik}denote the set of all
part of the initialization program, previously known hypotheses at the time of data set k which associate the
targets form their own individual clusters. cumulative set of measurements Z kwith targets or clutter;
The HYPGEN subroutine forms new data-association hy- and am
denote the set of hypotheses after the mth
potheses for the set of measurements associated with each measurement of a data set has been processed. As a new
cluster. The probability of each such hypothesis is calcu- set of measurements Z ( k + 1) is received, a newset of
lated and target estimates are updated for each hypothesis hypotheses Q“+’is formed as follows: Go is initialized by
of each cluster. setting Do= Ok. A new set of hypotheses is repetitively a‘‘‘
Both the CLUSTR and HYPGEN subroutines use the RE- formed for each prior hypothesis and each measure-
DUCE subroutine for eliminating unlikelyhypotheses or ment Z,(k+ 1). Each hypothesis in thisnew set is the
combining hypotheses with similar target estimates. Once joint hypothesis that is true and that measurement
the set of hypothesesissimplifiedby this procedure, Z,(k+ 1) came from target j . The values which j may
uniquely associated measurements areeliminated from the assume are 0 (to denote that the measurement is a false
hypothesismatrixby the MASH subroutine. Tentative alarm), the value ofany prior target, or a value one
targets become confirmed targets if they were the unique greater than the current number of tentative targets (to
origin of the eliminated measurement. denote that the measurement originated from a new
846 IEE TRANSACTIONS ON AUTOMATIC C O ~ O LVOL.
, AC-24,NO. 6,DECEMBER1979
QMk+l is formed. A
- Target
Measurements
the target estimate for the prior hypothesis a:, then the 1
3
0
0
2
2
0 4 2
covariance of v = 2, - HT is given by 1 4 2
3 4 2
0 0 5
B- H F H ~R+ (5) 1
2 0
0 5
5
3 0 5
0 2 5
and the measurement Z , lies within an “rpsigma” valida- 1 2 5
3 2 5
tion region if 0 4 5
1 4 5
2 4 5
3 4 5
(Zm-HF)rB-’(Zm-H5?)<q2. (6)
Hywthesls m t r w
In computer
targets. The number of possible assignments is given by either multiplying the prior probability by either Pn, PNT,
or PDN(Zm- HZ,B ) / ( 1 - P D ) as appropriate. After all
such branches are generated the likelihoods are then nor-
malized.
The probability of an assignment for a given configura- Concurrently with the above calculations, a calculation
tion is therefore of P N T , the density of new (i.e., unknown) targets, is
performed whenever a data set from a type 1 sensor is
received. The density of new targets PNT depends upon
the number of times the area has been observed by a type
1 sensor and the possible flux of undetected targets into
Combining these last three equations and simplifying, and out of the area.
we find that the probability of The development of this paper has implicitly assumed
that the probability distribution of the target state would
begivenby or approximated by a normal distribution
after one measurement. If the measurement vector con-
tains all the target state variables, then the initial state and
covariance of a target are given by x = Z,,, and P = R .
However, in general this will not be true but the normal
distribution assumption might nevertheless be made. For
Substituting this and (9) into (8), we find that example, if the target state is position and velocity and
only position is given in the measurement, then the veloc-
ity might be assumed to be normally distributed with zero
mean and a standard deviation equal to one-third the
maximum velocity of the target.
If the measurements or other factors are such that the
assumption of a normal distribution after one measure-
ment is not a good assumption, then appropriate modifi-
cations would have to be made to the gate criterion, the
hypothesis probability calculations and the Kalman filter
where for ease of notation the measurements have been
equations. As an example, consider the case where N
reordered so that the first NDT measurements correspond
targets on a plane surface, generate two sets of line-of-
to measurements from prior targets. Substituting for the
bearing (LOB) reports each containing exactly N LOB's
Poissonprocesses, the dependence on V is eliminated!
(i.e., PD = 1, @=O,.) The LOB's intersect in N 2 points,
Simplifying and combining constants into c, we finally
corresponding to the N real targets and N 2 - N "ghosts."
have
Since all the statistical degrees-of-freedom in the measure-
ments are necessary just to determine location, there are
no additional degrees-of-freedom remaining for correlat-
ing one LOB with another. Therefore, in this case, there is
no gate criterion for the second data set and each of the
N~ pairs are equally likely.
B. Multiple-Scan A Igorithms
FORMATION
VI. CLUSTER
K SCAN
NUhiBER This is one case in which later data did not help resolve a
A i~1EASUREMEM
0 :
ERRORELLIPSE
prior data-association hypothesis; in fact, the ambiguity
-L PROJECTED LOCATION was increased. At k = 5, the data-association hypotheses at
ESTlhlATED LOCATION k = 4 are the most significant and are preserved. (If the
N = 1 scan filter criterion was used, the hypotheses at
k = 4 would have been eliminated.) By the time measure-
Y ments at k =6 are processed, the difference in the hy-
I J I 83%probability of 1 taraet
(bl 898 probability of 1 o r 2 tarqets
potheses at k = 4 is no longer important since the target
IC)948 probability of 1 o r more tarqets estimates are now so similar. From then on, we have two
1111 99% orobabilihr of 1 or more taraets (8mthat all 4 measurements e separate track maintenance problems.
from'same tar'qet: 4% that first meas. I S false an+ last 7 are from
same tarqetl
fel 1 W probability that tarqet exists 19896 that last meas. .came from
target: 1% that last meas. came from new taraet: 1% that last meas.
came from false target) C. HighTargetDensity
I I I I
1 2 3 4 5 6 The last example illustrates the difficulty of associating
X
measurements into tracks for a more complicated arrange-
Fig. 3. Example of track initiation.
ment of measurements. This example is a single run from
"-7 I
the Monte Carlo program described in the next section. In
K = SCAN NUhlBER this example there are five real targets; the existence of
PROBABILI~ = INITIALLY KNOWN
TARGET four of them is initially known by the filter. The a priori
location and velocity estimates of these four targets as
PROJECTED LOCATION
= ESTIMATEDLOCATION
well as measurements from the first six scans are shown in
Fig. 5. Both the measurement noise and the process noise
are relatively large (4=r =0.40). Thedata points are
shown grouped according to the maximum likelihood data
EPARATE CLUSTERS SEPARATE
association hypotheses (except as noted below). In addi-
tion, there are approximately 15 other feasible groupings
of targets that are also possible arrangements. As
measurements are processed, the probabilities of these
different groupings change. For example, at scan 4 the
most
likely hypothesis is that measurement 19 is
associated with target 1 and measurement 18 is associated .
ONE SUPERCLUSTER with target 2; however, on scan 5 and subsequent scans,
another hypothesis becomes the most likely and reverses
= 6 PROBABILITY TiiAT MEASUREMENTCAhlE FROM
PRIOR TARGET this assignment. The one target unknown by the filter is
1 I I I
I I
being formed by measurements 2, 8, and 14. Even at scan
0 1 2 3 4 5 6 7
X 4 when there is only one measurement for either target 3
or the new target, the most likely hypothesis is that
Fig. 4. Example of crossing tracks. measurements 2, 8, and 14 are a new target and measure-
ments 5, 10,16, and 20 are from target 3. At scan 5,
collision is due to the fact that one of the hypotheses in however, the most likely hypothesis is that measurements
the top cluster is that the top measurement at k = 1 was 2, 10, and 14 (as well as 23) are false, and that measure-
from a target, but the next measurement was from clutter. ments 5, 8, 16, and 20 are associated with target 3. At scan
Since we assumed an initial variance in velocity of 1.0, the 6 the likelihood that measurements 2, 8, 14, 23, and 30
above target could have originated the measurement at form a new target is increased and by scan 7 it is part of
(3.2,2.9). After the measurements are processed, however, the most likely hypothesis. This target does not become a
thispossibilityis so remote that it is eliminated. After confirmed target until scan 9. In each case, the general
eliminating all the other negligible hypotheses at k = 3, the grouping of measurements corresponds to one of the
supercluster is separated into two clusters, corresponding actual targets.
to the two targets. To process the two measurements at
k=4, the supercluster has to be formed again. At this
time, the tentative target in the top of the figure becomes VIII. MONTECARLOSIMULATION
a confirmed target. Two hypotheses remain after process-
ing the measurements atk=4; that the lower target The independent factors affecting filter performance
originated the lower measurement and the higher target include both filter characteristics (e.g., the filter criteria
originated thehigher measurement ( p l =60 percent) or for eliminating or combining hypotheses) and environ-
vice versa (p,=40 percent). The measurements at k = 5 mental variables, such as target density Pn, measurement
are such that they reduce the difference in probabilities of accuracy R, target perturbances Q , false report densities
these two hypotheses (to p , = 54 percent, p z = 46 percent). fin, and data rate T, Pn.
852 IBEB 'fRANSAClTONS ON AuToMAnC CONTROL, VOL AC-24,NO. 6, DECEMBER 1979
12
1
a
6
_/--- --
The probability or ease of making correct associations associating a target with a measurement, and the probabil-
between targets and measurements appears to be a key ities of associating a target with a measurement correctly
factor in determining filter performance. As such, the and incorrectly, as the density-variance product increases.
primary effect of many of the environmental variables These curves may be viewed as the association probabili-
mentioned above is in affecting this factor. -The more ties of an N = 0 scan filter in processing one scan of target
dense the targets and measurements or the larger the information when the filter knows the number of true
uncertainty in their locations, the more dfficult it is to targets and their prior locations from the previous scan,
make the correct associations. The variables PIT, Dm, and and usesthefollowing association rules: a target is
PD determine the density of measurements according to associated with the closest measurement within its valida-
tion region; if no measurements are within validation
PM PIT + p D @ T T (20) region (or such a measurement isassigned to another
target), then no measurement is associated with the target.
and the variancebetween measurements and eliminated
The curves do not reflect the performance of any filter
target locations (just before an association is to be made)
over more than one scan.
is given by
The curves in Fig. 6 were generated for the case where a
02=F11+r. (21) proportion PD =0.9 of the true targets generated a
measurement, the relative density of true targets to false
If we make the approximation that p,,reaches its steady- measurements was 5 / 1, and the target gate size was 9 = 3.
state value as givenbysolving the Kalman filter equa- Since only 90 percent of targets generated measurements,
tions, then pl, can be related to q, r , and T. Po also the probability of correctly associating a target with a
affects PI, by affecting the average time between measure- measurement is no greater than 90 percent. As the den-
ments. In addition, the actual value of Fll wouldbe sity-variance product increases, this probability decreases.
affected by combining hypotheses so that the relationship Anevenworse condition is the related increase in the
between Fll and q, r , and T mustbe considered an probability of incorrectly associating a target and a
approximation. measurement. Incorrect association can have a cascading
An indication of the increasing difficulty of association effect on tracking algorithms which do not account for it.
withincreasing target and measurement densities and The probability a target is not associated with any
uncertainties isgivenby the association probabilities measurement is initially 10 percent for this set of condi-
shown in Fig. 6. The figure shows the probability of not tions and also decreases with increasing density-variance.
REID: ALGORITHM FOR TRACKPIG MULTIPLE TARGETS 853
_ = 0.2 -
'ercen 'ercenl
c-
PROBABILITY OF Brr $umber of orma lized
Case 'argets False
0.8
ASSOCIATION ,, 3.0 lyrmthese!
- -
'racked Brgets
-Error
q = r = O . l Z , 0 =0.5
P = Pnl" 2 IP = 0.03)
4.40 75.4 7.0 L W
q.r.0.12, a =0.01
1 6 41 89. 1 7.7 L 055
Fig. 6. T h e probability of correct and incorrect data association versus w = a1)
measurement densityX variance. q = r = a 4 , a =0.1
7.90 85.2 11.8 1.071
IP = 0. 11
q = r = 0 . 4 . a =0.5
A number of Monte Carlo runs were made to validate IP = 0.11
4. 40 75.0 65 1.043
the filter and examine its performance under various q = r = O . M , a =0.1
7.76 99.3 5. a a 537
conditions. The area under surveillance was 10 units by 10 IP = 0.01) (High 3! )
NT
units. Unless otherwise noted, values of Pn = 0.05, P, = q = r = 0 . 1 2 .
Ip 0.03) (High ON$
a = 0 . 1
a05 94 3 62 L 052
0.01, PD=0.9, q=O.O4, r=0.04, and T=1.0 were used in q = r - 0 . 4 , a =0.1
7.81 90.8 12 1 L 0%
generating the number of targets and the measurements. IP= 0. 1) (High DNT)
erating measurements and evaluating the algorithm) was Y. Bar-Shalom and E. Tse, “Tracking in a cluttered environment
with probabilistic data association,” Automatica, voi. 11, pp.
approximately 64K words. Ten Monte Carlo runs of 10 451460. 1975.
scans each were executed in 25-45 s depending upon the Y.-Bar-Shiom, “Extension of the probabilisitc data association
filter in multi-target tracking,” in Proc. 5th Symp. on Nonlinear
particular case. To handle more clusters and targets, or to Estimation, Sept. 1974, pp. 16-21.
reduce memory requirements, the cluster and target infor- D. L. Alspach, “A Gaussian s u m approach to the multi-target
identification-tracking problem,” Automatica, vol. 11, pp. 285-296,
mation could be put on a disk file. However, disk access . .<.
1975
<
timewould then cause a large increase in the overall R. W. Sittler, “An optimal data association problem in surveillance
theory,” IEEETrans.Mil.Electron., vol. MIL-I, pp. 125-139,
execution time of the program. Apr. 1964.
J. J. Stein and S. S. Blackman, “Generalized correlation of multi-
target track data,” IEEE Trans. Aerosp. Electron. %st., vol. AES-
IX. CONCLUSIONS 11, pp. 1207-1217, NOV.1975.
P. Smith and G. Buechler, “A branching algorithm for discriminat-
ing and tracking multiple objects,” IEEE Trans. Automat. Contr.,
This paper has developed a multiple-target tracking vol. AC-20. DD. 101-104. Feb. 1975.
C. L. Morifield, “Appbcation of 0-1 integer programming to
filter incorporating a wide range of capabilities not previ- multitarget tracking problems,” IEEE Trans. Automat. Contr., vol.
ously synthesized, including track initiation, multiple-scan AC-22, pp. 302-31 1, June 1977.
Y.Bar-Shalom, “Tracking methods in a multitarget environment,”
correlation, and the ability to process data sets with false IEEE Trans. Automat. Contr., vol. AC-23, pp. 618-626, Aug. 1978.
or missing measurements. The primary contribution is a D. L. Alspach and H. W. Sorenson, “Recursive Bayesian estima-
tion using Gaussian sums,” Automtica, vol. 7, 1971.
Bayesian formulation for determining the probabilities of R. E. Kalman, “A new approach to linear filtering and prediction
alternative data-to-target association hypotheses,which problems,” J . Basic Eng., vol. 82-D, pp. 35-45, 1960.
D. B.Reid, “A multiple hypothesis filter for traclung multiple
permitted this synthesis. In simulations of a simple targets in a cluttered environment,” LMSC Rep. D-560254, Sept.
aircraft tracking problem, the filter demonstrated its capa- 1977.
bilities over a wide range of target densities and measure-
ment uncertainties. The filter proved to be robust to errors
in the given filter parameters (e.g., unknown target den-
sity). Donald B. Reid (S69-”72) was born on March
29,1941, in Washington, X. He received the
B.S. degree from the U.S. Military Academy,
West Point, N Y , in 1963 and the M.S. and
ACKNOWLEDGMENT Ph.D. degrees in aero & astronautical engineer-
ing from Stanford University, Palo Alto, CA in
The author would like to thank Dr. H. R. Rauch, Mr. 1965 and 1972, respectively.
From 1965 to 1969 he served in the U.S. Air
R. G. Bryson, and the reviewers for their helpful sugges- Force as an Astronautical Engineer in the
tions. 6595th Aerospace Test Wing at Vandenberg
AFB and participated in the testing and launch
operations of military space programs. He was a member of the technical
REFERENCES staff at the Institute for Defense Analyses in Arlington, VA, from 1972
to 1976. Since July 1976 he has been a scientist with the Palo Alto
Research Laboratory of Lockheed Missiles & Space Company. His
[l] R. A. Singer, R . G. Sea, and, K.B. Housewright, “Derivation and
evduahon of unproved traclung fdters for use in dense multi-target current interests include multiple target tracking, orbital rendezvous and
environments,” IEEE Trans. Inform. Theory, vol.
IT-20, pp. station keeping, system identification, and military command and con-
423-432, July 1974. trol systems.