Mathematical Problems in Engineering - 2020 - Shin - Closed Form Distance Estimators Under Kalman Filtering Framework With
Mathematical Problems in Engineering - 2020 - Shin - Closed Form Distance Estimators Under Kalman Filtering Framework With
Research Article
Closed-Form Distance Estimators under Kalman Filtering
Framework with Application to Object Tracking
1
Department of Information and Statistics, Research Institute of Natural Science, Gyeongsang National University, Jinju 52828,
Republic of Korea
2
Department of Applied Mathematics, Peter the Great St. Petersburg Polytechnic University, Saint Petersburg 195251, Russia
3
Graduate School of Mechanical and Aerospace Engineering, Gyeongsang National University, Jinju 52828, Republic of Korea
Received 9 April 2020; Revised 15 June 2020; Accepted 24 June 2020; Published 20 August 2020
Copyright © 2020 Vladimir Shin et al. ,is is an open access article distributed under the Creative Commons Attribution License,
which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
In this paper, the minimum mean square error (MMSE) estimation problem for calculation of distances between two signals via
the Kalman filtering framework is considered. ,e developed algorithm includes two stages: the Kalman estimate of a state vector
computed at the first stage is nonlinearly transformed at the second stage based on a distance function and the MMSE criterion. In
general, the most challenging aspect of application of the distance estimator is calculation of the multivariate Gaussian integral.
However, it can be successfully overcome for the specific metrics between two points in line, between point and line, between point
and plane, and others. In these cases, the MMSE estimator is defined by an analytical closed-form expression. We derive the exact
closed-form bilinear and quadratic MMSE estimators that can be effectively applied for calculation of an inner product, squared
norm, and Euclidean distance. A novel low-complexity suboptimal estimator for special composite functions of linear, bilinear,
and quadratic forms is proposed. Radar range-angle responses are described by the functions. ,e proposed estimators are
validated through a series of experiments using real models and metrics. Experimental results show that the MMSE estimators
outperform existing estimators that calculate distance and angle in nonoptimal manner.
where the best parameters of the fitting functions are cal- (3) ,e MMSE estimators for quadratic and bilinear
culated given the training data is considered in [23]. Al- forms of a state vector are investigated and applied,
gorithm for estimation of a walking distance using a wrist- including the estimators for the square of a norm
mounted inertial measurement unit device is proposed in ‖xk ‖22 , the square of the Euclidean distance
[24]. ,e concept of distance between two samples or be- ‖xk − yk ‖22 , and the inner product 〈xk , yk 〉. A novel
tween two variables is fundamental in statistics due to the low-complexity algorithm for suboptimal estimation
fact that a sum of squares of independent normal random of a special class of composite functions is proposed.
variables has a chi-square distribution. Knowledge of the Tracking radar responses such as range, angles, and
distribution and usage of the usual approximations make a range rate are described by the functions.
confidence interval for distance metrics [25, 26]. Usage of (4) Performance of the proposed MMSE estimators
the Taylor series expansions for aircraft geometric-height through real examples illustrates their theoretical
estimation using range and bearing measurements is and practical usefulness.
addressed in [27, 28]. ,e minimum mean square error
(MMSE) estimation of a state vector in the presence of ,is paper is organized as follows. Section 2 presents a
information about the absolute value of a difference between statement of the MMSE estimation problem for an arbitrary
its subvectors is proposed in [29]. nonlinear function of a state vector within a Kalman filtering
In many applications, it is interesting to estimate not framework. In Section 3, the general MMSE estimator is
only a position or state of an object but also a nonlinear proposed, and computational complexity of the estimator is
distance function which gives information to effectively discussed. ,e concept of a closed-form estimator is in-
control target tracking. However, most authors have not troduced. In Section 4, the closed-form MMSE estimator for
focused on a simultaneous estimation of a state and distance absolute value of a linear form of a state vector is derived
functions in dynamical models such as a Kalman filtering (,eorem 1). In particular cases, the estimator calculates
framework. distances between two points in 1-D line, between a point
,e problem of estimation of the distance function, and line in 2-D plane, and between a point and plane in 3-D
dk � d(xk , yk ), between two vector signals xk and yk is space. ,e comparative analysis of the estimator via several
considered in the paper, but its difference from the afore- practical examples is presented. In Section 5, the MMSE
mentioned references is that the both signals xk and yk are estimators for quadratic and bilinear forms of a state vector
unknown, and they should be simultaneously estimated with are comprehensively studied (,eorems 2 and 3). Effective
the function dk using indirect measurements. For example, matrix formulas for the quadratic and bilinear MMSE es-
we observe positions of two points A(xk ) and B(yk ) in a line timators are derived and applied with the Euclidean dis-
and a distance between the points represents the absolute tance, a norm, and inner product of vector signals. In Section
difference, i.e., dk (A, B) � |xk − yk |. ,e positions xk and yk 6, a low-complexity suboptimal estimator for composite
and consequently the distance dk � |xk − yk | are unknown, nonlinear functions is proposed and recommended for
and our problem is to optimally calculate three estimates calculation of radar range-angle responses. In Section 7, the
k , and d
xk , y . Note that the simple distance estimator d
� efficiency of the suboptimal estimator is demonstrated on an
k k
|xk − y k | is not an optimal solution. 2-D dynamical model. Finally, we conclude the paper in
,e purpose of the paper is to derive an analytical closed- Section 8. ,e list of main notations is given in Table 1.
form MMSE estimator for distance functions between
random signals such as the absolute value, the Euclidean 2. Problem Statement
distance, inner product, bilinear, and quadratic forms. ,e
advantage of the estimator is quick and accurate calculation ,e basic framework for the Kalman filter involves esti-
of distance metrics compared to the approximate or iterative mation of a state of a discrete-time linear dynamical system
estimators. A further study of using the estimators is also with additive Gaussian white noise:
done for the object tracking problem where we can obtain xk+1 � Fk xk + Gk vk , k � 0, 1, . . . ,
important practical results for the distance estimation of (1)
signals in linear Gaussian discrete-time systems. y k � Hk x k + w k ,
,e following list highlights the primary contributions of
this paper: where xk ∈ Rn is a state vector, yk ∈ Rm is a measurement
vector, and vk ∈ Rr and wk ∈ Rm are zero-mean Gaussian
(1) Extension of the MMSE approach to the estimation white noises with process (Qk ) and measurement (Rk ) noise
of a nonlinear functions of a state vector within the covariances, respectively, i.e., vk ∼ N(0, Qk ), wk ∼ N(0, Rk ),
Kalman filtering framework. ,e obtained MMSE- and Fk ∈ Rn×n , Gk ∈ Rr×r , Qk ∈ Rr×r , Rk ∈ Rm×m , and
optimal solution represents a two-stage estimator. Hk ∈ Rm×n . ,e initial state x0 ∼ N(m0 , C0 ) and the process
(2) Derivation of analytical expressions for the different and measurement noises vk , wk are mutually uncorrelated.
metrics between two points in a line, between a point In parallel with the state-space model (1), consider the
and a line, and between a point and a plane. We nonlinear function of a state vector:
establish that the obtained estimators represent zk � f xk : Rn ⟶ R, (2)
compact closed-form formulas depending on the
Kalman filter state estimates and error covariance. which in particular case represents a distance metric in Rn .
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 3
Table 1: List of main notations. where x−k+1 � E(xk+1 | yk ) and P−k+1 � Cov(e−k+1 ), e−k+1 �
R n
Set of n-dimensional real column vectors xk+1 − x−k+1 are the time update estimate and error covari-
Rn×m Set of n × m real matrices ance, respectively, and Kk ∈ Rn×m is the filter gain matrix.
AT Transpose of matrix A Second stage (optimal MMSE estimator): next, the op-
In Identity matrix of size n × n timal MMSE estimate of the nonlinear function zk � f(xk )
On Null matrix of size n × n based on the measurements yk also represents a conditional
A− 1 Inverse of n × n matrix A mean, that is,
tr(A) Trace of n × n matrix A
zk � Ezk yk � n f(x)px yk dx,
opt
Normal distribution with mean m and covariance (4)
N(m, C) R
matrix C
E(.) Expectation operator where p(x | yk ) � N(xk , Pk ) is a multivariate conditional
Cov(xk ) Covariance (covariance matrix) of random vector xk Gaussian probability density function.
Cov(xk , yk ) Cross covariance of random vectors xk and√��� yk
1 1 T −1
‖x‖2 Euclidean norm (2-norm) of vector, ‖x‖2 � xT x N xk , Pk � 1/2 exp− x − xk Pk x − xk . (5)
n/2
2
Inner product of vectors, (2π) Pk
〈x, y〉
〈x, y〉 � ni�1 xi yi , x, y ∈ Rn
cT x Linear form (LF), cT x � ni�1 ci xi , c, x ∈ Rn ,us, the best estimate in equation (4) represents the
opt
Quadratic form (QF), optimal MMSE estimator, zk � F(xk , Pk ), which depends
xT Ax on the Kalman estimate xk and error covariance Pk deter-
xT Ax � ni,j�1 aij xi xj , A � [aij ]
xT Bx Bilinear form (BLF), xT A x � ni,j�1 bij xi x
j , B � [bij ] mined by KF equation (3).
Pk+1 � In − Kk+1 Hk+1 P−k+1 , where Φ(·) is the cumulative distribution function of the
standard normal distribution, N(0, 1).
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
4 Mathematical Problems in Engineering
Direction of motion
x1 x2 M (x1, x2)
dk (ℒ, M)
Line L:
|x1 – x2| Trajectory Ax1 + Bx2 + C = 0
,e MMSE estimator (10) allows to calculate distances Example 3 (distance between point and plane). Similar to
measured in terms of the absolute value in n-dimensional space. equation (12), the shortest distance between the moving
point M(xk ) � M(x1,k , x2,k , x3,k ) and the plane P: Ax1 +
4.2. Examples of MMSE Estimator for Distance between Bx2 + Cx3 + D � 0 in 3-D space,
Points. Let xk ∈ Rn be a normal state vector, and xk ∈ Rn
Ax1,k + Bx2,k + Cx3,k + D
and Pk ∈ Rn×n are the Kalman estimate and error covariance, dk (P, M) � √����������� , (15)
respectively, Pk � [Pij,k ]. A2 + B 2 + C 2
is shown in Figure 3.
Example 1 (distance on 1-D line). ,e MMSE estimator for Substituting cT � A B C and d � D into equations
the distance zk � |xk − ak | between the moving point (xk ) (9) and (10), we get
and given sequence (ak ) in 1-D line takes the form �����
��� 1 ⎪
⎧
⎨ 2P(ℓ) 2
opt 2Pk − ak 2
x opt (P, M) � √����������
d � k
exp ⎝− ℓ k ⎞
⎛ ⎠
zk � exp− k k
A2 + B2 + C2 ⎪
⎩ π 2P(ℓ)
π 2Pk k
(11)
k − ak
x ℓk ⎟⎥⎤⎫ ⎪
⎬
k − ak 1 − 2Φ− ��� . ⎡⎢ ⎜
+ x
Pk + ℓk ⎢⎢⎢⎣1 − 2Φ⎛
⎜
⎝− ����⎞ ⎠⎥⎥⎦⎪,
⎟
Pk(ℓ) ⎭
(16)
Example 2 (distance between point and line). ,e shortest
distance dk (L, M) from the moving point where ℓk and P(ℓ)
k are determined by equation (9):
M(xk ) � M(x1,k x2,k ) to the line L: Ax1 + Bx2 + C � 0 in ℓk � A
x1,k + B
x2,k + C
x3,k + D,
2-D plane is shown in Figure 2. ,e distance is given by
P(ℓ) 2 2 2 (17)
Ax1,k + Bx2,k + C k � A P11,k + B P22,k + C P33,k
dk (L, M) � √������� . (12) + 2AP12,k + 2ACP13,k + 2BCP23,k .
A2 + B 2
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 5
M (x1, x2, x3) Remark 2. Reviewing formula (20), we find the following. If
the values of αk and βk are large (αk , |βk | ≫ 1), then
exp(− αk ) ≈ 0 and Φ(− βk ) ≈ 0 if x k > 0 or Φ(− βk ) ≈ 1 if
x k < 0, which implies that both estimates are quite close, i.e.,
Plane opt
zk ≈ zsub xk |. Assuming the estimate x k is far enough
k � |
: Ax1 + Bx2 + Cx3 + D = 0 from zero, then the large values of the functions αk and βk
depend on the error variance Pk . Using (19), the steady-state
value of the variance P∞ satisfies the quadratic equation
������ �
Figure 3: Shortest distance from point M(x1 , x2 , x3 ) to a plane in P2∞ + qP∞ − rq � 0 with solution P∞ � (− q + q2 + 4rq )/2.
3-D. Since the variance P∞ � P∞ (q, r) depends on the noise
statistics q and r, this fact can be used in practice to compare
,e MMSE distance estimators in ,eorem 1 and Ex- the proposed estimators. For example, if the estimate x k is
amples 1∼3 are summarized in Table 2. far enough from zero and the product rq is small (rq ≪1),
then P∞ ≈ 0, and αk , |βk | ≫1. In this case, both estimators are
opt
close, zk ≈ zsub
k . Simulation results confirm this result.
4.3. Numerical Examples. In this section, numerical exam- Next, we test the efficiency of the proposed estimators. ,e
ples demonstrate the accuracy of the two closed-form es- estimators are compared under different values of the noise
timators calculated for the absolute value z � |cT x|. ,e variances q and r. ,e following scenarios were considered:
optimal MMSE estimator zopt is compared with the simple Case 1: small noises, q � 10− 4 , r � 10− 2
suboptimal one zsub � |cT x|. Case 2: medium noises, q � 0.1, r � 0.5
Case 3: large noises, q � 0.5, r � 1
4.3.1. Estimation of Distance between Random Location and Both estimators were run with the same random noises
Given Point in 1-D Line. Let xk be a scalar random position for further comparison. ,e Monte Carlo simulation with
measured in additive white noise; then, the system model 1000 runs was applied in calculation of the root mean square
is �����������
opt opt
error (RMSE), RMSEk � E(zk − zk )2 , and RMSEsubk �
xk+1 � xk + vk , x0 � m0 , ������������
(18) sub 2
E(zk − zk ) . Define the average RMSE over the time
y k � xk + w k , k � 1, 2, . . . ,
interval k ∈ [k1 , k2 ] as
where m0 is the known initial condition and vk ∼ N(0, q) k
def 1 2
and wk ∼ N(0, r) are the uncorrelated white Gaussian R(z) � RMSEk . (21)
noises. k2 − k1 + 1 k�k
1
0.12 0.07
0.1 0.06
0.05
0.08
Distance
0.04
RMSE
0.06
0.03
0.04
0.02
0.02 0.01
0 0
2 4 6 8 10 12 14 16 18 20 2 4 6 8 10 12 14 16 18 20
Time, k Time, k
Figure 4: Comparison between optimal and suboptimal estimators for small noises (Case 1) with q � 0.0001, r � 0.01, P∞ ≈ 0.001, and
zero initial condition m0 � 0. (a) True and estimated values for zk � |xk |. (b) RMSEs for both estimators.
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 7
1.1 0.07
1.08
1.06 0.06
1.04 0.05
1.02
Distance
0.04
RMSE
1
0.98 0.03
0.96
0.02
0.94
0.92 0.01
0.9 0
2 4 6 8 10 12 14 16 18 20 2 4 6 8 10 12 14 16 18 20
Time, k Time, k
Figure 5: Comparison between optimal and suboptimal estimators for small noises (Case 1) with q � 0.0001, r � 0.01, P∞ � 0.001, and
nonzero initial condition m0 � 1. (a) True and very close estimates for zk � |xk |. (b) Very close RMSE values for both estimators.
2 1.2
1
1.5
0.8
Distance
RMSE
1 0.6
0.4
0.5
0.2
0 0
2 4 6 8 10 12 14 16 18 20 2 4 6 8 10 12 14 16 18 20
Time, k Time, k
Figure 6: Comparison between optimal and suboptimal estimators for medium noises (Case 2) with q � 0.1, r � 0.5, P∞ � 0.18, and zero
initial condition m0 � 0. (a) True and estimated values for zk � |xk |. (b) RMSEs for both estimators.
4 2.5
3.5
2
3
2.5 1.5
Distance
RMSE
2
1.5 1
1
0.5
0.5
0 0
2 4 6 8 10 12 14 16 18 20 2 4 6 8 10 12 14 16 18 20
Time, k Time, k
Figure 7: Comparison between optimal and suboptimal estimators for large noises (Case 3) with q � 0.5, r � 1.0, P∞ � 0.5, and zero initial
condition m0 � 0. (a) True and estimated values for zk � |xk |. (b) RMSEs for both estimators.
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
8 Mathematical Problems in Engineering
4.3.2. Estimation of Distance between Two Random Points in also valid for models (22) and (23). For example, if the
1-D Line. Consider a motion of two random points A1 (x1 ) estimate ℓk � x
1,k − x 2,k is far enough from zero and the
and A2 (x2 ) in 1-D line. Assume that evolution of the state variance P(ℓ) E(ℓ 2 opt sub
k � k − ℓk ) is small, then z k ≈z k . ,e
vector xk � [x1,k x2,k ]T from time tk to tk+1 is defined by the (ℓ)
simulation results in Figure 8 with Pk � 0.0015, k > 8, and
random walk model: very close values of the average RMSEs, R(zopt ) � 0.0189
x1,k+1 � x1,k + v1,k , x1,0 � m1 , k � 0, 1, . . . , and R(zsub ) � 0.0189, confirm this fact.
(22) In addition, we are interested in the following new
x2,k+1 � x2,k + v2,k , x2,0 � m2 , scenarios:
where m1 and m2 are the known initial conditions and Case 1: both points A1 (x1 ) and A2 (x2 ) are fixed, and
v1,k ∼ N(0, q1 ) and v2,k ∼ N(0, q2 ) are uncorrelated white their positions are measured with small noises
Gaussian noises. Case 2: the first point A1 (x1 ) is fixed, but the movement
Assuming we measure the true position of the points of the second one A2 (x2 ) is subject to a small noise
with correlated measurement white noises w1 and w2 , re-
spectively, the measurement equation is Case 3: the movement of both points is subject to a
medium noise
y1,k � x1,k + w1,k , w1,k ∼ N 0, r1 , ,e model parameters and simulation results for the
(23)
y2,k � x2,k + w2,k , w2,k ∼ N 0, r2 , scenarios are illustrated in Table 4. From Table 4, we observe
the strong difference between the average RMSEs R(zopt )
and R(zsub ), i.e., R(zopt ) < R(zsub ). It is not a surprise that
where E(w1,k w2,k ) � r12 .
the optimal estimator (24) is better than the suboptimal one,
Our goal is to estimate the unknown distance
zsub
k � | 2,k |.
x1,k − x
d(A1 , A2 ) � |x1,k − x2,k | between the current location of the
points A1 (x1,k ) and A2 (x2,k ).
According to the proposed two-step estimation proce- 5. MMSE Estimators for Bilinear and
dure, the optimal Kalman estimate xk � x 2,k T and
1,k x Quadratic Forms
error covariance Pk � [Pij,k ], P0 � I2 computed at the first
stage are used at the second stage for estimation of the 5.1. Optimal Closed-Form MMSE Estimator for Quadratic
distance zk � |x1,k − x2,k |. Using formulas (9) and (10) for Form. Consider a quadratic form (QF) of the state vector
cT � 1 − 1 and d � 0, we obtain the best MMSE estimate xk ∈ Rn :
for the distance: zk � xTk Ak xk , Ak � ATk . (25)
�����
In this case, the optimal MMSE estimator (4) can be
opt 2P(ℓ)
zk � k
exp − αk + ℓk 1 − 2Φ − βk , explicitly calculated in terms of the Kalman estimate xk and
π error covariance Pk .
ℓ2
k
αk � , Theorem 2 (MMSE estimator for QF). Let xk ∈ Rn be a
2P(ℓ)
k normal random vector, and xk ∈ Rn and Pk ∈ Rn×n are the
(24) Kalman estimate and error covariance, respectively. 2en, the
ℓk
βk � ��� �, optimal MMSE estimator for the QF zk � xTk Ak xk has the
P(ℓ) following closed-form structure:
k
opt
zk � xTk Ak xk +tr Ak Pk . (26)
ℓk � x
1,k − x
2,k ,
P(ℓ)
k � P11,k + P22,k − 2P12,k . Proof. Using the formulas xT Ax � tr(AxxT ) and
E(xxT ) � Cov(x) + E(x)E(xT ), we obtain
In parallel with the optimal distance estimator (24), we
zk � ExTk Ak xk yk � EtrAk xk xTk yk
opt
consider the simple suboptimal estimator zsub
k � | 2,k |.
x1,k − x
opt
� trAk Exk xTk yk
Remark 3. As we see, the optimal estimate zk of the dis-
tances in (20) and (24) depends on the functions αk and βk . � trAk Pk + Exk yk ExTk yk
,e functions in formulas (20) and (24) are calculated in the
pairs of points ( xk , Pk ) and (ℓk , P(ℓ)
k ), respectively. ,e � tr Ak Pk + trAk xk xTk � tr Ak Pk + xTk Ak xk .
second pair depends on the state estimate xk � [ 2,k ]T
x1,k x
and error covariance Pk � [Pij,k ]. ,erefore, Remark 2 is (27)
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 9
1.14 0.045
0.04
1.12
0.035
1.1 0.03
Distance
0.025
RMSE
1.08
0.02
1.06 0.015
0.01
1.04
0.005
1.02 0
0 2 4 6 8 10 12 14 16 18 20 0 2 4 6 8 10 12 14 16 18 20
Time, k Time, k
True Optimal RMSE
Optimal Suboptimal RMSE
Suboptimal
(a) (b)
Figure 8: Comparison between optimal and suboptimal estimators for small noises with q1 � q2 � 10− 4 , r1 � r2 � 10− 2 , r12 � 0.005, and
initial positions m1 � 0, m12 � 1. (a) True and very close estimates for the distance zk � |x1,k − x2,k |. (b) Very close RMSE values for both
estimators.
Proof. Using the fact that the MMSE estimator is unbiased, 5.2. Optimal Closed-Form MMSE Estimator for Bilinear Form.
opt
E(zk − zk ) � 0, and the equality zsub opt
k � z k − tr(Ak Pk ), we Let xk ∈ Rn and xk ∈ Rn be two arbitrary state vectors. ,en, a
obtain bilinear form (BLF) on the state space can be written as follows:
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
10 Mathematical Problems in Engineering
Theorem 3 (MMSE estimator for BLF). Let where d(xk , xnk ) is the Euclidean distance and D is the
T
xk � xTk xTk 2n
∈ R be a joint normal random vector, and distance threshold (see Figure 9).
xk ∈ R and Pk ∈ R2n×2n are the Kalman estimate and block
2n In view of the above, rewrite the control law in the
error covariance matrix (33). 2en, the optimal MMSE es- equivalent form:
timator for the BLF uk � xTk Ak xk has the following closed- 1, d xk , xnk < D2 ,
Uk∗ � (39)
form structure: − 1, otherwise,
opt
u k �xTk Ak xk + trAk Pxx,k . (34)
where d2 (xk , xnk ) is the squared of the Euclidean distance and
D2 is the new threshold.
Example 4 (estimation of inner product and squared Eu- Using the quadratic estimator (37) for the squared
clidean distance). Using the bilinear estimator (34) with distance zk � d2 (xk , xnk ), we obtain the MMSE estimator,
opt
Ak � In , the MMSE estimator for the inner product uk � zk � (xk − xnk )T (xk − xnk ) + tr(Pk ), which can be used in the
xTk xk takes the form control (39):
opt
u Tk xk + trPxx,k .
k � x (35) ⎨ 1, zopt
⎧ 2
k <D ,
Uk∗ � ⎩ (40)
Next, calculate the optimal MMSE estimator for the − 1, otherwise.
squared Euclidean distance between two points
zk � d2 (xk , xk ) � ‖xk − xk ‖22 or zk � ‖ηk ‖22 , where ηk � xk − In the next section, we discuss application of the linear,
xk . ,e Kalman estimate and error covariance of the dif- bilinear, and quadratic estimators (,eorems 1–3) for es-
ference ηk take the form timation of composite nonlinear functions.
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 11
Table 5: MMSE estimators for QF, BLF, inner product, and squared norm.
Title Formula for function MMSE estimator Equation
T T zopt � xT Ax + tr(AP)
QF z � x Ax, A � A (26)
u
opt
� x Bx + tr(BPxx )
T
BLF u � xT Bx, B � BT (34)
opt T
u
� x x + tr(Pxx )
Inner product u � 〈x, x〉 � xT x (35)
z � (x − x)T (x − x) + tr(P(η) ),
opt
Normal trajectory
�����������
6. Suboptimal Estimator for Composite d� p2x + p2y + p2z � F1 (x),
Nonlinear Functions �����
6.1. Definition of Composite Function. Consider a composite F1 (x) � g1 (x), g1 � x21 + x22 + x23 ,
function F depending on LF, QF, and BLF, such as
py
θ � tan− 1 � F2 (x),
F(x) � F g1 (x), g2 (x), . . . , gh (x), (41) px
g2 (x)
where the inside functions are defined as F2 (x) � tan− 1 , g 2 � x2 , g 3 � x1 ,
g3 (x)
LF � cT x, x, c ∈ Rn , pz
⎢
⎡
⎢
⎢ φ � ������� � F3 (x), (44)
gi (x) � ⎢
⎢ T
⎣ QF � x Ax,
⎢
⎢
n
x∈R ,A∈R n×n
, (42) px + p2y
2
In the spherical coordinates, we assume that a 6.2. Suboptimal Estimator for Composite Functions. Given
Doppler radar is located at the origin of the Cartesian the Kalman estimate and covariance (x, P), we estimate a
coordinates, and it measures the following quantities quantity obtained via the composite function F(x) � F(g1
obtained via nonlinear composite functions Fi (g1 (x), . . . , gh (x)). ,e idea of the algorithm is based on the
(x), . . . , gh (x)) of the state components depending on LF, optimal MMSE estimators for LF, QF, and BLF proposed in
QF, and BLF: equations (10), (26), and (34), respectively. We have
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
12 Mathematical Problems in Engineering
Example 7 (estimation of cosine of angle). Let 7.1. Suboptimal Estimators for Range-Angle Response. ,e
T
X � xT xT ∈ R2n be a joint normal state vector, and example of Section 4.3.2 is considered again. Consider the 2-
⌢ x D models (22) and (23) describing motion of the two
X � , random points A1 (x1,k ) and A2 (x2,k ). To calculate the range
x (dk ), tangent of the bearing angle (θk ), and cosine of the
(47)
Pxx Pxx angle (φk ), we use the following formulas:
P� T⎣
⎡ ⎦
⎤ ��������
Pxx Pxx def
f xk � dk � x21,k + x22,k ,
are the Kalman estimate and block error covariance. def x2,k
,e cosine of angle between two vectors x, x ∈ Rn is h xk � tan θk � ,
x1,k
equal to
〈x, x〉 〈x, x〉 def 〈x , x 〉 (52)
cos(θ) � � √��� √��� . (48) g xk � cos φk � ��� k−���1 ���k ���
‖x‖ ×‖x‖ x x × xT x
T
�xk− 1 � × �xk �
We observe the ratio (48) represents the composite x1,k− 1 x1,k + x2,k− 1 x2,k
function z � F(x,√x)���
depending on the three inside functions � ����������� ��������.
√��� x21,k− 1 + x22,k− 1 × x21,k + x22,k
T T
g1 � x x, g2 � x x, and g0 � 〈x, x〉:
g
z � cos(θ) � √�� 0 √��. (49) ,e following estimators for the range-angle responses
g1 × g2 (52) are illustrated and compared:
,e optimal MMSE estimators for the inside functions (1) Simple estimator:
g0 , g1 , and g2 are known. Using equation (45), we have ��������
sim � x
21,k + x
22,k ,
0 � xT x + tr Pxx ,
g (a) f k
1 � xT x + tr Pxx ,
g (50) sim 2,k
x
T
(b) hk � ,
2 � x x + tr Pxx .
g 1,k
x (53)
i,
Replacing the inside functions gi with their estimates g 1,k− 1 x
x 1,k + x 2,k− 1 x 2,k
sim
(c) g k �
����������� �������� .
we get the suboptimal estimator for the cosine of angle: 21,k− 1 + x
x 22,k− 1 × x 21,k + x 22,k
0
g xT x + trPxy
zcom � �� �� � ������������ ����������� �. (51)
1 g
g 2 T
xT x + tr Pxx × x x + tr Pxx (2) Estimator for composite functions:
com
�����������������������
(a) f 21,k + P11,k + x
� x 22,k + P22,k ,
k
com sim
(b) hk � hk ,
(54)
1,k− 1 x
x 1,k + x P(1)
2,k +
2,k− 1 x + P(2)
com
(c) g k
k− 1,k
� ����������������������������� �����������������������. k− 1,k
21,k− 1 + P11,k− 1 + x
x 22,k− 1 + P22,k− 1 × x 21,k + P11,k + x
22,k + P22,k
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 13
2.5 0.7
0.6
2
0.5
1.5 0.4
RMSE
Range
1 0.3
0.2
0.5
0.1
0 0
0 2 4 6 8 10 12 14 16 18 20 0 2 4 6 8 10 12 14 16 18 20
Time, k Time, k
True Simple
Simple Composite
Composite
(a) (b)
Figure 10: Comparison of composite and simple estimators for range. (a) True and estimated ranges. (b) RMSE for both estimators.
sim
Note that the simple and composite estimates hk and
com
hk for a bearing angle coincide. In equation (54), P(1) k− 1,k �
2
E(e1,k− 1 e1,k ) and P(2)
k− 1,k � E(e e
2,k− 1 2,k ) are the error cross- Tangent of bearing angle
covariances satisfying the following recursive: 1.5
0
√√√√√√√√√√√√√√√√√√√√√√√ √
I1
(A.1)
Note that both estimators and sim
are based on the
g k com
g k
MMSE estimators for a squared norm and inner product. √���� 0
− 1/ 2πP xe− ((x− x) /2P) dx .
2
2πP 0 P
In this paper, we propose a novel MMSE approach for the
estimation of distance metrics under the Kalman filtering ∞ √��
1 t2 /2
framework. ,e main contributions of the paper are listed in )e−
� √��� √� (t P + x dt
the following. 2π − x/ P
Firstly, an optimal two-stage MMSE estimator for an √�� ∞
P
x ∞
arbitrary nonlinear function of a state vector is proposed. � √��� √� te− t2 /2
dt + √��� √� e− t2 /2
dt
,e distance metric is an important practical case of such 2π − x/ P 2π − x/ P
nonlinearities, detailed study of which is given in the √�� (A.2)
paper. Implementation of the MMSE estimator is re- P x2 /2P
x ∞
t2 /2
duced to calculation of the multivariate Gaussian inte- � √���e− + √��� √� e− dt
2π 2π − x/ P
gral. To avoid the difficulties associated with its
calculation, the concept of a closed-form estimator √�� √�
−
x/ P
depending on the Kalman filter statistics is introduced. P
� √���e− x2 /2P
⎛
+x ⎝1 − √1��� e− t2 /2 ⎠
dt⎞
We establish relations between the Euclidean metrics and 2π 2π − ∞
the closed-form estimator, which lead to simple compact
formulas for the real-life distances between points pre- √��
P x2 /2P −x
sented in Table 2. � √���e− 1 − Φ√�� .
+x
2π P
Secondly, an important class of bilinear and quadratic
estimators is comprehensively studied. ,ese estimators are
applied to a square of norm, Euclidean distance, and inner Similar technique can be used to find the second
product. Table 5 summarizes the results. Moreover, an integral I2 :
2629, 2020, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1155/2020/9141735, Wiley Online Library on [23/11/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Mathematical Problems in Engineering 15