3D-WiFi 3D Localization With Commodity WiFi
3D-WiFi 3D Localization With Commodity WiFi
Abstract— Recently, 3D localization has attracted intense inter- accuracy [5]–[7]. Due to the requirement of extremely high
ests with its enabled applications, such as smart healthcare, sampling rate and strict time-synchronization between UWB
smart home, and smart robots. Conventional 3D localization transceivers, the sophisticated location system is designed and
technologies require to utilize the special-dedicated infrastruc-
tures with a large-scale deployment, which results in high implemented by using the dedicated infrastructures. More-
cost. However, in order to accomplish an appealing tradeoff over, current location systems also adopt the mechanism of
between location accuracy and infrastructure cost, designing and TOA measurements to locate the target in 3D space using
implementing a 3D localization system are still a challenging frequency modulated continuous wave (FMCW) technology
task to solve. To address this issue, we develop a novel 3D [8], [9], which can achieve decimeter-level accuracy. Since
localization system by using commercial off-the-shelf (COTS)
WiFi infrastructures at a low cost. First, we design a cost- FMCW has to take a narrow-band signal to sweep the
effective hardware scheme to derive the orientation information carrier frequency through a wide bandwidth, FMCW signal
for 3D localization. Then, we adopt a fusion method of multiple generator is designed and developed by the special-purpose
channel state information measurements to improve multipath hardware platform. In addition, radio frequency identification
resolution and identify the target direct path by the azimuth devices (RFIDs) can be attached to the target object for
and elevation angle-of-arrival (AOA) and equivalent time-of-
arrival estimations, which can be formulated as subspace-based 3D localization with a larger-scale deployment [10]–[12].
sparse reconstruction with high accuracy. Finally, according to In indoor scenarios, RFID signal is harshly impaired by com-
both azimuth and elevation AOA estimations of the target direct plicated multipath propagation, so that the location systems
path, the target can be localized in 3D space at decimeter-level. provide coarse-grained 3D location information. In order to
We implement the proposed 3D localization system using COTS improve the location accuracy, the emerging location scheme
WiFi infrastructures and validate its performance with extensive
evaluations in two indoor scenarios. exploits a hybrid technique with both RFID-based subsys-
tem and computer-vision-based subsystem [13], which adopts
Index Terms— 3D, wireless localization, 2D-AOA, sparse recon- fingerprinting approach to localize the stationary object at
struction, COTS.
decimeter level with not only a cumbersome training proce-
dure, but also an additional auxiliary device. Taken together,
I. I NTRODUCTION existing 3D localization systems require the special-dedicated
infrastructures, which results in high cost to make them
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
5142 IEEE SENSORS JOURNAL, VOL. 19, NO. 13, JULY 1, 2019
the sampling spatial grids. The prominent location systems implementation of the proposed 3D-WiFi localization system.
achieve decimeter-level accuracy, preferably using the Section IV validates the performance of the proposed 3D-WiFi
commercial off-the-shelf (COTS) WiFi infrastructures without localization system with experimental evaluations. Finally,
any other additional auxiliary. However, the emerging location the conclusion is drawn in section V.
scheme only focus on the plane-domain (2D) localization.
Therefore, the favorable performance of WiFi CSI-based
II. R ELATED W ORK
localization motives us to reach and realize 3D localization
with AOA measurements using COTS WiFi infrastructures at In this section, we firstly review 3D localization technolo-
low cost. gies with enabled applications, and then introduce WiFi-based
In this paper, we develop a novel 3D localization system, indoor localization with AOA measurements.
named 3D-WiFi that localizes the target in 3D space by Recent 3D localization systems are designed and imple-
using COTS WiFi infrastructures. We firstly design a cost- mented with diverse wireless technologies. Conventional 3D
effective hardware scheme to derive the orientation informa- location systems adopt TOA or TDOA measurements to
tion, i.e., the azimuth and elevation AOA estimations, for achieve an excellent accuracy using UWB technology [5]–[7]
3D localization. Then, we adopt a fusion method of multiple or FMCW technology [8], [9]. High accurate location sys-
CSI measurements to improve multipath resolution with the tems can be applicable for human body localization such
azimuth and elevation AOA and equivalent TOA measure- as elder or patient monitoring, motion tracking, and even
ments, which can be formulated as a problem of subspace- smart surgical tools [6], [8], [17], [18]. In these 3D local-
based sparse reconstruction. After that, the target direct path ization systems, RF signal acquisition requires to design and
can be identified by the minimal TOA measurement. Finally, develop the special-purposed infrastructures components. In
according to the azimuth and elevation AOA estimations of addition, RFIDs can be attached to the target object for 3D
the target direct path from two or more receivers, the target localization with a larger-scale deployment in the interested
can be localized in 3D space at a decimeter level by using environment [10]–[12]. In order to improve the location accu-
COTS WiFi infrastructures. racy, RFID-based scheme adopts fingerprinting approach to
The main contributions of the paper can be summarized as localize the object in 3D space with an additional vision-
follows. assisted technique [13]. Therefore, existing 3D localization
1) We develop a novel 3D localization system, named systems are designed and implemented by using the dedicated
3D-WiFi that first realizes to localize the target in 3D infrastructures, which results in high cost for potential and
space by using COTS WiFi infrastructures at low cost. practical location-based applications.
The proposed 3D-WiFi localization system can achieve Recently, ubiquitous WiFi infrastructures with multiple
decimeter-level accuracy and further accomplish the antennas bring about an emerging solution on wireless local-
tradeoff between location accuracy and infrastructure ization by deriving AOA information. In complicated mutil-
cost. path indoor environments, since the AOA resolution relies on
2) We design a cost-effective hardware scheme to derive the number of antennas, the location systems [17], [22], [23]
the azimuth and elevation AOA information for 3D have achieved high accuracy with a lot of antennas using
localization. The developed L-shaped array consists of the special-purpose hardware platform. However, advanced
two commodity WiFi cards with external uniform linear location schemes can achieve decimeter-level accuracy by
subarrays in the orthogonal directions by stitching one using the COTS WiFi infrastructures, even without any other
shared antenna. The advantage of the L-shaped array lies auxiliary [16], [20], [21]. With the limited number of antennas
in that the azimuth and elevation AOA estimations can on the COTS WiFi devices, these systems effectively leverage
be separately obtained using each uniform linear sub- rich phase information of CSI readings to emulate and enlarge
array with higher accuracy than other structured arrays, the number of antennas, which leads to joint AOA and
effectively reducing the computational complexity for TOA measurement with two-dimensional MUSIC algorithm.
practical 3D localization. To enhance AOA accuracy, the art [19] explores and exploits
3) In order to improve multipath resolution, we adopt the spatial sparsity of multipath signal to realize joint AOA and
a fusion method of multiple CSI measurements with TOA estimations with two-dimensional sparse reconstruction.
singular value decomposition (SVD). With the robust- Using the COTS WiFi infrastructures, the favorable location
ness to noises, the signal subspace is utilized to systems can achieve an attractive tradeoff between location
realize joint AOA and equivalent TOA estimations accuracy and infrastructure cost. In this regard, it motives us to
using each uniform linear subarray, which can be evolve WiFi CSI-based location systems into 3D localization
formulated as a problem of subspace-based sparse with AOA measurements by using COTS WiFi infrastructures
reconstruction. at low cost.
4) We implement the proposed 3D-WiFi localization sys- Therefore, we design and implement a novel 3D localization
tem on commercial WiFi devices, carry out experiments system that realizes the azimuth and elevation AOA measure-
in two indoor scenarios, and validate its performance ments by using COTS WiFi infrastructures. The developed
with extensive evaluations. L-shaped array can be utilized to independently obtain the
The rest of this paper is structured as follows. Section II azimuth and elevation AOA estimations using each uniform
reviews the related work. Section III describes the system linear subarray with higher accuracy than other structured
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
ZHANG AND WANG: 3D-WiFi: 3D LOCALIZATION WITH COMMODITY WiFi 5143
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
5144 IEEE SENSORS JOURNAL, VOL. 19, NO. 13, JULY 1, 2019
Fig. 2. CSI phase measurements of the shared antenna on the developed L-shaped array. (a) Raw phase measurements on the share antenna. (b) Sanitized
phase measurements on the shared antenna. (c) Aligned phase measurements on the shared antenna between two commodity WiFi NICs.
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
ZHANG AND WANG: 3D-WiFi: 3D LOCALIZATION WITH COMMODITY WiFi 5145
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
5146 IEEE SENSORS JOURNAL, VOL. 19, NO. 13, JULY 1, 2019
Owing to the accessibility to the commodity WiFi chipsets, with second-order cone (SOC) programming [37], [38]. Once
each CSI measurement usually includes 30 subcarriers on the spatial sparse spectrums could be work out, the sharp peaks
3 antennas using the standard Intel 5300 WiFi NIC, so that of spatial sparse spectrums can be translated to JATE of the
the CSI vectors H 1 and H 2 from the developed L-shaped array each path with each uniform linear subarray. Therefore, JATE
can be expressed as (19) and (20), as shown at the bottom of with two commodity WiFi NICs can be obtained and then the
this page, respectively. direct path can be identified by the minimal TOA measurement
According to the spatial sparsity of multipath signals, for 3D localization.
we adopt the sparse reconstruction algorithm to realize JATE
of each path with high accuracy. To cope with the prob- D. Subspace Sparse Reconstruction Based on
lem of sparse reconstruction, the CSI measurements should 1 -Methodology SVD
be sparsely represented. We require to partition the two- In order to realize the target localization, the adequate pairs
dimensional grids of all possible angles and time delays of JATE from dozens of CSI measurements are clustered to
with an equal spacing, i.e., a sampling spatial grid for AOA discriminate multipath and identify the direct path [16], [20],
estimation as { ϕ1 , ϕ Na } and {
ϕ2 , . . . , 2 , . . . ,
φ1 , φ φ Na } with [21]. However, when the target is slowly moving or static
each uniform linear subarray respectively, and a sampling in a short time, we prefer to combine such independent
time grid of all possible delays for equivalent TOA estimation estimations from multiple CSI measurements and refine one
as {τ1 ,
τ2 , . . . ,
τ Nτ }1 . The bases of sparse representation are representative estimation by coherent combined processing
comprised of the joint steering vectors of all possible angles in a fusion method, effectively reducing computational com-
and time delays as (21) and (22), as shown at the bottom plexity. Firstly, we combine the coherence of multiple CSI
of this page, respectively, where Aϕτ and Aφτ are the size measurements using SVD. Then, the signal subspace is uti-
of 90×Nτ Na . With the over-completed bases, the aligned lized to improve multipath resolution with the azimuth AOA,
CSI measurements from each uniform linear subarray can be elevation AOA, and equivalent TOA estimations, which can
sparsely represented as be formulated as subspace-based sparse reconstruction based
1 = Aϕτ sϕτ + n1 , on 1 -methodology optimization.
H (23)
The CSI matrixes with multiple snapshots are collected with
2 = Aφτ sφτ + n2 , each uniform liner subarray, as H1 = H 11 , H
21 , . . . , H
1Nt
H (24)
and H2 = H 12 , H
22 , . . . , H
2Nt . At the same time, S1 =
where the sparse spectrums sϕτ and sφτ are the Nτ Na ×1 vec-
Nt Nt
tors that should own non-zero elements mapping the JATE of s1ϕτ , s2ϕτ , . . . , sϕτ and S2 = s1φτ , s2φτ , . . . , sφτ are defined,
each path in the indoor scenario, and zero otherwise. In com- respectively. With the over-complete bases of sparse repre-
pressive sensing theory, the sparse spectrums sϕτ and sφτ can sentation, the CSI matrixes can be expressed with the noise,
be reconstructed by regularizing it based on 1 -methodology respectively as
[33], [34], [36] that is formulated by the appropriated objective
H1 = Aϕτ S1 + N1 , (27)
functions respectively as
2
min H1 − Aϕτ sϕτ 2 + κ sϕτ 1 , (25) H2 = Aφτ S2 + N2 . (28)
2 We perform the SVD of H1 and H2 that are decomposed
min H2 − Aφτ sφτ 2 + κ sφτ 1 , (26) into the signal subspace and the noise subspace. With robust-
ness to the noise, the signal subspace can be used to estimate
where κ is a regularization factor that controls a tradeoff
JATE with each uniform linear subarray, which models the
between the sparsity of spatial spectrum and the residual norm.
problem as subspace-based sparse reconstruction. We hold on
Finding the numerous solutions of the sparse spectrums is a
the over-complete bases for sparse representation of the signal
convex optimization problem that can be effectively tackled
subspace, and thus, the signal subspace HSV1 and H2 can be
SV
1 The range of equivalent TOA is normally up to the maximum of sampling expressed, respectively as
delay as [0, τmax ], where τmax = 1/ f δ . As IEEE 802.11a/g/n standards, f δ HSV
1 = Aϕτ S1 + N1 ,
SV SV
(29)
depends on the CSI settings. In the proposed 3D-WiFi system, Intel 5300 WiFi
NIC is set up in 5GHz WiFi with 40MHz bandwidth, f δ = 1.25MHz, thus
τmax = 800ns. HSV
2 = Aφτ S2 + N2 .
SV SV
(30)
1 = [H1 (1, 1), H1(1, 2), . . . , H1 (1, 30), . . . , H1(3, 1), H1(3, 2), . . . , H1(3, 30)]T ,
H (19)
2 = H2 (1, 1), H2 (1, 2), . . . , H2 (1, 30), . . . , H2 (3, 1), H2 (3, 2), . . . , H2 (3, 30) T .
H (20)
Aϕτ = a (
ϕ1 ,τ1 ), . . . , a ϕ1 ,
τ Nτ , a (
ϕ2 ,
τ1 ), . . . , a ϕ2 ,
τ Nτ , . . . , a(
ϕ Na , τ1 ), . . . , a(
ϕ Na ,
τ Nτ ) , (21)
size of 90×N size of 90×N size of 90×N
τ τ τ
Aφτ = a τ1 , . . . , a
φ1 , φ1 ,
τ Nτ , a φ τ1 , . . . , a
2 , φ2 ,
τ Nτ , . . . , a φ τ1 , . . . , a
Na , φ Na ,
τ Nτ . (22)
size of 90×Nτ size of 90×Nτ size of 90×Nτ
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
ZHANG AND WANG: 3D-WiFi: 3D LOCALIZATION WITH COMMODITY WiFi 5147
Fig. 5. Joint AOA and equivalent TOA estimations with one uniform linear
subarray. (a) Sparse reconstruction using one CSI measurement. (b) Subspace-
based sparse reconstruction using 50 CSI measurements with finer accuracy
in a fusion method.
where HSV1 and H2 are the sizes of 90×L that are effectively
SV
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
5148 IEEE SENSORS JOURNAL, VOL. 19, NO. 13, JULY 1, 2019
Fig. 7. 3D localization examples in two indoor scenarios. (a) Lobby, z = 0.6m. (b) Lobby, z = 1.2m. (c) Corridor, z = 0.6m. (d) Corridor, z = 1.2m.
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
ZHANG AND WANG: 3D-WiFi: 3D LOCALIZATION WITH COMMODITY WiFi 5149
L-shaped array. By clustering the sufficient azimuth and ele- Furthermore, the proposed 3D-WiFi localization system
vation AOA estimations from multiple CSI measurements, uses the off-the-shelf infrastructures without other auxil-
multipath signals in the indoor scenarios can be discriminated iary devices at low cost and can achieve a satisfied accu-
and the direct path can be identified for 3D localization. In racy at decimeter-level. Therefore, the favorable performance
the experimental evaluations, we evaluate the effectiveness of of 3D-WiFi localization system accomplishes an attractive
the proposed 3D-WiFi system and validate the localization tradeoff between location accuracy and infrastructure cost.
performance in different indoor scenarios.
Fig. 9 illustrates the cumulative distribution func-
B. Direct Path Identification Accuracy
tions (CDFs) of 3D localization errors in two indoor sce-
narios. From the results, we can discover that our proposed The azimuth and elevation AOA estimations are a key factor
3D-WiFi outperforms JATE-MUSIC in all scenarios. The of 3D localization with AOA measurements. We evaluate the
median localization errors of 3D-WiFi system are 0.78m and accuracy of AOA estimation by comparing the difference
1.06m in the lobby and the corridor, respectively. Compared between the ground truth AOA of direct path and the identified
with JATE-MUSIC, the median localization errors of the AOA of direct path with both 3D-WiFi and JATE-MUSIC.
proposed 3D-WiFi system reduce about 18% and 32% in the Fig. 10 illustrates the CDFs of 2D-AOA estimation errors
lobby and the corridor, respectively. These results of 3D-WiFi in the lobby scenario. With the proposed 3D-WiFi system,
localization accuracy demonstrate the effectiveness of the pro- the median errors are 8.9◦ for the azimuth AOA and 6.7◦
pose 3D-WiFi localization system with AOA measurements on for the elevation AOA in the lobby, respectively. Compared
not only the designed hardware scheme, but also the azimuth with JATE-MUSIC, the proposed 3D-WiFi system reduces the
and elevation AOA estimation with subspace-based sparse median errors as 17% for the azimuth AOA estimation and
reconstruction. Therefore, the proposed 3D-WiFi localization 23% for the elevation AOA estimation, respectively. In the
system can achieve good localization performance in indoor corridor, Fig. 11 illustrates the CDFs of 2D-AOA estimation
scenarios. errors. The proposed 3D-WiFi system realizes an improvement
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
5150 IEEE SENSORS JOURNAL, VOL. 19, NO. 13, JULY 1, 2019
Fig. 11. CDFs of 2D-AOA estimation errors in the corridor scenario. Fig. 12. Impact of the deployment density. (a) Lobby. (b) Corridor.
(a) Azimuth AOA estimation. (b) Elevation AOA estimation.
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
ZHANG AND WANG: 3D-WiFi: 3D LOCALIZATION WITH COMMODITY WiFi 5151
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app
5152 IEEE SENSORS JOURNAL, VOL. 19, NO. 13, JULY 1, 2019
[27] Y. Xie, Z. Li, and M. Li, “Precise power delay profiling with commodity [38] A. Nemirovski and A. Ben Tal, Lectures Modern Convex Optimization:
WiFi,” in Proc. ACM Int. Conf. Mobile Comput. Netw., Paris, France, Analysis, Algorithms, Engineering Applications. Philadelphia, PA, USA:
Sep. 2015, pp. 53–64. SIAM, 2001.
[28] Y. Xie, Y. Zhang, J. C. Liando, and M. Li, “SWAN: Stitched Wi-Fi [39] D. Halperin, W. Hu, A. Sheth, and D. Wetherall, “Tool release: Gath-
ANtennas,” in Proc. ACM Int. Conf. Mobile Comput. Netw. New Delhi, ering 802.11n traces with channel state information,” ACM SIGCOMM
India, Oct. 2018, pp. 51–66. Comput. Commun. Rev., vol. 41, no. 1, p. 53, Jan. 2011.
[29] J. Gjengset, J. Xiong, G. McPhillips, and K. Jamieson, “Phaser: Enabling
phased array signal processing on commodity WiFi access points,”
in Proc. ACM Int. Conf. Mobile Comput. Netw. Honolulu, HI, USA, Lingyan Zhang received the B.S. degree from the
Sep. 2014, pp. 153–164. Nanjing University of Technology, Nanjing, China,
[30] R. Schmidt, “Multiple emitter location and signal parameter estima- in 2007, and the M.S. degree from the Shenzhen
tion,” IEEE Trans. Antennas Propag., vol. AP-34, no. 3, pp. 276–280, Graduate School, Harbin Institute of Technology,
Mar. 1986. Shenzhen, China, in 2010. She is currently pursuing
[31] J. M. Kim, O. K. Lee, and J. C. Ye, “Compressive MUSIC: Revisiting the Ph.D. degree with the Department of Electri-
the link between compressive sensing and array signal processing,” IEEE cal Engineering, Dalian University of Technology,
Trans. Inf. Theory, vol. 58, no. 1, pp. 278–301, Jan. 2012. Dalian, China. Her research interests include wire-
[32] I. Bilik, “Spatial compressive sensing for direction-of-arrival estimation less localization and wireless sensor networks.
of multiple sources using dynamic sensor arrays,” IEEE Trans. Aeros.
Elect. Syst., vol. 47, no. 3, pp. 1754–1769, Jul. 2011.
[33] D. Malioutov, M. Cetin, and A. S. Willsky, “A sparse signal reconstruc-
tion perspective for source localization with sensor arrays,” IEEE Trans.
Signal Process., vol. 53, no. 8, pp. 3010–3022, Aug. 2005. Hongyu Wang (M’03) received the B.S. degree in
[34] E. J. Candes and M. B. Wakin, “An introduction to compressive electronic engineering from the Jilin University of
sampling,” IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21–30, Technology in 1990, the M.S. degree in electronic
Mar. 2008. engineering from the Graduate School of the Chi-
[35] S. Kumar, E. Hamed, D. Katabi, and L. E. Li, “LTE radio analytics made nese Academy of Sciences in 1993, and the Ph.D.
easy and accessible,” in Proc. ACM Int. Conf. SIGCOMM. Chicago, IL, degree in precision instrument and optoelectronics
USA, Aug. 2014, pp. 211–222. engineering from Tianjin University in 1997.
[36] D. L. Donoho and M. Elad, “Optimally sparse representation in general He is currently a Professor with the Dalian Uni-
(nonorthogonal) dictionaries via 1 minimization,” Nat. Acad. Sci., versity of Technology. He serves as the Dean of
vol. 100, no. 5, pp. 2197–2202, Mar. 2003. the School of Information and Communication Engi-
[37] M. Lobo, L. Vandenberghe, S. Boyd, and H. Lebret, “Applications neering. His research interests include algorithmic,
of second-order cone programming,” Linear Algebra Appl., vol. 284, optimization, and performance issues in wireless ad hoc, mesh, and sensor
nos. 1–3, pp. 193–228, 1998. networks.
horized licensed use limited to: AMRITA VISHWA VIDYAPEETHAM AMRITA SCHOOL OF ENGINEERING. Downloaded on September 24,2024 at 09:40:23 UTC from IEEE Xplore. Restrictions app