Professional Documents
Culture Documents
Freetrack: Device-Free Human Tracking With Deep Neural Networks and Particle Filtering
Freetrack: Device-Free Human Tracking With Deep Neural Networks and Particle Filtering
Freetrack: Device-Free Human Tracking With Deep Neural Networks and Particle Filtering
Abstract—Human tracking is of key importance to a variety of device-free localization and tracking include radar-based sys-
applications. Different from the previous approaches requiring the tems and vision-based systems. These systems, however, require
targets to carry electronic devices, this paper proposes a device-free
specialized hardware and high cost. Due to ubiquitous de-
tracking method based on WiFi channel state information (CSI)
through deep neural networks (DNN) and particle filtering (PF). In ployment and non-line-of-sight (NLOS) coverage, device-free
the area covered with WiFi, human movements may cause observ- localization, and tracking based on WiFi have gained increasing
able variations of WiFi signals. By analyzing the CSI fingerprint attention recently. Research showed that received signal strength
patterns and modeling the dependency between CSI fingerprints indication (RSSI) could be used to achieve device-free localiza-
and locations through DNN, the proposed method is able to local- tion [1], as RSSI was affected by human movements. However,
ize the targets according to the measured CSI fingerprints through
DNN regression. Localization with DNN is accurate for static tar- complexity of indoor environments, due to shadow fading, mul-
gets, yet unable to form reasonable trajectories of moving targets. tipath propagation, blockage, etc., causes instability and dec-
This paper proposes to apply PF on DNN localization results and lination of localization performance with RSSI. Channel state
form the walking trajectories of the targets. To avoid the trajecto- information (CSI) is a fine-grained measurement from the phys-
ries to cross obstacles, map matching is integrated to constrain the ical layer that describes the amplitude and phase of each orthog-
unreasonable transfer of particles, which further improves the pre-
cision of trajectories. To combat with environmental variants, fine onal subcarrier in a channel. Research showed that WiFi CSI
tuning on DNN is proposed to enhance the adaptivity of the method. provided the capability to benefit from the multipath effect,
Extensive evaluations in two representative scenarios with only one thus was suitable for accurate localization [2], [3]. An increas-
pair of WiFi transmitter and receiver achieve the high accuracy of ing number of research have been conducted in the field of
around half a meter and precise trajectories as well as adaptation CSI-based localization in a device-based [1], [3]–[7] or device-
to environmental variants.
free [2], [8]–[13] way. These works mainly used signal propa-
Index Terms—Channel state information, deep neural network, gation models or fingerprint classification methods. Due to the
device-free tracking, fine tuning, map matching, particle filtering. complexity of indoor environments, it is difficult to establish
accurate signal propagation models, hence CSI fingerprinting
outperforms propagation models [3].
I. INTRODUCTION
Traditional classification algorithms such as Bayesian classi-
OCALIZATION and tracking have been the focus of re-
L search for years. Accurate information on location and tra-
jectory helps enhance building management as well as provides
fier and support vector machines (SVM) can make good use of
training data, but they belong to the category of shallow learn-
ing, which has limits on fully exploiting the training data, needs
appropriate information at right locations. A common solution professional experiences to tune the models, and is subjective
to these problems is to pinpoint the mobile devices carried by the on feature selection. Deep neural networks (DNN) imitate the
targets in WiFi infrastructures, thanks to pervasiveness of wire- signal transition process of neurons, are able to approximate ar-
less signals. Such a solution requires the active participation of bitrary mathematical functions, and extract features from the
mobile devices in order to be localized. However, on many oc- input implicitly thus avoiding manual and subjective feature
casions, such as at home or in sensitive areas, the targets may selection. Recently there is a trend of employing deep learn-
not carry any electronic devices or power them off. Under such ing for fingerprint-based localization [4]–[7], [12]. These works
circumstances, device-free localization and tracking are in need, formulated fingerprinting as a classification problem and deter-
which detect and track the targets that do not carry any electronic mined the target location as the reference point (RP) with the
devices nor participate actively in the process. Approaches to most similar fingerprint or the average of a group of RPs with
similar fingerprints. Fingerprinting through classification treats
localization as a discrete problem, while localization is by na-
Manuscript received November 29, 2018; revised May 7, 2019; accepted June ture a continuous problem estimating the coordinates, which
2, 2019. (Corresponding author: Rui Zhou.) can be solved by regression. Research proved by experiment
R. Zhou, M. Tang, and Z. Gong are with the School of Information
and Software Engineering, University of Electronic Science and Technol- that SVM regression (SVR) achieved better performance than
ogy of China, Sichuan Sheng 610054, China (e-mail: ruizhou@uestc.edu.cn; SVM classification and Bayesian classifier with respect to lo-
649529440@qq.com; 1455771801@qq.com). calization [13]. Although these approaches provide solutions
M. Hao is with the College of Computer Science and Technology, Zhejiang
University, Zhejiang Sheng 310027, China (e-mail: 452868118@qq.com). to accurate localization, when it comes to tracking moving hu-
Digital Object Identifier 10.1109/JSYST.2019.2921554 mans, the accuracy degrades significantly. There are only a few
1937-9234 © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
solutions tackling this issue by making use of CSI ampli- A. Localization with CSI
tude [14], [15] or Doppler effect [16], [17]. The FILA [1] system was claimed to be the first to use CSI
Summarizing the aforementioned works, the following chal- for device-based indoor localization. It developed a refined in-
lenges still exist: 1) the features are selected manually which is
door propagation model representing the relationship between
difficult and subjective; 2) moving human tracking is inaccurate CSI values and distances and applied trilateration to accomplish
and the estimated trajectories may be unreasonable; 3) it is diffi- localization. Wu et al. [3] extended the FILA system with a CSI-
cult to adapt to environmental variants. So to tackle these issues,
based fingerprinting approach using maximum likelihood algo-
we propose a device-free human tracking method, called Free- rithm, achieving an improved accuracy. Abdel-Nasser et al. [2]
Track, exploiting WiFi CSI amplitude information. The method introduced MonoPHY as a single stream device-free localiza-
treats localization as a regression problem and employs DNN
tion system, which used cluster-based CSI fingerprinting with
to model the dependency between CSI fingerprints and location maximum likelihood. MonoStream [8] enhanced MonoPHY and
coordinates. The inputs to the DNN model are the CSI finger-
modeled localization as an object recognition problem and ex-
prints and the outputs are the two-dimensional (2-D) location
tracted features that could capture small variations in the effect of
coordinates. In order to generate precise trajectories of walking human standing at different locations on the CSI vectors. To mit-
humans, the method applies particle filtering (PF) on the DNN
igate the issue of prior training, LiFS [9] estimated the locations
localization results to correlate consecutive location estimations
by modeling the CSI measurements of multiple wireless links as
and integrates map matching to constrain the transfer of particles a set of power fading-based equations and only the subcarriers
to avoid crossing obstacles (such as a large furniture). To combat
affected by multipath were utilized for localization. By detect-
with environmental variants, we propose to apply fine tuning on
ing the subtle reflection signals from the human body and further
the DNN localization model, which proves to be effective. Eval- differentiating them from those reflected signals from static ob-
uations of FreeTrack in two representative scenarios achieve the
jects, MaTrack [10] identified the target’s angle and tracked the
mean distance error of about half a meter and precise trajecto- walking human without prior training. Qian et al. [11] proposed
ries, outperforming the state-of-the-art. The main contributions Widar that simultaneously estimated human moving velocities
of the paper are summarized as follows.
and locations by modeling the relationships between CSI dy-
1) Propose an accurate device-free human tracking method namics and locations and velocities exploiting Doppler shifts.
FreeTrack, exploiting WiFi CSI amplitude fingerprints. Han et al. [19] proposed S-Phaser that utilized calibrated CSI
2) Apply DNN to model the dependency between CSI fin-
phase to compute the direct path length between an Access Point
gerprints and location coordinates and realize accurate (AP) and terminals and used a geometric positioning algorithm
localization through DNN regression, outperforming to determine the target location.
commonly used classification algorithms.
3) Apply PF on the DNN localization results to form precise
trajectories of moving humans, in which the state model B. Localization With Deep Learning
and the observation model are for free moving. To fully exploit the training data and avoid subjective manual
4) Integrate map matching to PF to constrain the transfer of feature selection, there is a trend of employing deep learning
particles and solve the obstacle crossing problem, in order for WiFi CSI fingerprinting. Wang et al. presented two device-
to form the reasonable trajectories. based fingerprinting systems: DeepFi [4] using CSI amplitude
5) Apply fine tuning on the DNN model to tackle environ- information and PhaseFi [5] using calibrated CSI phase infor-
mental variants and reduce recalibration efforts. mation. Deep learning was utilized to train the weights of a deep
This paper is an extension of our previous work presented in neural network as fingerprints and then a Bayesian probabilis-
[18]. We have significantly improved that paper in the following tic algorithm based on Radial Basis Function (RBF) was used
aspects: 1) adopt PF and map matching to continuously track to estimate the location. Wang et al. proposed CiFi [6] which
moving humans; 2) adopt fine tuning to enhance adaptivity; 3) used deep convolutional neural networks (DCNN) for device-
new evaluations were carried out to verify the tracking method. based localization. They extracted CSI phase information and
The remainder of the paper is organized as follows. The related estimated angle of arrival (AOA) using phase differences, which
work is first reviewed briefly in Section II. Section III presents was used to create AOA images as input to train the weights in
the preliminary of CSI and the rationale behind localization and the DCNN. The location of a mobile device was estimated based
tracking. Section IV proposes the device-free tracking method on the trained DCNN and new CSI AOA images with a prob-
based on DNN regression and PF with map matching as well as abilistic method as a weighted average of selected candidate
fine tuning in details. Evaluations and comparisons are reported locations. Chen et al. [7] proposed ConFi using convolutional
in Section V. Section VI concludes the paper. neural network (CNN) for device-based localization. CSI am-
plitude information was organized into a time-frequency matrix
that resembled image as the feature for localization. The loca-
II. RELATED WORK tion was calculated as the weighted centroid of the RPs with high
Indoor localization and tracking have gained a great deal of output value. Gao et al. [12] proposed device-free localization
attention in the recent decades. Our interests are in WiFi-based and activity recognition by exploiting a radio image processing
solutions, in particular, the state-of-the-art of localization and approach to characterize the influence of human behaviors on
tracking with CSI and deep learning. WiFi signals. They transformed CSI amplitude and phase into
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 3
ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 5
keeping the particles with larger weights and discarding the ones Fig. 5. Fine tuning of DNN localization model.
with less weights.
The weights are updated according to the new observation.
By using the reachability factor cik , if there is a direct path from
The particles that are nearer to the new observation are regarded
the last state (xik−1 , yk−1
i
) to the current state (xik , yki ) of the
more important and assigned larger weights. Hence we update
particle i, the transfer is possible, otherwise the transfer is for-
the weights with a Gaussian distribution, in which the centroid
bidden. After map matching, the obstacle crossing problem can
is the new observation and the input is the distance between the
be reduced significantly, as Fig. 7(d) illustrates.
particle and the new observation
1 d2
E. Fine Tuning to Fit Environmental Variants
ω̄ki = √ e− 2σ
i
(9)
2πσ DNN perform well on the assumption that the training and
wherein σ is the covariance of the observations, di is the distance testing data are from the same domains, with same feature spaces
between the particle sik = (xik , yki ) and the new observation zk = and same probability distributions. A DNN model trained in a
(xzk , ykz ), calculated as domain may not perform well in a different domain. For WiFi-
based localization and tracking, the environment may have vari-
di = (xik − xzk )2 + (yki − ykz )2 . (10) ants, such as different people and different walking styles, which
The updated weights are then normalized as cause differences in probability distribution. Consequently, the
DNN model needs to be rebuilt from the scratch in the varied
ω̄ i environment. However, it is expensive to recalibrate the model,
ωki = np k . (11)
j=1 ω̄kj as a large number of WiFi fingerprints need to be collected and
labeled.
5) System State Update: After updating the states and
To reduce the recalibration effort, we propose to adapt the
weights of the particles, the system state sk is updated as
DNN model trained in the source domain to the target domain
np
xk xik by means of fine tuning. Assume D = {F, P (F )} represents
i
sk = = ωk . (12) a domain, in which F represents the feature space and P (F )
yk yki
i=1 represents the probability distribution. Its task T = {C, f (·)}
The current location of the human is (xk , yk ). consists of a label space C and a prediction function f (·),
which predicts the label f (r) ∈ C of a new sample r ∈ F . The
D. Map Matching DNN model is trained to approximate f (·), by learning from
the training data. Suppose the source domain data are denoted
PF solves the sequential problem of locations, thus can pro-
as Ds = {(r1s , cs1 ), . . . , (rns s , csns )} and the target domain data
duce relatively precise trajectories. However, the trajectories
are denoted as Dt = {(r1t , ct1 ), . . . , (rnt t , ctnt )}, where ris and rit
may still cross the obstacles, as Fig. 7(c) shows, which should
represent the features (CSI fingerprints), csi and cti represent the
be corrected. We propose to apply map matching to solve the
labels (location coordinates). Given Ds , T s , and Dt , the objec-
obstacle crossing problem. The basic idea is to constrain the
tive of adaptation is to improve the learning effect of f (·) in T t
transfer of the particles by exploiting the indoor digital map.
based on Dt using the knowledge in Ds and T s [24].
During the update of the particle state and weight, we evaluate
We first establish the DNN localization model approximat-
the possibility of the transfer between the last state (xik−1 , yk−1
i
)
i i ing f (·) with the training set in the source domain Ds . For
to the current state (xk , yk ). If the transfer crosses an obstacle,
each environmental variant, we consider it as a target domain,
as Fig. 4 illustrates, the line segment connecting (xik , yki ) and
for example, a different walking style is regarded as a target
(xik−1 , yk−1
i
) crosses the obstacle, we set its reachability factor
domain, a different person is regarded as another target do-
ck as 0, otherwise cik is set as 1. The updated weight ω̄ki is then
i
main. For each target domain, we collect a small number mt
adjusted as
(mt << ns and mt << nt ) of new training samples to con-
ω̌ki = ω̄ki · cik (13) stitute the target domain data Dt = {(r1t , ct1 ), . . . , (rm t
t
, ctmt )},
t
in which ri = (h1 , h2 , . . . , hl ) represents the CSI fingerprint,
and then normalized as
cti = (x, y) represents the location coordinate. We apply the new
ω̌ i training data Dt on the DNN localization model built with the
ωki = np k . (14)
j=1 ω̌kj source domain data Ds and retrain the DNN model to adjust the
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 7
Fig. 6. Evaluation scenarios. The dashed lines are the walking routes. (a) Laboratory. (b) Laboratory. (c) Hall. (d) Hall.
neuron weights and biases, as shown in Fig. 5, thus to tune the TABLE I
TRACKING ACCURACY OF FREETRACK
source model to fit the environmental variants.
V. EVALUATIONS
A. Experimental Setup
The infrastructure of device-free human tracking is composed
of a WiFi transmitter and a WiFi receiver, both can be com-
modity wireless devices supporting OFDM and MIMO. The
experiments were conducted in two representative scenarios: a
cluttered research laboratory (6 m × 8 m) and an empty hall
(5 m × 5 m), as shown in Fig. 6. In each testbed, we em-
ployed two laptops equipped with Intel Wireless Link 5300 The learning rate is set as 10−4 . 100 particles are used to ap-
(IWL5300), one acting as transmitter and the other as receiver, proximate the system state. We use three metrics to analyze the
working in 5-GHz band, each with three antennas. The firmware tracking performance: 1) accuracy represents the mean distance
and driver of IWL5300 were modified to export CSI from each error between the true locations and the estimated locations; 2)
packet to the upper layers [20], which contains 30 groups of standard deviation represents the standard deviation of distance
subcarriers. errors; and 3) precision represents the cumulative distribution
1) Research Laboratory: The CSI data were extracted from function (CDF) of distance errors.
the packets sent from the transmitter to the receiver during which 1) Research Laboratory: The tracking results in the research
the volunteer traversed the area. The walking route is shown in laboratory are shown in Table I and Fig. 7. Table I lists the accu-
Fig. 6(b) as the dashed lines. For training, the route was walked racy and the standard deviation of distance errors. Our method
20 times, each with about 240 samples, thus about 4800 training FreeTrack (DNN with PF and map) achieves the accuracy of
samples altogether. For testing, the route was walked once, with 54 cm and the standard deviation of 58 cm. DNN achieves the
240 testing samples. accuracy of 86 cm. Combining with PF, the accuracy is improved
2) Hall: The CSI data were collected from the packets sent by 33.7% to 57 cm. By integrating map matching, the accuracy is
from the transmitter to the receiver during which the volun- improved further by 5.3% to 54 cm. Fig. 7(a) illustrates the pre-
teer traversed the area. The three walking routes are shown in cision of tracking, in which FreeTrack outperforms DNN with
Fig. 6(d) as the dashed rectangles. For training, the large outside PF, which outperforms DNN. The distance error of FreeTrack
rectangle was walked 32 times, each with about 630 samples; is within 20 cm with the probability of 29%, within 50 cm 75%,
the medium middle rectangle was walked 15 times, each with within 80 cm 89% and within 1 m 93%. The tracking trajectories
about 480 samples, and the small inside rectangle was walked 15 are illustrated in Fig. 7(b)–(d). As shown in Fig. 7(b), DNN can-
times, each with about 320 samples, altogether more than 32 000 not form a trajectory due to point localization. Fig. 7(c) shows the
training samples. For testing, each of the three routes was walked trajectory formed by DNN with PF, which improves the accuracy
once, with 633, 477, and 313 testing samples, respectively. The significantly and forms a relatively correct trajectory. Fig. 7(d)
localization model of the hall was trained with all the training shows the trajectory formed by FreeTrack, which improves the
samples and tested with the three routes of testing samples. performance further by removing the obstacle crossing problem.
2) Hall: The tracking results in the hall are shown in Table I
and Fig. 8. Since the hall is an empty space, map matching is
B. Tracking Performance not integrated. Table I lists the accuracy and the standard devi-
Through the training of the DNN localization model, an opti- ation of distance errors of walking the large outside rectangle.
mal set of parameters is identified. The DNN localization model FreeTrack achieves the accuracy of 54 cm and the standard de-
has 5 hidden layers with [256, 512, 1024, 512, 256] neurons. viation of 31 cm. Compared with DNN, the tracking accuracy
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
Fig. 7. Tracking precision and trajectories in the research laboratory. (a) Precision. (b) DNN. (c) DNN+PF. (d) DNN+PF+Map.
Fig. 8. Tracking precision and trajectories in the hall. (a) Precision. (b) Large rectangle. (c) Medium rectangle. (d) Small rectangle.
Fig. 9. Tracking precision and trajectories of random routes. (a) Precision. (b) Ground truth. (c) N-shape. (d) V-shape.
is improved by 5.3% from 57 to 54 cm. Fig. 8(a) illustrates form relatively precise trajectories. Table I lists the accuracy and
the tracking precision of the large outside rectangle, in which the standard deviation of distance errors of the two routes. For
FreeTrack outperforms DNN. The distance error of FreeTrack the N-shape route, FreeTrack achieves the accuracy of 85 cm
is within 20 cm with the probability of 28%, within 50 cm 64%, and the standard deviation of 52 cm. Compared with DNN, the
within 80 cm 85% and within 1 m 90%. The tracking trajectories accuracy is improved by 29.2%. For the V-shape route, Free-
of all the three routes formed by DNN and DNN with PF are il- Track achieves the accuracy of 78 cm and the standard devia-
lustrated in Fig. 8(b)–(d), in which Fig. 8(b) shows the estimated tion of 55 cm. Compared with DNN, the accuracy is improved by
trajectories of the outside route, Fig. 8(c) shows the trajectories 27.8%. Fig. 9(a) plots the precision of the two random routes, in
of the middle route and Fig. 8(d) shows the trajectories of the which FreeTrack outperforms DNN significantly for both routes.
inside route, by DNN and DNN with PF, respectively. For all For the N-shape route, the distance error of FreeTrack is within
the three routes, DNN localization cannot form reasonable tra- 20 cm with the probability of 4%, within 50 cm 31%, within
jectories due to point localization, while DNN with PF can form 80 cm 54% and within 1 m 63%. For the V-shape route, the
relatively precise trajectories. distance error of FreeTrack is within 20 cm with the probabil-
3) Random Routes: We also conducted experiments of ran- ity of 3%, within 50 cm 21%, within 80 cm 56% and within
dom walking in the hall, to evaluate the performance of Free- 1 m 76%.
Track on random routes that are not pretrained. The testing
routes are an N-shape route and a V-shape route, as shown in
Fig. 9(b), which are different from the training routes. The esti- C. Variants and Parameters
mated trajectories of them by FreeTrack are shown in Fig. 9(c) We investigate the impact of environmental variants and pa-
and (d). DNN localization cannot form reasonable trajectories rameters on the performance of tracking. Most comparisons
due to point localization, while FreeTrack (DNN with PF) can were made on the large rectangle route in the hall.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 9
Fig. 10. Tracking precision with different variants and parameters. (a) Walking style. (b) Human diversity. (c) Route diversity. (d) Walking distance. (e) Number
of antennas. (f) Sampling rate. (g) Training times of routes. (h) Number of particles.
D. Method Study
FreeTrack exploits DNN, PF, and map to track moving hu- of (43, 37, 37 cm) for the three routes illustrated in Fig. 6(d),
mans. To investigate the impact of each component, we sep- while DNN with PF (empty hall without map) achieves (54,
arately replace DNN with SVM regression, replace PF with 21, 36 cm). As we model the tracking problem as a linear sys-
Kalman Filtering (KF), replace CSI with RSSI, and compare tem, both PF and KF can solve the problem well, hence the
them with FreeTrack. Finally we compare FreeTrack with the performance of PF and KF are comparable. But in complicated
state-of-the-art. The comparisons were made on the route in the scenarios such as cluttered rooms, with the aid of maps, PF out-
laboratory and the large rectangle route in the hall. performs KF.
1) Compare With SVM: SVM is a classic statistical tool for 3) Compare With RSSI: RSSI is a commonly used measure-
classification and regression. We replace DNN regression with ment of signal quality, characterizing the overall received signal
SVM regression, and apply SVR with PF and map to track the power in a channel. We replace CSI with RSSI and apply the
moving human using the same training and testing datasets. The same method to track the moving human. The tracking results
tracking results in the laboratory and in the hall are illustrated are illustrated in Fig. 11 and Table III. RSSI achieves an accu-
in Fig. 11 and Table III. SVR with PF and map achieves an racy of 198 cm in the laboratory and 274 cm in the hall, both
accuracy of 79 cm in the laboratory and 74 cm in the hall, both are far less accurate than CSI, as RSSI is a coarse measurement
are less accurate than FreeTrack. unable to deal with multipath. Hence compared with RSSI, CSI
2) Compare With Kalman Filtering: Kalman Filtering is a is more appropriate for human tracking.
widely adopted filtering tool. We replace PF with Kalman Fil- 4) Compare With State-of-the-Art: We compare our method
tering and apply DNN with KF (cannot integrate map matching) FreeTrack (DNN with PF with map) with the method proposed
to track the moving human using the same datasets. The tracking by Shi et al. [14], which applied the Bayesian probabilistic al-
results are illustrated in Fig. 11 and Table III. In the laboratory gorithm based on CSI fingerprint to infer locations and contin-
DNN with KF achieves an accuracy of 70 cm, worse than DNN uously tracked the trajectory of a moving human with Bayesian
with PF and map. In the hall DNN with KF achieves an accuracy filtering. We reimplemented the method of Shi et al., which
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 11
achieves an accuracy of 100 cm in the laboratory and 76 cm in [12] Q. Gao, J. Wang, X. Ma, X. Feng, and H. Wang, “CSI-based device-free
the hall. FreeTrack outperforms it by a large margin, as shown wireless localization and activity recognition using radio image features,”
IEEE Trans. Veh. Technol., vol. 66, no. 11, pp. 10 346–10 356, 2017.
in Fig. 11 and Table III. [13] R. Zhou, X. Lu, P. Zhao, and J. Chen, “Device-free presence detection and
localization with SVM and CSI fingerprinting,” IEEE Sensors J., vol. 17,
VI. CONCLUSION no. 23, pp. 7990–7999, Dec. 2017.
[14] S. Shi, S. Sigg, L. Chen, and Y. Ji, “Accurate location tracking from CSI-
OFDM and MIMO enable to access fine-grained physical based passive device-free probabilistic fingerprinting,” IEEE Trans. Veh.
Technol., vol. 67, no. 6, pp. 5217–5230, Jun. 2018.
layer information of multiple links and individual subcarriers [15] C. R. Karanam, B. Korany, and Y. Mostofi, “Magnitude-based angle-
from commodity wireless devices, thus trigger the use of CSI of-arrival estimation, localization, and target tracking,” in Proc. 17th
to achieve accurate device-free localization and tracking. This ACM/IEEE Int. Conf. Inf. Process. Sensor Netw., Piscataway, NJ, USA,
2018, pp. 254–265.
paper presents a device-free human tracking method based on [16] X. Li et al., “IndoTrack: Device-free indoor human tracking with com-
CSI amplitude fingerprints with only one pair of commodity modity Wi-Fi,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.,
WiFi transmitter and receiver. By exploiting DNN, the features New York, NY, USA, 2017, vol. 1, no. 3, pp. 72:1–72:22.
[17] K. Qian, C. Wu, Y. Zhang, G. Zhang, Z. Yang, and Y. Liu, “Widar2.0:
are extracted automatically and human localization is accom- Passive human tracking with a single Wi-Fi link,” in Proc. 16th Annu. Int.
plished through 2-D regression. To track moving humans, PF Conf. Mobile Syst., Appl., Services, 2018.
integrated with map matching is applied on DNN localization, [18] R. Zhou, M. Hao, X. Lu, M. Tang, and Y. Fu, “Device-free localization
based on CSI fingerprints and deep neural networks,” in Proc. IEEE 15th
which proves effective in forming precise moving trajectories. Int. Conf. Sens., Commun. Netw., Hong Kong, China, Jun. 2018.
To combat with environmental variants, the DNN localization [19] S. Han, Y. Li, W. Meng, C. Li, T. Liu, and Y. Zhang, “Indoor localization
model is fine tuned with a small number of samples from the with a single Wi-Fi access point based on OFDM-MIMO,” IEEE Syst. J.,
vol. 13, no. 1, pp. 964–972, Mar. 2019.
varied environments. Evaluations demonstrate the effectiveness [20] D. Halperin, W. Hu, A. Sheth, and D. Wetherall, “Predictable 802.11 packet
of the method, achieving the tracking accuracy of about half delivery from wireless channel measurements,” in Proc. ACM SIGCOMM-
a meter and precise trajectories as well as easy adaptation to Conf., New Delhi, India, 2010, pp. 159–170.
[21] M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm
environmental variants. for discovering clusters in large spatial databases with noise,” in Proc. 2nd
Int. Conf. Knowl. Discovery and Data Mining, Portland, Oregon, 1996,
REFERENCES pp. 226–231.
[22] I. Jolliffe, Principal Component Analysis, 2nd ed. New York, NY, USA:
[1] K. Wu, J. Xiao, Y. Yi, M. Gao, and L. M. Ni, “FILA: Fine-grained in- Springer-Verlag, 2002.
door localization,” in Proc. IEEE INFOCOM, Orlando, FL, USA, 2012, [23] M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, “A tutorial
pp. 2210–2218. on particle filters for online nonlinear/non-Gaussian Bayesian tracking,”
[2] H. Abdel-Nasser, R. Samir, I. Sabek, and M. Youssef, “MonoPHY: Mono- IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174–188, Feb. 2002.
stream-based device-free WLAN localization via physical layer informa- [24] S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Trans. Knowl.
tion,” in Proc. IEEE Wireless Commun. Netw. Conf., Shanghai, China, Data Eng., vol. 22, no. 10, pp. 1345–1359, Oct. 2010.
2013, pp. 4546–4551.
[3] K. Wu, J. Xiao, Y. Yi, D. Chen, X. Luo, and L. M. Ni, “CSI-based indoor
localization,” IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 7, pp. 1300–
1309, Jul. 2013. Rui Zhou received the Ph.D. degree from the University of Freiburg, Germany,
[4] X. Wang, L. Gao, S. Mao, and S. Pandey, “CSI-based fingerprinting for in 2010.
indoor localization: A deep learning approach,” IEEE Trans. Veh. Technol., She is currently an Associate Professor with the University of Electronic
vol. 66, no. 1, pp. 763–776, Jan. 2017. Science and Technology of China, Sichuan Sheng, China. Her research interests
[5] X. Wang, L. Gao, and S. Mao, “CSI phase fingerprinting for indoor local- include pervasive computing, Internet of Things, and machine learning.
ization with a deep learning approach,” IEEE Internet Things J., vol. 3,
no. 6, pp. 1113–1123, Dec. 2016.
[6] X. Wang, X. Wang, and S. Mao, “CiFi: Deep convolutional neural net-
works for indoor localization with 5 GHz Wi-Fi,” in Proc. IEEE Int. Conf. Mingjie Tang is currently pursuing the B.S degree in the University of Electronic
Commun., Paris, France, 2017, pp. 1–6. Science and Technology of China, Sichuan Sheng, China.
[7] H. Chen, Y. Zhang, W. Li, X. Tao, and P. Zhang, “ConFi: Convolutional His research interests include localization and machine learning.
neural networks based indoor Wi-Fi localization using channel state infor-
mation,” IEEE Access, vol. 5, pp. 18 066–18 074, 2017.
[8] I. Sabek and M. Youssef, “MonoStream: A minimal-hardware high ac-
curacy device-free WLAN localization system,” Comput. Sci., eprint Ziyuan Gong received the B.S. degree from Southwest Jiaotong University,
arXiv:1308.0768, Aug. 2013. Sichuan Sheng, China, in 2018. He is currently working toward the M.S. degree
[9] J. Wang et al., “LiFS: Low human-effort, device-free localization with with the University of Electronic Science and Technology of China, Sichuan
fine-grained subcarrier information,” in Proc. 22nd Annu. Int. Conf. Mobile Sheng, China.
Comput. Netw., New York, NY, USA, 2016, pp. 243–256. His research interests include wireless sensing and machine learning.
[10] X. Li, S. Li, D. Zhang, J. Xiong, Y. Wang, and H. Mei, “Dynamic-MUSIC:
Accurate device-free indoor localization,” in Proc. Proc. ACM Int. Joint
Conf. Pervasive and Ubiquitous Comput., Heidelberg, Germany, 2016,
pp. 196–207. Meng Hao received the B.S. degree from the University of Electronic Science
[11] K. Qian, C. Wu, Z. Yang, C. Yang, and Y. Liu, “Decimeter level passive and Technology of China, Sichuan Sheng, China, in 2018. She is currently
tracking with WiFi,” in Proc. 3rd Workshop on Hot Topics in Wireless, pursuing the M.S. degree with Zhejiang University, Zhejiang Sheng, China.
New York, NY, USA, 2016, pp. 44–48. Her research interests include image processing and machine learning.