Freetrack: Device-Free Human Tracking With Deep Neural Networks and Particle Filtering

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

This article has been accepted for inclusion in a future issue of this journal.

Content is final as presented, with the exception of pagination.

IEEE SYSTEMS JOURNAL 1

FreeTrack: Device-Free Human Tracking With Deep


Neural Networks and Particle Filtering
Rui Zhou , Member, IEEE, Mingjie Tang, Ziyuan Gong, and Meng Hao

Abstract—Human tracking is of key importance to a variety of device-free localization and tracking include radar-based sys-
applications. Different from the previous approaches requiring the tems and vision-based systems. These systems, however, require
targets to carry electronic devices, this paper proposes a device-free
specialized hardware and high cost. Due to ubiquitous de-
tracking method based on WiFi channel state information (CSI)
through deep neural networks (DNN) and particle filtering (PF). In ployment and non-line-of-sight (NLOS) coverage, device-free
the area covered with WiFi, human movements may cause observ- localization, and tracking based on WiFi have gained increasing
able variations of WiFi signals. By analyzing the CSI fingerprint attention recently. Research showed that received signal strength
patterns and modeling the dependency between CSI fingerprints indication (RSSI) could be used to achieve device-free localiza-
and locations through DNN, the proposed method is able to local- tion [1], as RSSI was affected by human movements. However,
ize the targets according to the measured CSI fingerprints through
DNN regression. Localization with DNN is accurate for static tar- complexity of indoor environments, due to shadow fading, mul-
gets, yet unable to form reasonable trajectories of moving targets. tipath propagation, blockage, etc., causes instability and dec-
This paper proposes to apply PF on DNN localization results and lination of localization performance with RSSI. Channel state
form the walking trajectories of the targets. To avoid the trajecto- information (CSI) is a fine-grained measurement from the phys-
ries to cross obstacles, map matching is integrated to constrain the ical layer that describes the amplitude and phase of each orthog-
unreasonable transfer of particles, which further improves the pre-
cision of trajectories. To combat with environmental variants, fine onal subcarrier in a channel. Research showed that WiFi CSI
tuning on DNN is proposed to enhance the adaptivity of the method. provided the capability to benefit from the multipath effect,
Extensive evaluations in two representative scenarios with only one thus was suitable for accurate localization [2], [3]. An increas-
pair of WiFi transmitter and receiver achieve the high accuracy of ing number of research have been conducted in the field of
around half a meter and precise trajectories as well as adaptation CSI-based localization in a device-based [1], [3]–[7] or device-
to environmental variants.
free [2], [8]–[13] way. These works mainly used signal propa-
Index Terms—Channel state information, deep neural network, gation models or fingerprint classification methods. Due to the
device-free tracking, fine tuning, map matching, particle filtering. complexity of indoor environments, it is difficult to establish
accurate signal propagation models, hence CSI fingerprinting
outperforms propagation models [3].
I. INTRODUCTION
Traditional classification algorithms such as Bayesian classi-
OCALIZATION and tracking have been the focus of re-
L search for years. Accurate information on location and tra-
jectory helps enhance building management as well as provides
fier and support vector machines (SVM) can make good use of
training data, but they belong to the category of shallow learn-
ing, which has limits on fully exploiting the training data, needs
appropriate information at right locations. A common solution professional experiences to tune the models, and is subjective
to these problems is to pinpoint the mobile devices carried by the on feature selection. Deep neural networks (DNN) imitate the
targets in WiFi infrastructures, thanks to pervasiveness of wire- signal transition process of neurons, are able to approximate ar-
less signals. Such a solution requires the active participation of bitrary mathematical functions, and extract features from the
mobile devices in order to be localized. However, on many oc- input implicitly thus avoiding manual and subjective feature
casions, such as at home or in sensitive areas, the targets may selection. Recently there is a trend of employing deep learn-
not carry any electronic devices or power them off. Under such ing for fingerprint-based localization [4]–[7], [12]. These works
circumstances, device-free localization and tracking are in need, formulated fingerprinting as a classification problem and deter-
which detect and track the targets that do not carry any electronic mined the target location as the reference point (RP) with the
devices nor participate actively in the process. Approaches to most similar fingerprint or the average of a group of RPs with
similar fingerprints. Fingerprinting through classification treats
localization as a discrete problem, while localization is by na-
Manuscript received November 29, 2018; revised May 7, 2019; accepted June ture a continuous problem estimating the coordinates, which
2, 2019. (Corresponding author: Rui Zhou.) can be solved by regression. Research proved by experiment
R. Zhou, M. Tang, and Z. Gong are with the School of Information
and Software Engineering, University of Electronic Science and Technol- that SVM regression (SVR) achieved better performance than
ogy of China, Sichuan Sheng 610054, China (e-mail: ruizhou@uestc.edu.cn; SVM classification and Bayesian classifier with respect to lo-
649529440@qq.com; 1455771801@qq.com). calization [13]. Although these approaches provide solutions
M. Hao is with the College of Computer Science and Technology, Zhejiang
University, Zhejiang Sheng 310027, China (e-mail: 452868118@qq.com). to accurate localization, when it comes to tracking moving hu-
Digital Object Identifier 10.1109/JSYST.2019.2921554 mans, the accuracy degrades significantly. There are only a few

1937-9234 © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

2 IEEE SYSTEMS JOURNAL

solutions tackling this issue by making use of CSI ampli- A. Localization with CSI
tude [14], [15] or Doppler effect [16], [17]. The FILA [1] system was claimed to be the first to use CSI
Summarizing the aforementioned works, the following chal- for device-based indoor localization. It developed a refined in-
lenges still exist: 1) the features are selected manually which is
door propagation model representing the relationship between
difficult and subjective; 2) moving human tracking is inaccurate CSI values and distances and applied trilateration to accomplish
and the estimated trajectories may be unreasonable; 3) it is diffi- localization. Wu et al. [3] extended the FILA system with a CSI-
cult to adapt to environmental variants. So to tackle these issues,
based fingerprinting approach using maximum likelihood algo-
we propose a device-free human tracking method, called Free- rithm, achieving an improved accuracy. Abdel-Nasser et al. [2]
Track, exploiting WiFi CSI amplitude information. The method introduced MonoPHY as a single stream device-free localiza-
treats localization as a regression problem and employs DNN
tion system, which used cluster-based CSI fingerprinting with
to model the dependency between CSI fingerprints and location maximum likelihood. MonoStream [8] enhanced MonoPHY and
coordinates. The inputs to the DNN model are the CSI finger-
modeled localization as an object recognition problem and ex-
prints and the outputs are the two-dimensional (2-D) location
tracted features that could capture small variations in the effect of
coordinates. In order to generate precise trajectories of walking human standing at different locations on the CSI vectors. To mit-
humans, the method applies particle filtering (PF) on the DNN
igate the issue of prior training, LiFS [9] estimated the locations
localization results to correlate consecutive location estimations
by modeling the CSI measurements of multiple wireless links as
and integrates map matching to constrain the transfer of particles a set of power fading-based equations and only the subcarriers
to avoid crossing obstacles (such as a large furniture). To combat
affected by multipath were utilized for localization. By detect-
with environmental variants, we propose to apply fine tuning on
ing the subtle reflection signals from the human body and further
the DNN localization model, which proves to be effective. Eval- differentiating them from those reflected signals from static ob-
uations of FreeTrack in two representative scenarios achieve the
jects, MaTrack [10] identified the target’s angle and tracked the
mean distance error of about half a meter and precise trajecto- walking human without prior training. Qian et al. [11] proposed
ries, outperforming the state-of-the-art. The main contributions Widar that simultaneously estimated human moving velocities
of the paper are summarized as follows.
and locations by modeling the relationships between CSI dy-
1) Propose an accurate device-free human tracking method namics and locations and velocities exploiting Doppler shifts.
FreeTrack, exploiting WiFi CSI amplitude fingerprints. Han et al. [19] proposed S-Phaser that utilized calibrated CSI
2) Apply DNN to model the dependency between CSI fin-
phase to compute the direct path length between an Access Point
gerprints and location coordinates and realize accurate (AP) and terminals and used a geometric positioning algorithm
localization through DNN regression, outperforming to determine the target location.
commonly used classification algorithms.
3) Apply PF on the DNN localization results to form precise
trajectories of moving humans, in which the state model B. Localization With Deep Learning
and the observation model are for free moving. To fully exploit the training data and avoid subjective manual
4) Integrate map matching to PF to constrain the transfer of feature selection, there is a trend of employing deep learning
particles and solve the obstacle crossing problem, in order for WiFi CSI fingerprinting. Wang et al. presented two device-
to form the reasonable trajectories. based fingerprinting systems: DeepFi [4] using CSI amplitude
5) Apply fine tuning on the DNN model to tackle environ- information and PhaseFi [5] using calibrated CSI phase infor-
mental variants and reduce recalibration efforts. mation. Deep learning was utilized to train the weights of a deep
This paper is an extension of our previous work presented in neural network as fingerprints and then a Bayesian probabilis-
[18]. We have significantly improved that paper in the following tic algorithm based on Radial Basis Function (RBF) was used
aspects: 1) adopt PF and map matching to continuously track to estimate the location. Wang et al. proposed CiFi [6] which
moving humans; 2) adopt fine tuning to enhance adaptivity; 3) used deep convolutional neural networks (DCNN) for device-
new evaluations were carried out to verify the tracking method. based localization. They extracted CSI phase information and
The remainder of the paper is organized as follows. The related estimated angle of arrival (AOA) using phase differences, which
work is first reviewed briefly in Section II. Section III presents was used to create AOA images as input to train the weights in
the preliminary of CSI and the rationale behind localization and the DCNN. The location of a mobile device was estimated based
tracking. Section IV proposes the device-free tracking method on the trained DCNN and new CSI AOA images with a prob-
based on DNN regression and PF with map matching as well as abilistic method as a weighted average of selected candidate
fine tuning in details. Evaluations and comparisons are reported locations. Chen et al. [7] proposed ConFi using convolutional
in Section V. Section VI concludes the paper. neural network (CNN) for device-based localization. CSI am-
plitude information was organized into a time-frequency matrix
that resembled image as the feature for localization. The loca-
II. RELATED WORK tion was calculated as the weighted centroid of the RPs with high
Indoor localization and tracking have gained a great deal of output value. Gao et al. [12] proposed device-free localization
attention in the recent decades. Our interests are in WiFi-based and activity recognition by exploiting a radio image processing
solutions, in particular, the state-of-the-art of localization and approach to characterize the influence of human behaviors on
tracking with CSI and deep learning. WiFi signals. They transformed CSI amplitude and phase into
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 3

a radio image, extracted color and texture features, adopted a


deep learning network to learn optimized deep features, and esti-
mated location and activity of a person using a machine learning
approach.

C. Tracking With CSI


The aforementioned works are localization methods. They
perform well for single point localization, but may degrade
significantly for tracking moving targets and may not produce
Fig. 1. CSI exhibits different patterns at different locations. (a) Human at
precise moving trajectories. Li et al. [16] proposed a device- location A. (b) Human at location B.
free human tracking system IndoTrack, composed of Doppler-
MUSIC and Doppler-AoA. Doppler-MUSIC was to extract
accurate Doppler velocity information from WiFi CSI samples. The kth subcarrier in Hij can be expressed as
Doppler-AoA was to determine the trajectory of the target by
jointly estimating target velocity and location via probabilistic
comodeling of spatial-temporal Doppler and AoA information. hk = |hk |ej∠hk , k ∈ [1, Ns ] (3)
Qian et al. [17] presented Widar 2.0, a device-free human local-
ization and tracking system. They built a unified model account- here, |hk | is the amplitude and ∠hk is the phase of subcarrier
ing for AOA, time of flight (TOF), and Doppler shifts together k. The phase information contains significant random noise and
and devised an efficient algorithm for their joint estimation. They shifts, hence is difficult to be leveraged for wireless sensing.
then designed a pipeline to translate the erroneous raw parame- Therefore, we solely adopt CSI amplitude for human tracking.
ters into precise locations. Shi et al. [14] presented a device-free
tracking system which adopted CSI amplitude from multiple
pairs of WiFi devices. They applied a probabilistic fingerprint- B. Rationale of Localization
based technique using Bayes classifier for localization and ap- Due to slight frequency delta, separate subcarriers experi-
plied principal component analysis (PCA) to filter the most ence different multipath fading. When small movements have
relevant feature vectors. With Bayesian filtering they could altered the environment, the individual subcarrier measurements
continuously track the trajectory of a moving target. Karanam are more sensitive to the variations. CSI portrays a fine-grained
et al. [15] proposed to estimate the AoA of all the signal paths temporal and spectral structure of wireless channels and exhibits
arriving at a receiver array using only the corresponding received properties suitable for localization. Fig. 1 illustrates the proper-
signal magnitude measurements, based on the spatial correlation ties of CSI for device-free localization, in which the Packet axis
of them, and then utilized a particle filter to show how a moving represents the packets over time, the Subcarrier axis represents
target can be tracked. each subcarrier, and the Amplitude axis represents the amplitude
of each subcarrier over packets. Different colors represent dif-
III. CSI PRELIMINARY AND RATIONALES ferent amplitude levels. Fig. 1(a) and (b) show the amplitude of
subcarriers over time/packets when a human stands at two loca-
A. CSI Preliminary
tions one meter apart. The CSI amplitude patterns have obvious
CSI is fine-grained information from the physical layer differences between the two locations. Such properties of CSI in-
that describes channel frequency response (CFR) from the dicate that there is certain dependency between CSI fingerprints
transmitter to the receiver, due to orthogonal frequency divi- and locations, making it possible for accurate localization.
sion multiplexing (OFDM) and multiple-input multiple-output
(MIMO) techniques. Leveraging commodity network interface
card (NIC) with modified firmware and driver [20], the am- C. Issue of Tracking
plitude and phase of each subcarrier within a channel can be Localization is to estimate one single location, belonging to
revealed to the upper layers from each packet in the format of the category of point localization, without relating to the histori-
CSI. The raw data contain the number of transmitting antennas cal locations. Human moving is a consecutive process, in which
Ntx , the number of receiving antennas Nrx , packet transmis- each location is related to its precedents in time sequence. When
sion frequency f , and the CSI matrix H, which is a Ntx × Nrx applying point localization on a moving human, the estimated
matrix trajectory may be unreasonable. Fig. 6(b) shows a real walking
path and Fig. 7(b) shows the trajectory estimated by DNN local-
H = (Hij )Ntx ×Nrx (1)
ization. Although the localization accuracy is as high as 86 cm,
where Hij is the CSI of the channel formed by transmitting the trajectory formed by localization does not reflect the real tra-
antenna i and receiving antenna j, containing the information of jectory at all. Even worse, the estimated trajectory crosses the
Ns subcarriers, expressed as furniture many times. Therefore, we propose to apply PF to re-
late the current location estimation with the historical locations
Hij = (h1 , h2 , . . . , hNs ), i ∈ [1, Ntx ], j ∈ [1, Nrx ]. (2) and integrate the map information to avoid crossing obstacles.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

4 IEEE SYSTEMS JOURNAL

the highest possible variance and orthogonal to the preceding


components. PCA aims to find l (l < L) new variables, with
each one being a linear combination of the original variables,
so that the new variables can reveal the nature of the origi-
nal ones and compress them. Applying PCA on the CSI ma-
trix H, we obtain the transformation matrix T , the transformed
matrix S and the variable weights W = (w1 , w2 , . . . , wL ) in
descending order, wherein L is the dimension of the original
CSI fingerprint.
 The cumulative
 contribution rate Ci is defined
as Ci = ( ij=1 wj )/( L j=1 w j ). If Cl ≥ Cc , which means that
the cumulative contribution rate of the first l new variables equals
to or is greater than the predefined threshold Cc , we extract the
first l new variables as the contributing information. The first l
Fig. 2. Device-free human tracking with DNN and PF. rows of the transformed matrix S constitute the principal com-
ponent matrix R, which will be used as the CSI fingerprints for
the subsequent model training and tracking.
IV. DEVICE-FREE HUMAN TRACKING
The proposed method of device-free human tracking based on
B. Localization With DNN Regression
DNN and PF is illustrated in Fig. 2. The CSI fingerprints are first
retrieved from the packets sent from the WiFi transmitter to the Device-free localization is to estimate the location coordi-
receiver. The raw CSI fingerprints go through preprocessing and nates of the targets, without participation of mobile devices. It
are fed into the DNN model, which estimates the location co- can be solved as a regression problem by establishing the de-
ordinates through 2-D DNN regression. PF recursively updates pendency between CSI fingerprints and location coordinates.
the location according to the last location and the current loca- DNN have been proved to be very effective in implicit feature
tion estimation returned by DNN. Map matching is integrated extraction and have gained vast application in pattern recogni-
in PF to constrain the transfer of particles to directly reachable tion. We model the dependency between location coordinates
destinations and help form correct trajectories. and CSI fingerprints with DNN and formulate localization as
a regression problem. The inputs to the DNN model are the
A. CSI Fingerprint Preprocessing preprocessed CSI fingerprints and the outputs are the location
coordinates.
Raw CSI data contain noise and noncontributing information. Localization through DNN regression consists of the training
We apply the density-based spatial clustering of applications stage and the localization stage. In the training stage, a large
with noise (DBSCAN) algorithm to reduce the noise and apply number of CSI fingerprints are collected from a person at each
the PCA algorithm to extract the most contributing information RP in the area of interest. The DNN model is then trained by
from the raw CSI data. using the CSI fingerprints of all the RPs labeled with their loca-
1) Denoising: Raw CSI data have noise. We apply the DB- tion coordinates. Training of the DNN model is to determine the
SCAN algorithm to detect and reduce the noise. DBSCAN [21] structure of the deep neural network and the weights and biases
is a density-based clustering algorithm, which groups points that of the neurons. In the localization stage, the CSI fingerprint is
are closely packed together and marks as outliers that lie alone collected from the person at the unknown location. After prepro-
in low density regions. It does not require to specify the num- cessing, the CSI fingerprint is fed into the trained DNN model,
ber of clusters a priori and can be used to detect and reduce which outputs the 2-D location coordinate.
noise. Assume D represents the dataset of the raw CSI data, in Assume n is the number of the labeled training samples and
which each CSI fingerprint is regarded as a point, denoted as l denotes the dimensionality of a CSI fingerprint. Each labeled
p = (h1 , h2 , . . . , hi , . . . , hL ), where hi is the amplitude of sub- sample consists of a pair (ri , (xi , yi )), where ri ∈ Rl is a vector
carrier i and L = Ntx × Nrx × Ns is the number  of the subcar- representing a CSI fingerprint after preprocessing and (xi , yi ) ∈
i j L j 2
riers. The Euclidean distance d(p , p ) = i
k=1 (hk − hk ) R2 denotes the location coordinate where ri is measured. DNN
is used to measure the distance between two CSI fingerprints model training is to establish the DNN model using the training
for the purpose of clustering. The outliers are regarded as noise. dataset {(ri , (xi , yi ))|i = 1, 2, . . . , n}. Assume (r, (x, y)) is a
2) Contributing Information Extraction: Each CSI finger- testing sample, with r ∈ Rl representing the CSI fingerprint,
print has L = Ntx × Nrx × Ns dimensions. Each dimension localization is to determine the value of (x, y) by the trained
may have different contribution to localization, hence we ap- DNN model.
ply PCA to extract the most contributing information as well 1) Structure of DNN: We employ a fully connected deep
as to reduce the dimensionality. PCA [22] converts a set of neural network to fulfill the task of localization with CSI fin-
possibly correlated variables into a set of linearly uncorrelated gerprints. The DNN model has M fully connected hidden lay-
variables, called principal components, through orthogonal ers, plus one input layer, and one output layer, as shown in
transformation. The first principal component has the largest Fig. 3. Each hidden layer has k1 , k2 , . . . , ki , . . . , kM neurons,
possible variance, and each succeeding component in turn has respectively. The input to the DNN model is CSI fingerprint
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 5

of the dynamic system can be expressed as



sk = f (sk−1 ) + vk−1
(5)
zk = h(sk ) + wk
where sk represents the system state, zk represents the obser-
vation, f (·) and h(·) represent the state transition function and
the observation function of the dynamic system, vk and wk rep-
resent the system noise and the observation noise, respectively.
PF approximates the system state sk and the posterior distribu-
tion p(sk |z1:k ) with a set of particles in the state space, able
Fig. 3. Structure of DNN for device-free localization. to approximate any dynamic systems. Assume np denotes the
number of particles, {(sik , ωki )|i = 1, 2, . . . , np } represents the
set of particles at iteration k, in which sik represents the state of
r = (h1 , h2 , . . . , hl ), and the output of the DNN model is loca- particle i and ωki represents its weight. The system state sk and
tion coordinate (x, y), which is the result of 2-D DNN regres- its posterior distribution can be approximated by the particles:
sion. During training, the CSI fingerprints of all the RPs are fed  np i i
into the deep neural network in batches to train the weights and sk = i=1 ωk s k
np i (6)
biases of the neurons. During localization, the CSI fingerprint of p(sk |z1:k ) ≈ i=1 ωk δ(sk − sik )
the unknown location is fed into the deep neural network, which np i
outputs the 2-D location coordinate (x, y). in which δ is Kronecker delta function and i=1 ωk = 1.
2) Activation Function: The activation function introduces 2) Initialization of Particles: Suppose the set of particles at
nonlinearity into DNN and is an important factor in performance. iteration k is {(sik , ωki )|i = 1, 2, . . . , np }. As the system state sk
We choose Rectified Linear Units (ReLU) as the activation func- is location coordinate for the human tracking problem, the set of
tion, which is expressed as f (x) = max(0, x). particles at iteration k can be expressed as {((xik , yki ), ωki )|i =
3) Loss Function: We use the error loss function based on 1, 2, 3, . . . , np }, in which (xik , yki ) represents the state of parti-
back propagation to train the weights and biases of the neurons. cle i (i.e., the location coordinate) and ωki represents its weight.
The loss function is employed to measure the difference between Initial values of the particles are set to follow the Gaussian dis-
the ground truth and the output of the DNN model, which we tribution, with the mean value of z0 = (xz0 , y0z ), which is the first
define as the mean distance error location returned by DNN regression. The initial weight of each
m
particle is set as 1/np .
1  3) State Model and Observation Model: A person may walk
floss = (x̂i − xi )2 + (ŷi − yi )2 (4)
m i=1 indoors at any velocity. Without the aid of external equipments
to supply motion information, we model the system as free walk-
where m is the batch size, (xi , yi ) and (x̂i , ŷi ) represent the ing, i.e., the person may walk at any speed in any orientation.
true and the estimated coordinates of sample i, respectively. By As the sampling rate is not less than 10 Hz, the time interval
minimizing the value of floss , the neuron weights and biases are between two consecutive observations is not more than 0.1 s,
updated with adaptive moment estimation (Adam) algorithm, within which the person usually can walk not more than 0.2 m
until the value of floss converges. even in a fast pace. Hence, we assume that the location of it-
eration k equals to the location of iteration k−1, and model
the location change as system noise. The system state can be
C. Tracking With Particle Filtering modeled as
As aforementioned, point localization may not form reason-    
xk xk−1
able trajectories. For the problem of human tracking, we can treat sk = = +v (7)
the human moving as a stochastic process, in which we regard yk yk−1
the human location as the state of the dynamic system and regard
in which v represents the system noise assumed to be Gaussian.
the estimated location by DNN regression as the observation. We
We use the location (xz , y z ) estimated by DNN regression as
propose to apply PF to track the trajectory of a moving human.
the observation. Thus the observation model can be expressed
Suppose sk represents the system state (i.e., the human location)
as
at iteration k, suppose zk represents the observation (i.e., the es-  
timated location by DNN regression) at iteration k, PF [23] is to xzk
recursively estimate the posterior distribution p(sk |z1:k ) of the zk = . (8)
ykz
system state sk given the observations (z1 , z2 , . . . , zk ).
1) Particle Filtering: Filtering is applied widely in naviga- 4) Weights Update and Resampling: Each time a new ob-
tion, tracking, control, and information fusion. Its objective is to servation is obtained, i.e., a new location estimation is returned
estimate the state of a dynamic system from the noisy observa- by DNN, the particle weights are updated and normalized. The
tions with probabilistic tools. The state and observation models particles are then resampled according to the updated weights,
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

6 IEEE SYSTEMS JOURNAL

Fig. 4. Obstacle crossing of particles.

keeping the particles with larger weights and discarding the ones Fig. 5. Fine tuning of DNN localization model.
with less weights.
The weights are updated according to the new observation.
By using the reachability factor cik , if there is a direct path from
The particles that are nearer to the new observation are regarded
the last state (xik−1 , yk−1
i
) to the current state (xik , yki ) of the
more important and assigned larger weights. Hence we update
particle i, the transfer is possible, otherwise the transfer is for-
the weights with a Gaussian distribution, in which the centroid
bidden. After map matching, the obstacle crossing problem can
is the new observation and the input is the distance between the
be reduced significantly, as Fig. 7(d) illustrates.
particle and the new observation
1 d2
E. Fine Tuning to Fit Environmental Variants
ω̄ki = √ e− 2σ
i
(9)
2πσ DNN perform well on the assumption that the training and
wherein σ is the covariance of the observations, di is the distance testing data are from the same domains, with same feature spaces
between the particle sik = (xik , yki ) and the new observation zk = and same probability distributions. A DNN model trained in a
(xzk , ykz ), calculated as domain may not perform well in a different domain. For WiFi-
 based localization and tracking, the environment may have vari-
di = (xik − xzk )2 + (yki − ykz )2 . (10) ants, such as different people and different walking styles, which
The updated weights are then normalized as cause differences in probability distribution. Consequently, the
DNN model needs to be rebuilt from the scratch in the varied
ω̄ i environment. However, it is expensive to recalibrate the model,
ωki = np k . (11)
j=1 ω̄kj as a large number of WiFi fingerprints need to be collected and
labeled.
5) System State Update: After updating the states and
To reduce the recalibration effort, we propose to adapt the
weights of the particles, the system state sk is updated as
    DNN model trained in the source domain to the target domain
np
xk  xik by means of fine tuning. Assume D = {F, P (F )} represents
i
sk = = ωk . (12) a domain, in which F represents the feature space and P (F )
yk yki
i=1 represents the probability distribution. Its task T = {C, f (·)}
The current location of the human is (xk , yk ). consists of a label space C and a prediction function f (·),
which predicts the label f (r) ∈ C of a new sample r ∈ F . The
D. Map Matching DNN model is trained to approximate f (·), by learning from
the training data. Suppose the source domain data are denoted
PF solves the sequential problem of locations, thus can pro-
as Ds = {(r1s , cs1 ), . . . , (rns s , csns )} and the target domain data
duce relatively precise trajectories. However, the trajectories
are denoted as Dt = {(r1t , ct1 ), . . . , (rnt t , ctnt )}, where ris and rit
may still cross the obstacles, as Fig. 7(c) shows, which should
represent the features (CSI fingerprints), csi and cti represent the
be corrected. We propose to apply map matching to solve the
labels (location coordinates). Given Ds , T s , and Dt , the objec-
obstacle crossing problem. The basic idea is to constrain the
tive of adaptation is to improve the learning effect of f (·) in T t
transfer of the particles by exploiting the indoor digital map.
based on Dt using the knowledge in Ds and T s [24].
During the update of the particle state and weight, we evaluate
We first establish the DNN localization model approximat-
the possibility of the transfer between the last state (xik−1 , yk−1
i
)
i i ing f (·) with the training set in the source domain Ds . For
to the current state (xk , yk ). If the transfer crosses an obstacle,
each environmental variant, we consider it as a target domain,
as Fig. 4 illustrates, the line segment connecting (xik , yki ) and
for example, a different walking style is regarded as a target
(xik−1 , yk−1
i
) crosses the obstacle, we set its reachability factor
domain, a different person is regarded as another target do-
ck as 0, otherwise cik is set as 1. The updated weight ω̄ki is then
i
main. For each target domain, we collect a small number mt
adjusted as
(mt << ns and mt << nt ) of new training samples to con-
ω̌ki = ω̄ki · cik (13) stitute the target domain data Dt = {(r1t , ct1 ), . . . , (rm t
t
, ctmt )},
t
in which ri = (h1 , h2 , . . . , hl ) represents the CSI fingerprint,
and then normalized as
cti = (x, y) represents the location coordinate. We apply the new
ω̌ i training data Dt on the DNN localization model built with the
ωki = np k . (14)
j=1 ω̌kj source domain data Ds and retrain the DNN model to adjust the
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 7

Fig. 6. Evaluation scenarios. The dashed lines are the walking routes. (a) Laboratory. (b) Laboratory. (c) Hall. (d) Hall.

neuron weights and biases, as shown in Fig. 5, thus to tune the TABLE I
TRACKING ACCURACY OF FREETRACK
source model to fit the environmental variants.

V. EVALUATIONS
A. Experimental Setup
The infrastructure of device-free human tracking is composed
of a WiFi transmitter and a WiFi receiver, both can be com-
modity wireless devices supporting OFDM and MIMO. The
experiments were conducted in two representative scenarios: a
cluttered research laboratory (6 m × 8 m) and an empty hall
(5 m × 5 m), as shown in Fig. 6. In each testbed, we em-
ployed two laptops equipped with Intel Wireless Link 5300 The learning rate is set as 10−4 . 100 particles are used to ap-
(IWL5300), one acting as transmitter and the other as receiver, proximate the system state. We use three metrics to analyze the
working in 5-GHz band, each with three antennas. The firmware tracking performance: 1) accuracy represents the mean distance
and driver of IWL5300 were modified to export CSI from each error between the true locations and the estimated locations; 2)
packet to the upper layers [20], which contains 30 groups of standard deviation represents the standard deviation of distance
subcarriers. errors; and 3) precision represents the cumulative distribution
1) Research Laboratory: The CSI data were extracted from function (CDF) of distance errors.
the packets sent from the transmitter to the receiver during which 1) Research Laboratory: The tracking results in the research
the volunteer traversed the area. The walking route is shown in laboratory are shown in Table I and Fig. 7. Table I lists the accu-
Fig. 6(b) as the dashed lines. For training, the route was walked racy and the standard deviation of distance errors. Our method
20 times, each with about 240 samples, thus about 4800 training FreeTrack (DNN with PF and map) achieves the accuracy of
samples altogether. For testing, the route was walked once, with 54 cm and the standard deviation of 58 cm. DNN achieves the
240 testing samples. accuracy of 86 cm. Combining with PF, the accuracy is improved
2) Hall: The CSI data were collected from the packets sent by 33.7% to 57 cm. By integrating map matching, the accuracy is
from the transmitter to the receiver during which the volun- improved further by 5.3% to 54 cm. Fig. 7(a) illustrates the pre-
teer traversed the area. The three walking routes are shown in cision of tracking, in which FreeTrack outperforms DNN with
Fig. 6(d) as the dashed rectangles. For training, the large outside PF, which outperforms DNN. The distance error of FreeTrack
rectangle was walked 32 times, each with about 630 samples; is within 20 cm with the probability of 29%, within 50 cm 75%,
the medium middle rectangle was walked 15 times, each with within 80 cm 89% and within 1 m 93%. The tracking trajectories
about 480 samples, and the small inside rectangle was walked 15 are illustrated in Fig. 7(b)–(d). As shown in Fig. 7(b), DNN can-
times, each with about 320 samples, altogether more than 32 000 not form a trajectory due to point localization. Fig. 7(c) shows the
training samples. For testing, each of the three routes was walked trajectory formed by DNN with PF, which improves the accuracy
once, with 633, 477, and 313 testing samples, respectively. The significantly and forms a relatively correct trajectory. Fig. 7(d)
localization model of the hall was trained with all the training shows the trajectory formed by FreeTrack, which improves the
samples and tested with the three routes of testing samples. performance further by removing the obstacle crossing problem.
2) Hall: The tracking results in the hall are shown in Table I
and Fig. 8. Since the hall is an empty space, map matching is
B. Tracking Performance not integrated. Table I lists the accuracy and the standard devi-
Through the training of the DNN localization model, an opti- ation of distance errors of walking the large outside rectangle.
mal set of parameters is identified. The DNN localization model FreeTrack achieves the accuracy of 54 cm and the standard de-
has 5 hidden layers with [256, 512, 1024, 512, 256] neurons. viation of 31 cm. Compared with DNN, the tracking accuracy
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

8 IEEE SYSTEMS JOURNAL

Fig. 7. Tracking precision and trajectories in the research laboratory. (a) Precision. (b) DNN. (c) DNN+PF. (d) DNN+PF+Map.

Fig. 8. Tracking precision and trajectories in the hall. (a) Precision. (b) Large rectangle. (c) Medium rectangle. (d) Small rectangle.

Fig. 9. Tracking precision and trajectories of random routes. (a) Precision. (b) Ground truth. (c) N-shape. (d) V-shape.

is improved by 5.3% from 57 to 54 cm. Fig. 8(a) illustrates form relatively precise trajectories. Table I lists the accuracy and
the tracking precision of the large outside rectangle, in which the standard deviation of distance errors of the two routes. For
FreeTrack outperforms DNN. The distance error of FreeTrack the N-shape route, FreeTrack achieves the accuracy of 85 cm
is within 20 cm with the probability of 28%, within 50 cm 64%, and the standard deviation of 52 cm. Compared with DNN, the
within 80 cm 85% and within 1 m 90%. The tracking trajectories accuracy is improved by 29.2%. For the V-shape route, Free-
of all the three routes formed by DNN and DNN with PF are il- Track achieves the accuracy of 78 cm and the standard devia-
lustrated in Fig. 8(b)–(d), in which Fig. 8(b) shows the estimated tion of 55 cm. Compared with DNN, the accuracy is improved by
trajectories of the outside route, Fig. 8(c) shows the trajectories 27.8%. Fig. 9(a) plots the precision of the two random routes, in
of the middle route and Fig. 8(d) shows the trajectories of the which FreeTrack outperforms DNN significantly for both routes.
inside route, by DNN and DNN with PF, respectively. For all For the N-shape route, the distance error of FreeTrack is within
the three routes, DNN localization cannot form reasonable tra- 20 cm with the probability of 4%, within 50 cm 31%, within
jectories due to point localization, while DNN with PF can form 80 cm 54% and within 1 m 63%. For the V-shape route, the
relatively precise trajectories. distance error of FreeTrack is within 20 cm with the probabil-
3) Random Routes: We also conducted experiments of ran- ity of 3%, within 50 cm 21%, within 80 cm 56% and within
dom walking in the hall, to evaluate the performance of Free- 1 m 76%.
Track on random routes that are not pretrained. The testing
routes are an N-shape route and a V-shape route, as shown in
Fig. 9(b), which are different from the training routes. The esti- C. Variants and Parameters
mated trajectories of them by FreeTrack are shown in Fig. 9(c) We investigate the impact of environmental variants and pa-
and (d). DNN localization cannot form reasonable trajectories rameters on the performance of tracking. Most comparisons
due to point localization, while FreeTrack (DNN with PF) can were made on the large rectangle route in the hall.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 9

Fig. 10. Tracking precision with different variants and parameters. (a) Walking style. (b) Human diversity. (c) Route diversity. (d) Walking distance. (e) Number
of antennas. (f) Sampling rate. (g) Training times of routes. (h) Number of particles.

TABLE II 2) Human Diversity: To validate the impact of human diver-


TRACKING ACCURACY WITH DIFFERENT VARIANTS AND PARAMETERS
sity, three volunteers conducted the same experiments with the
same setup. The model is trained with one person (tester 1), and
tested with the other two persons (tester 2 and tester 3). As the
training set contains only the data of tester 1, the tracking perfor-
mance of tester 2 and tester 3 degrades. By applying fine tuning
on the DNN model with 5 training routes for each of the other
persons, the accuracy can achieve 63 cm for tester 2 and 72 cm
for tester 3. The tracking results are illustrated in Table II and
Fig. 10(b).
3) Route Diversity: We tested three different routes in the
hall to validate the impact of route diversity: a large rectangle, a
medium rectangle, and a small rectangle, as shown in Fig. 6(d).
The tracking results are illustrated in Table II and Fig. 10(c). All
the routes can achieve high accuracy and precision.
4) Walking Distance: To validate the impact of walking dis-
tance on tracking performance, we tested three distances on
the same route. As shown in Fig. 6(d), the first distance is
the full of the outside rectangle, the second is half of the
outside rectangle, and the third is one fourth of the outside
rectangle. The tracking results are illustrated in Table II and
Fig. 10(d). The tracking performance does not depend on the
distance.
5) Number of Antennas: More antennas provide more infor-
mation in a CSI fingerprint, thus we tested the impact of the
number of antennas: one TX and one RX antennas (1TX-1RX
containing one antenna pair), two TX and two RX antennas
1) Walking Style: People may walk at different paces, hence (2TX-2RX containing four antenna pairs), and three TX and
we carried out experiments to validate the tracking method on three RX antennas (3TX-3RX containing nine antenna pairs).
different walking styles. The model is trained with normal walk- The tracking results are illustrated in Table II and Fig. 10(e).
ing data, and tested with slow walking and fast walking as well As each antenna pair contains 30 groups of subcarriers, with the
as normal walking. As the training set contains only normal number of antenna pairs increasing from one to four to nine, the
walking data, the tracking performance of slow walking and dimensionality of a CSI fingerprint increases from 30 to 120 to
fast walking degrades. Therefore, we apply fine tuning on the 270. More dimensions provide more information, thus the track-
DNN model with eight training routes of slow walking and eight ing accuracy improves from 160 to 64 to 54 cm. From 1TX-1RX
training routes of fast walking, the accuracy can achieve 77 cm to 2TX-2RX, the dimensionality increases three times, hence
for slow walking and 81 cm for fast walking. The tracking results the accuracy is improved significantly. From 2TX-2RX to 3TX-
are illustrated in Table II and Fig. 10(a). 3RX, the dimensionality increases 1.25 times and 2TX-2RX can
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

10 IEEE SYSTEMS JOURNAL

provide relatively adequate information to distinguish different


locations, thus the accuracy is improved marginally.
6) Sampling Rate: Higher sampling rate brings more sam-
ples, which benefits both DNN and PF, thus we tested the impact
of different sampling rates: 10, 20, and 40 Hz. The tracking re-
sults are illustrated in Table II and Fig. 10(f). With the sampling
rate increasing from 10 to 20 to 40 Hz, the tracking accuracy im-
proves from 156 to 89 to 54 cm. Higher sampling rate achieves
higher accuracy.
7) Training Times of Routes: The amount of training data
plays an important role in deep learning. Hence, we tested the
impact of the training times of routes on tracking performance.
We set the training times of the large rectangle in the hall as
16, 24, 28, and 32, and evaluated the performance. As shown
in Table II and Fig. 10(g), the tracking performance improves
with the training times. When the training times approach 32,
the accuracy does not improve much. We conducted similar ex-
periments in the research laboratory and set the training times
as 10, 15, 18, and 20. The tracking performance improves with
the training times too. When the training times approach 20, the
accuracy does not improve much. The hall is an empty space, in Fig. 11. Tracking precision with different methods. (a) Laboratory. (b) Hall.
which the fingerprints of neighboring locations are similar, thus
TABLE III
it requires more training times than the laboratory. TRACKING ACCURACY WITH DIFFERENT METHODS
8) Number of Particles: More particles take more computing
time. We set the particle number as 20, 50, 100, and 200, and
tested their effect on tracking performance and computing time.
As shown in Table II and Fig. 10(h), with the increase of the
particle number from 20 to 50 to 100, the tracking accuracy
improves from 74 to 64 to 54 cm, while the single tracking
time increases from 4 to 5 to 8 ms. When further increasing the
particle number from 100 to 200, the tracking accuracy does not
improve, but the single tracking time increases from 8 to 18 ms.

D. Method Study
FreeTrack exploits DNN, PF, and map to track moving hu- of (43, 37, 37 cm) for the three routes illustrated in Fig. 6(d),
mans. To investigate the impact of each component, we sep- while DNN with PF (empty hall without map) achieves (54,
arately replace DNN with SVM regression, replace PF with 21, 36 cm). As we model the tracking problem as a linear sys-
Kalman Filtering (KF), replace CSI with RSSI, and compare tem, both PF and KF can solve the problem well, hence the
them with FreeTrack. Finally we compare FreeTrack with the performance of PF and KF are comparable. But in complicated
state-of-the-art. The comparisons were made on the route in the scenarios such as cluttered rooms, with the aid of maps, PF out-
laboratory and the large rectangle route in the hall. performs KF.
1) Compare With SVM: SVM is a classic statistical tool for 3) Compare With RSSI: RSSI is a commonly used measure-
classification and regression. We replace DNN regression with ment of signal quality, characterizing the overall received signal
SVM regression, and apply SVR with PF and map to track the power in a channel. We replace CSI with RSSI and apply the
moving human using the same training and testing datasets. The same method to track the moving human. The tracking results
tracking results in the laboratory and in the hall are illustrated are illustrated in Fig. 11 and Table III. RSSI achieves an accu-
in Fig. 11 and Table III. SVR with PF and map achieves an racy of 198 cm in the laboratory and 274 cm in the hall, both
accuracy of 79 cm in the laboratory and 74 cm in the hall, both are far less accurate than CSI, as RSSI is a coarse measurement
are less accurate than FreeTrack. unable to deal with multipath. Hence compared with RSSI, CSI
2) Compare With Kalman Filtering: Kalman Filtering is a is more appropriate for human tracking.
widely adopted filtering tool. We replace PF with Kalman Fil- 4) Compare With State-of-the-Art: We compare our method
tering and apply DNN with KF (cannot integrate map matching) FreeTrack (DNN with PF with map) with the method proposed
to track the moving human using the same datasets. The tracking by Shi et al. [14], which applied the Bayesian probabilistic al-
results are illustrated in Fig. 11 and Table III. In the laboratory gorithm based on CSI fingerprint to infer locations and contin-
DNN with KF achieves an accuracy of 70 cm, worse than DNN uously tracked the trajectory of a moving human with Bayesian
with PF and map. In the hall DNN with KF achieves an accuracy filtering. We reimplemented the method of Shi et al., which
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZHOU et al.: FREETRACK: DEVICE-FREE HUMAN TRACKING WITH DEEP NEURAL NETWORKS AND PARTICLE FILTERING 11

achieves an accuracy of 100 cm in the laboratory and 76 cm in [12] Q. Gao, J. Wang, X. Ma, X. Feng, and H. Wang, “CSI-based device-free
the hall. FreeTrack outperforms it by a large margin, as shown wireless localization and activity recognition using radio image features,”
IEEE Trans. Veh. Technol., vol. 66, no. 11, pp. 10 346–10 356, 2017.
in Fig. 11 and Table III. [13] R. Zhou, X. Lu, P. Zhao, and J. Chen, “Device-free presence detection and
localization with SVM and CSI fingerprinting,” IEEE Sensors J., vol. 17,
VI. CONCLUSION no. 23, pp. 7990–7999, Dec. 2017.
[14] S. Shi, S. Sigg, L. Chen, and Y. Ji, “Accurate location tracking from CSI-
OFDM and MIMO enable to access fine-grained physical based passive device-free probabilistic fingerprinting,” IEEE Trans. Veh.
Technol., vol. 67, no. 6, pp. 5217–5230, Jun. 2018.
layer information of multiple links and individual subcarriers [15] C. R. Karanam, B. Korany, and Y. Mostofi, “Magnitude-based angle-
from commodity wireless devices, thus trigger the use of CSI of-arrival estimation, localization, and target tracking,” in Proc. 17th
to achieve accurate device-free localization and tracking. This ACM/IEEE Int. Conf. Inf. Process. Sensor Netw., Piscataway, NJ, USA,
2018, pp. 254–265.
paper presents a device-free human tracking method based on [16] X. Li et al., “IndoTrack: Device-free indoor human tracking with com-
CSI amplitude fingerprints with only one pair of commodity modity Wi-Fi,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.,
WiFi transmitter and receiver. By exploiting DNN, the features New York, NY, USA, 2017, vol. 1, no. 3, pp. 72:1–72:22.
[17] K. Qian, C. Wu, Y. Zhang, G. Zhang, Z. Yang, and Y. Liu, “Widar2.0:
are extracted automatically and human localization is accom- Passive human tracking with a single Wi-Fi link,” in Proc. 16th Annu. Int.
plished through 2-D regression. To track moving humans, PF Conf. Mobile Syst., Appl., Services, 2018.
integrated with map matching is applied on DNN localization, [18] R. Zhou, M. Hao, X. Lu, M. Tang, and Y. Fu, “Device-free localization
based on CSI fingerprints and deep neural networks,” in Proc. IEEE 15th
which proves effective in forming precise moving trajectories. Int. Conf. Sens., Commun. Netw., Hong Kong, China, Jun. 2018.
To combat with environmental variants, the DNN localization [19] S. Han, Y. Li, W. Meng, C. Li, T. Liu, and Y. Zhang, “Indoor localization
model is fine tuned with a small number of samples from the with a single Wi-Fi access point based on OFDM-MIMO,” IEEE Syst. J.,
vol. 13, no. 1, pp. 964–972, Mar. 2019.
varied environments. Evaluations demonstrate the effectiveness [20] D. Halperin, W. Hu, A. Sheth, and D. Wetherall, “Predictable 802.11 packet
of the method, achieving the tracking accuracy of about half delivery from wireless channel measurements,” in Proc. ACM SIGCOMM-
a meter and precise trajectories as well as easy adaptation to Conf., New Delhi, India, 2010, pp. 159–170.
[21] M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm
environmental variants. for discovering clusters in large spatial databases with noise,” in Proc. 2nd
Int. Conf. Knowl. Discovery and Data Mining, Portland, Oregon, 1996,
REFERENCES pp. 226–231.
[22] I. Jolliffe, Principal Component Analysis, 2nd ed. New York, NY, USA:
[1] K. Wu, J. Xiao, Y. Yi, M. Gao, and L. M. Ni, “FILA: Fine-grained in- Springer-Verlag, 2002.
door localization,” in Proc. IEEE INFOCOM, Orlando, FL, USA, 2012, [23] M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, “A tutorial
pp. 2210–2218. on particle filters for online nonlinear/non-Gaussian Bayesian tracking,”
[2] H. Abdel-Nasser, R. Samir, I. Sabek, and M. Youssef, “MonoPHY: Mono- IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174–188, Feb. 2002.
stream-based device-free WLAN localization via physical layer informa- [24] S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Trans. Knowl.
tion,” in Proc. IEEE Wireless Commun. Netw. Conf., Shanghai, China, Data Eng., vol. 22, no. 10, pp. 1345–1359, Oct. 2010.
2013, pp. 4546–4551.
[3] K. Wu, J. Xiao, Y. Yi, D. Chen, X. Luo, and L. M. Ni, “CSI-based indoor
localization,” IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 7, pp. 1300–
1309, Jul. 2013. Rui Zhou received the Ph.D. degree from the University of Freiburg, Germany,
[4] X. Wang, L. Gao, S. Mao, and S. Pandey, “CSI-based fingerprinting for in 2010.
indoor localization: A deep learning approach,” IEEE Trans. Veh. Technol., She is currently an Associate Professor with the University of Electronic
vol. 66, no. 1, pp. 763–776, Jan. 2017. Science and Technology of China, Sichuan Sheng, China. Her research interests
[5] X. Wang, L. Gao, and S. Mao, “CSI phase fingerprinting for indoor local- include pervasive computing, Internet of Things, and machine learning.
ization with a deep learning approach,” IEEE Internet Things J., vol. 3,
no. 6, pp. 1113–1123, Dec. 2016.
[6] X. Wang, X. Wang, and S. Mao, “CiFi: Deep convolutional neural net-
works for indoor localization with 5 GHz Wi-Fi,” in Proc. IEEE Int. Conf. Mingjie Tang is currently pursuing the B.S degree in the University of Electronic
Commun., Paris, France, 2017, pp. 1–6. Science and Technology of China, Sichuan Sheng, China.
[7] H. Chen, Y. Zhang, W. Li, X. Tao, and P. Zhang, “ConFi: Convolutional His research interests include localization and machine learning.
neural networks based indoor Wi-Fi localization using channel state infor-
mation,” IEEE Access, vol. 5, pp. 18 066–18 074, 2017.
[8] I. Sabek and M. Youssef, “MonoStream: A minimal-hardware high ac-
curacy device-free WLAN localization system,” Comput. Sci., eprint Ziyuan Gong received the B.S. degree from Southwest Jiaotong University,
arXiv:1308.0768, Aug. 2013. Sichuan Sheng, China, in 2018. He is currently working toward the M.S. degree
[9] J. Wang et al., “LiFS: Low human-effort, device-free localization with with the University of Electronic Science and Technology of China, Sichuan
fine-grained subcarrier information,” in Proc. 22nd Annu. Int. Conf. Mobile Sheng, China.
Comput. Netw., New York, NY, USA, 2016, pp. 243–256. His research interests include wireless sensing and machine learning.
[10] X. Li, S. Li, D. Zhang, J. Xiong, Y. Wang, and H. Mei, “Dynamic-MUSIC:
Accurate device-free indoor localization,” in Proc. Proc. ACM Int. Joint
Conf. Pervasive and Ubiquitous Comput., Heidelberg, Germany, 2016,
pp. 196–207. Meng Hao received the B.S. degree from the University of Electronic Science
[11] K. Qian, C. Wu, Z. Yang, C. Yang, and Y. Liu, “Decimeter level passive and Technology of China, Sichuan Sheng, China, in 2018. She is currently
tracking with WiFi,” in Proc. 3rd Workshop on Hot Topics in Wireless, pursuing the M.S. degree with Zhejiang University, Zhejiang Sheng, China.
New York, NY, USA, 2016, pp. 44–48. Her research interests include image processing and machine learning.

You might also like