Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 11

Contactless WiFi Sensing and Monitoring for Future Healthcare - Emerging

Trends, Challenges, and Opportunities


Sandhiya S Kalai priya G S
Department of Biomedical Engineering, Department of Biomedical Engineering,
GRTIET GRTIET
thiya006selva@gmail.com sgkalaipriya21@gmail.com

Abstract—WiFi sensing has received recent and be combined with deep learning and can be used
significant interest from academia, industry, to monitor behavior, including emotional states
healthcare professionals, and other caregivers and mental well-being. Such information can be
(including family members) as a potential integrated into smart homes to support our daily
mechanism to monitor our aging population at a lives. In this study, we focus on a detailed review
distance without deploying devices on users’ which explores the application of WiFi sensing
bodies. In particular, these methods have the in such healthcare applications, demonstrating its
potential to detect critical events such as falls, relative advantages over other monitoring
sleep disturbances, wandering behavior, systems such as wearable sensors, camera-based
respiratory disorders, and abnormal cardiac imaging, and acoustic-based solutions.
activity experienced by vulnerable people. The
interest in such WiFi-based sensing systems A. Comparison of WiFi RF Sensing and Other
arises from practical advantages including its Approaches
ease of operation indoors as well as ready Broadly, current sensing and monitoring systems
compliance from monitored individuals. Unlike can be divided into those using contact-based
other sensing methods, such as wearables, sensors, including wearables and contactless
camera-based imaging, and acoustic-based systems . Besides wearable devices, the
solutions, WiFi technology is easy to implement contactless monitoring approaches can be
and unobtrusive. This paper reviews the current divided into visual based sensing radio frequency
state-of-the-art research on collecting and (RF) signals based sensing. RF signals at
analyzing channel state information extracted frequencies between 30 kHz & 300 GHz,
using ubiquitous WiFi signals, describing a range comprise electromagnetic waves called radio
of healthcare applications and identifying a waves (as are widely used in radar systems,
series of open research challenges, including including household and commercial behavior
untapped areas of research and related trends. recognition). Recently, the carrier frequency
This work aims to provide an overarching view range of WiFi signals is from 2.4 GHz to 5.9
in understanding the technology and discusses its GHz, which is covered by radio waves.
use-cases from a perspective that considers Applications of wearable devices cover a wide
hardware, advanced signal processing, and data range of methods, including measurements of
acquisition. heartbeat and respiration rates, oxygen saturation
I. INTRODUCTION level, electromyographic signals and many
SENSING and monitoring systems for human others . However, these sensors are expensive, as
healthcare have become increasingly popular, it is necessary to provide a single device to each
driven in part through our knowledge economy person being monitored. Moreover, the
as well as the significant improvements in our successful capture of the health information is
longevity and living standards. In healthcare dependant on the patient wearing the sensor or
applications, such systems can provide keeping it close to the body, which, if forgotten,
individuals with the capability of long-term can have severeconsequences in applications
detection of daily activities and variations in vital such as fall detection. There is also the challenge
signs, all in the privacy of our homes. With of the re-usability of wearable equipment,
simple, long-term, and continuous health resulting in widespread contact-transmission
monitoring in the daily home environment, it is viruses, such as COVID-19, if not appropriately
possible to record the signs of illness and disinfected. Generally the adoption of the
physiological deterioration that cannot be technology is problematic amongst some of the
detected during a short formal clinical most needy individuals, namely those who are
consultation. Such monitoring systems can also old or disabled. In contactless sensing methods,
camera-based sensing applications have proven around the house. Although there have been
their accuracy . However, several disadvantages numerous research studies conducted in this
make it difficult, in some scenarios, to rely on field, it is difficult to replace wearable and
such systems, which includes: System visualized healthcare applications due to their
complexity and high cost due to computational high reliability and efficiency. However, as
requirements for multiple cameras to cover areas academia and industry continue to optimize
of activity. Privacy concerns due to the capturing sensing technology, and as it becomes more
and storage of images, which unauthorized users reliable and accurate for the healthcare
can access in a lowsecurity system. Compared monitoring of humans, we can expect to see
with wearable sensing technologies, ambient RF changes from the current situation.
sensing has the advantage of reducing the risk of C. Contributions
contact transmission infections. Because it is There are a number of surveys of specific WiFi
capable of the contactless measurement of vital sensing techniques that have been published in
signatures and macro-health indicators in non- recent years, including human activity
line-of-sight (NLOS) environments. In hospitals, recognition], human identification, localization ,
wireless systems can capture the signal signature vital sign, and imaging (see Table I). All of the
of vital signs, such as coughing, shortness of studies mention human activity recognition; few
breath, fever, and aches . Given that these of them explore localization and vitals
symptoms are closely linked to patient estimation. The review papers discuss trends that
infections,WiFi sensing has the potential to can be related to healthcare (human activity
detect illness. The comparison of WiFi sensing recognition, vitals, localization), which is
and other RF sensing technique is conducted and introduced in Section II-C2, focusing on the
discussed in Section II-B. technology development, with less detail on the
B. Specification of WiFi Sensing in Healthcare applications in healthcare [18]. In comparison
At present, WiFi sensing research in healthcare with existing surveys within detailed contents of
is being mostly developed for use in non-hospital various techniques and applications, the view of
environments, driven by two trends: vital sign our survey is distinct, which specifically focuses
detection and activity detection (see Fig. 1). Vital on the analysis of WiFi applications in the
sign detection system aims to monitor the healthcare field. Our paper is structured to
movement of the lungs and heart in humans discuss the capability of WiFi sensing in
using WiFi signals to recognize the respiration healthcare applications, including current
and heartbeat rate, in real-time. For activity achievements and future expectations through a
detection task, alarms for critical events such as thematic analysis review, providing a healthcare
falling, and other specific actions that can cause perspective to researchers. More specifically, the
severe and fatal consequences to humans has contributions are as follows:
been studied in academia, and industry .  Provide a detailed overview of the
Generally, such systems use WiFi devices methodologies adopted in developing
alongside intelligent classification algorithms to healthcare monitoring systems.
monitor and predict human subjects’ movements.  Classify healthcare related applications
In the same context, WiFi signals are also used into different categories, and then provide
to report, over the internet, the activity status insights for distinct trends.
and/or vitals of the monitored subjects to the  Highlight challenges and their potential
medical specialist and families or carers. solutions that require further
Beneficiaries of such valuable real-time data and investigation for generalization of
information are the Internet of Things (IoT) healthcare applications based on WiFi
systems. For example, vital signs detection in a sensing.
smart home can help IoT systems adjust the The paper is organized as follows: Section II
temperature, humidity, and other environmental introduces WiFi sensing technical background
factors automatically to improve the quality of and development in healthcare range. Section III
the user’s experience . At present, WiFi sensing reviews different techniques applied in WiFi
has been applied in the home. For example, sensing, including signal preprocessing
Linksys sells a WiFi router and provides a techniques and algorithms. Section IV concludes
service called “Linksys Aware,” which enables and analyzes the recent healthcare related
WiFi devices to perceive the signals’ vibration applications in different fields, including vitals
detection, localization, large-scale and small (including the signals in line of sight (LOS) areas
scale activity recognition. While finally, Section and those reflected off the stationary objects).
V discusses the technical and ethical challenges The rest of the expression is the summation of
based on the recent researches. Then provides signals from all dynamic paths (including signals
future perspectives associated with healthcare reflected from the dynamic objects). Nd is the
WiFi sensing. index of the dynamic path, ai(f, t)represents the
WiFi signals. This section, therefore, discusses complex attenuation factor and the initial phase
some of the primary techniques used to perform of the i th path; e−j2πdi(t)λ represents the phase
WiFi sensing. change of i th path; di(t) and λ are the length of
1) Received Signal Strength Indicator (RSSI): the i th path and the wavelength of the WiFi
The RSSI technique has been widely used signal, respectively. The CSI value can adapt the
for the localization of individuals. In MIMO communication system to the current channel
systems, the RSSI is represented by the conditions and guarantee high reliability and
superposition of the strength of all the high rate communication in multi-antenna
received signals. Most network devices can systems. With MIMO and OFDM technologies,
perform this task, including network the size of the CSI matrix is constructed in 3
interface cards (NICs), as they are easily dimensions, with N transmitter antennas, M
accessible. An RSSI-based detection system receiver antennas, and K subcarriers. The CSI
depends on the magnitude changes of RSSI packet is transmitted as N × M × K, with the
levels caused by the activity. However, due packet index t (see Fig. 2). The propagation
to multi-path fading and time dynamics, its performance of wireless signals through both the
performance under complex conditions is direct path and the multiple reflection paths will
significantly impacted. Early WiFi sensing show the physical space environment, including
systems that have been used for commercial any object and the human body. Compared to
localization are primarily dependent on RSSI values, the CSI offers a fine-grained
RSSI without fine-grained information. representation of activity. Hence recent device-
Hence, they cannot be used to recognize free WiFi sensing studies favor CSI, instead of
complex human behaviour. RSSI
2) Channel State Information (CSI): CSI is
the channel property of the wireless B. Comparison With Non-WiFi RF Sensing
communication link. It represents the channel Prior to the wide use of WiFi sensing
frequency response (CFR) for each subcarrier technology, considerable subject-identification
between transmitter and receiver, which research has been performed with traditional
describes the fading factor of the signal on every radar systems due to their contactless and
transmission path, i.e. the value of every element privacypreserving characteristic. For example,
in channel gain matrix H (sometimes called frequency-modulated continuous-wave (FMCW)
channel matrix or channel fading matrix). In radar equipment was applied in , while in the
WiFi systems, the CSI signals can be obtained radar system was proven in its accuracy through
from the physical layer on the commercial IEEE 8-meter distance monitoring of breathing and
802.11 A/G/N wireless network card based on heart rate within 5.46 - 7.25 GHz bandwidth. In ,
OFDM. For each subcarrier, the WiFi channel is the authors use a MIMO ultra-wide-band (UWB)
modeled by y = Hx + n, Where y stands for the transceiver system to estimate the speed of
received signal, x is the transmitted signal, n is human movement with an average accuracy of
the noise component. The receiver computes the 96.33%. However, in all cases, there is a high
CSI matrix with the pre-defined signal x and the cost to establish a specific testbed. In [30], a
received signal y. However, in reality, a WiFi system based on SDR using USRP was
systems’ estimation of CSI is affected by proposed. The experiment simulated an FMCW
multipath fading. The CSI matrix of a given system to analyze the phase change status caused
subcarrier with frequency f and time t can be by respiration. The achievements of these non-
represented as : H(f, t) = e−j2πΔf t(Hs(f) + Nd wifi sensing systems are also heavily informed
i=1 ai(f, t)e−j2πdi(t)λ) (1) Where e−j2πΔf t is the by WiFi sensing due to the similarity of RF
random phase shift due to the hardware / signals. However, the key difference between the
software error of the WiFi system; Hs represents two methods is that CSI in the WiFi
the CSI signals from all the static paths communication system is designed to recover
transmitted information but not to explore the the wireless open-access research platform
physical characteristic of the communication (WARP) [18], [37], [38].
channel. For example, FMCW radar has the 2) WiFi Sensing Applications Towards
capability to consistently and linearly adjust the Healthcare:
frequency. Combined with the time of flight Based on the foundation of the open-source WiFi
(ToF) algorithm, FMCW can accurately estimate sensing driver’s development demonstrated in
the distance information of the objects. WiFi Section II-C1, researchers have started to
signals are only supposed to transmit within a propose several methods and applications based
shallow frequency bandwidth, which is limited to on WiFi sensing. This section provides a general
the devices, so it cannot be modulated to do the overview of WiFi sensing development trends in
frequency sweep operation to get the range bins healthcare, and more detailed technical analysis
[31]. Nevertheless, a lot of research studies is demonstrated in Section IV. Table II shows
found the potential of this technique and some popular applications of WiFi sensing in
proposed various researches to compensate for recent years. For the convenience of
the shortages and improve the feasibility in demonstration, different tasks are separated into
different tasks. C. The Evolution of WiFi two parts, human activity recognition, and vital
Sensing for Healthcare 1) Hardware Platform signs monitoring. In this case, we define the
Development of WiFi Sensing: For the past few classification and analysis of all active motion
years, research studies on CSI measurement from based on torso movement as human activity
WiFi signals have been emerging for different recognition. From another perspective, vital
sensing applications. In a WiFi system, CSI is signs are necessary to maintain regular human
essentially a data format used to represent the activity and are therefore not directly controlled
CFR sampling of the sub-carriers granularity in by consciousness and torso movement for the
the system’s frequency band, obtained from the vast majority of time. So, we differentiate it from
physical layer of the commercial IEEE 802.11n general human activity recognition. For the
wireless network card, based on OFDM human activity recognition applications in
technology. Based on the WiFi devices, the healthcare, we divide them into two types:
researchers first developed an open-source CSI healthcare auxiliary and healthcare recognition,
tool driver using the Intel 5300 NICs [32]. This based on the aspects of monitoring requirement
CSI tool enables 30 subcarriers in a 20 MHz of instant and long-term feedback. In case of
channel bandwidth for CSI collection from healthcare auxiliary applications in an indoor
commercial off-the-shelf (COTS) WiFi devices. environment, the literature covers daily activity
This driver provides a quick and low-cost recognition [24], [34], [39]–[44], and other
method to establish the WiFi sensing platform. specific activity recognition such as falling [45],
In another study, the authors in [33], [34] have smoking [46], sedentary behavior [47], pose
implemented their system based on the estimation [48]–[51], keystroke [52] and mouth
Qualcomm Atheros NICs offered by [35], which motion [53]. As for the daily activity types, most
has 114 CSI subcarriers, hence a higher papers consider: walking, running (or jogging),
resolution compared to the Intel 5300 CSI tool. sitting, pushing and dragging, jumping,
In [34], the results of the comparative study have squatting, opening the door, and other actions
shown that the higher the number of subcarriers, that people always take in daily life. Through
the higher the sensing accuracy. Other sensing these instant activity monitoring methods, the
devices include the Wi-ESP which has a reduced alarm of dangerous accidents like falling can be
cost and is smaller in size compared to the transferred to the nearest community hospital
previously mentioned COTS WiFi router [36]. and families to take an instant action to prevent
Besides NICs, software-defined radio (SDR) GE delayed medical attention, especially for elderly
et al.: CONTACTLESS WIFI SENSING AND people [54]. At the same time, these approaches
MONITORING FOR FUTURE HEALTHCARE are helpful for a disabled person to improve self-
- EMERGING TRENDS 175 TABLE II care capability through contactless interactive
GENERAL WIFI SENSING APPLICATIONS smart controlling methods of gestures
SINCE FROM 2015 TO 2020 platforms are recognition and pose estimation For another
commonly used to measure CSI, such as the range of the healthcare, recognition approaches,
universal software radio peripheral (USRP) and it mainly covers the detection of the diseases
through long-term gait monitoring, for
paraparesis detection [55] and Parkinson II. MAIN COMPONENTS OF CONTACTLESS
detection [56]. These works train the specific WIFI SENSING
model to learn the gait difference of healthy The development of WiFi sensing systems
people and patients for diseases recognition. involves two stages, the first is applying signal
Nevertheless, because datasets from disabled processing techniques, and the second is the
person are difficult to obtain, relatively few algorithm design. The signal processing stage
works have been published in this field. Vital consists of three sub-stages, i.e., denoising,
signs estimation belongs to the range of signal transformation, and feature extraction. The
healthcare recognition applications, which is algorithm stage explains modelingbased and
performed by monitoring the motion of the chest learning-based tracks, respectively. A
and heart. Most papers analyze the respiration generalized architecture diagram of a typical
rate [50], [57]–[67], some of them detect WiFi sensing system is shown in Fig. 3. Firstly,
heartbeats [50], [59], [60], [62], [64], [67], and raw WiFi signals are collected by the receiver
another paper demonstrates the biometric devices, where they are denoised, transformed,
estimation [68]. The difference between and features are extracted for the data-mining of
respiration and heartbeat estimation is CSI signals. Secondly, algorithms are applied to
demonstrated in Section IV-A2. From the classify/recognize/estimate the results. Each of
perspective of potential in healthcare the stages is detailed in the following
applications, these systems are useful for instant subsections. In this section, we review various
monitoring of vitals in the non-hospital kinds of technologies and classify them in
environments and helpful in the detection of different stages.
longterm chronic diseases’ such as arrhythmia, A. Signal Processing Techniques
and some respiratory diseases. Convincing This stage is concerned with the processing of
results with regards to WiFi sensing for the collected CSI signals captured during the
biometrics estimation is still lacking in the subject’s motion. CSI data is processed by
literature compared to radar-based systems [69], different methods to obtain the nature of the
[70] which has shown good performance. So information that is required by the system. The
using WiFi signals to estimate biometric signal processing of WiFi signals constitutes
parameters can be regarded as a potential three phases: Noise Reduction, Signal
application waiting for further development. Transformation, and Feature Extraction, to feed
Further to the previously reported studies, it is noise-free information to the algorithms (see
crucial to have reliable localization and tracking Section III-A1, III-A2 and III-A3)). Table III
systems to complement healthcare monitoring lists the various methodologies adopted and
ones. For instance, monitoring vitals during applied in the literature to process WiFi signals.
sleeping cannot be performed when the person is
not in bed [71], as the position of human is 1) Noise Reduction: Noise components, like
essential to the decision making process. outliers of CSI data, always exist, which impacts
Meanwhile, from the timeline shown in the the signal and causes a significant reduction in
Table II, we can conclude the emerging trend is the recognition accuracy of the overall system.
that the researchers are expecting specific WiFi Denoising raw data can reduce the redundant
sensing applications like diseases detection, computation of invalid information and improve
biometric estimation, sedentary activity efficiency and accuracy. De-noising is performed
recognition, which have more application value in two stages, the first is the removal of outliers,
in healthcare. On the other hand, as the types of and the second is performing interpolation.
perceptible activities in the traditional WiFi Outlier is the data that stands out from the rest of
sensing method are limited, the pose estimation the data set, leading to suspicion that no random
task is proposed to restore the human skeleton in deviations are resulting from entirely different
visualization with only WiFi signals. Combined mechanisms. In a WiFi system, outliers can be
with the state-of-the-art framework of computer caused by hardware or software errors. Moving
vision-based human activity recognition, it has average (MA) is a primary method to solve the
expected that the performance will be further outliers, which uses statistical methods to
improved [48], [49]. average the CSI values in a certain period and
connect the average values in the time range. A
Hampel filter is also used to remove the outliers,
where for each sample of the CSI datasets, the window length brings a lower resolution of
median value of the window consisting of the signal in the time domain. Discrete wavelet
sample and several surrounding samples is transform (DWT) is utilized to decompose
calculated, and then the absolute value of the signals on different scales to improve the
median is used to estimate the standard deviation performance compared with the Fourier
of the median of each sample pair. Using the transform. Meanwhile, DWT is available in
median to replace outliers is less sensitive to time-frequency analysis to judge the signal
noise than using mean and standard deviation frequency changes in the time range, the
[18], [59]. The median filter has the same instantaneous frequency, and amplitude at each
principle as the Hampel filter, which traverses moment.
the signal without outlier detection. LOF is used 3) Feature Extraction: Feature extraction is
to find abnormal CSI patterns calculating the the process of obtaining information from the
local density of the points with respect to k- signal, which is the basis of a different algorithm
nearest neighbors [99]. The local density of the for classification and estimation from the CSI
selected point will be calculated by reach-ability data. Phase difference and phase linear transform
distance to neighbors and compared with other are used to find the relationship between the
points. On the other hand, interpolation changes in the phase and human activities.
processing ensures the continuity of the signal in Filtering is adequate for detection of the behavior
time and reliability of the experimental data, with constant frequency like heartbeat and
especially when the data packets are collected at respiration, even for the detection of walking,
a higher frequency. If packets are lost during which focuses on filtered high frequency CSI
communication, the interpolation method would signals out to get cleaner human-related signals,
take the average of the nearest two points to such as the respiration and heartbeat rate [67],
replace the unperceived data. Meanwhile, to [98]. Butterworth filter is widely used because
keep the continuity of the signals, linear the frequency response curve in the pass-band is
interpolation is applied in many proposed flat without fluctuations, while it gradually drops
systems [46], [68], [73]. to zero in the stop-band. Thresholding is used to
distinguish valid signals in the time range based
2) Signal Transformation: The signal on ToF. As shown in (1), the ToF value of each
transformation method targets the analysis of path can be estimated by CSI data [78]. Based on
CSI signals in the time-frequency domain. In the the distance of transmission lines, those signals
virtual environment, the wireless signal will be with high ToF value are reflected more times
impacted by high and low-frequency noise. around the environment than others, which is
Through frequency domain filtering processing, meaningless for systems and can be excluded.
these noise signals can be effectively reduced. At Last but not least, signal compression utilizes
the same time, the signal components of the dimensional decrease methods that generally
frequency band required by the systems can be work in feature extraction, like principal process
obtained using a band-pass filter and inverse for CSI amplitude signals. component analysis
transformation. Fast Fourier transform (FFT) is a (PCA) and independent component correlation
standard method applied in the OFDM systems algorithm (ICA). PCA is a statistical method,
where the CSI is a sample of FFT of channel transforming a group of potentially correlated
impulse response (CIR). Short-time Fourier variables into a group of linearly uncorrelated
transform (STFT) frames and windows the variables through orthogonal transformation.
original signal first, then performs FFT on each This group of variables after conversion is called
frame. These characteristic assists researchers in the principal component. In WiFi sensing, PCA
finding the dominant frequency change in the is mainly adopted to integrate the signals from
time domain, which is efficient for real-time different subcarriers to extract main components
sensing. However, when the length of the frame of variance .ICA is also a method to find the
is constant, STFT takes a poor balance of signal hidden factors of non-Gaussian data, regarded as
restoration in the time and frequency domains. a powerful method in blind signal analysis. From
Suppose FFT window length (for CSI signals in the previously familiar sample-feature
the time domain) gets extremely short, it will perspective, the prerequisite for using ICA is that
cause inaccurate frequency analysis with implicit factors of independent non-Gaussian
inadequate signal information. Inversely, longer distribution generate the sample data. B. WiFi
Sensing Algorithms The core methodology length change of the Doppler signal, WiFi
applied for detection or recognition of activities equipment in a different position collects distinct
lies in the algorithm, which is divided into either CSI signals. This Widar3.0 considers the
modeling-based or learning-based. Some location of devices and maps DFS value into the
examples from the literature are shown in the BVP. This method reduces the negative
Table IV. 1) Modeling-Based Algorithm: influence from the environment and has been
Modelling-based approaches apply statistical or tested in unknown locations where signals are
mathematical models to extract specific features, collected for the training set.
depending on the tasks. These studies are less 3) Learning-Based Algorithm: Machine
dependent on training set and have more learning-based classification algorithms such as
robustness compared to the learning-based the k-nearest nighbors (KNN) and support vector
methods. ToF and angle of arrival (AoA) models machines (SVM) are widely used in detection
have been frequently applied for indoor tracking and recognition tasks [101]. Multi-cluster/class
and localization. When receiving signals in the feature selection (MCFS) in the WiHear system
same physical path, the delay should be a [53] sets to extract the optimal feature subset and
constant value. However, due to the multi-path find the correlation feature between different
effect, which reflects the transmitted signal, the subsets, using a pattern matching algorithm to
value of ToF can be influenced. Power delay avoid over-fitting. On the other hand, with the
profile (PDP) is a common approach to get the fixed size of the dataset, the classification
value of ToF through inverse fast Fourier process of MCFS on the testing set takes 5
transform (IFFT), which is popular in tracking seconds, which is much lower than 3 - 5 minutes
and localization [76]. Meanwhile, AoA makes taken by the SVM algorithm. The Dynamic Time
different antennas show different phase Wrapping (DTW) method calculates the
observations. Multiple Signal Classification similarity between time series data by extending
(MUSIC) performs well on the AoA estimation and shortening the sequences widely used in
[75], [78], which correlates phase difference with fingerprint-based learning methods. Similarly,
the distance of multiple antennas to estimate the earth mover’s distance (EMD) defines distance
transmission direction. The phase difference is measurement, which can measure the distance
required to combine with the Fresnel zones (see between two distributions. The function of EMD
Fig. 5). The Fresnel zone is a concentric ellipse and DTW is similar in CSI based classification,
with foci between the transmit and receiving which both belongs to the range of linear
antenna horizontally in the WiFi system. [100] regression. By contrast, DTW focus on
designs the related experiments and proves that estimation in single dimension CSI sequence,
the motion that happens in the middle of the and EMD can be used in higher dimensions, like
Fresnel zone is more efficient than happens on DFS integration shown in Fig. 7. Besides ML
the boundary. Doppler frequency spectrum methods, many deep neural network (DNN)
(DFS) represents frequency shift influenced from frameworks have been widely applied in WiFi
the active motion, which is feasible to extract the sensing. With the rapid development of neural
velocity of subjects. CSI itself represents the network in recent years in various fields,
channel frequency response, so it is convenient different DNN structures have been applied in
to do time-frequency analysis of the WiFi signals WiFi sensing, for example, convolutional neural
(see Fig. 6)). The authors of [84] developed an network (CNN), long short-term memory
algorithm to correlate static CSI values with (LSTM) and etc. In [41], instead of using long
active multi-path gradient and utilize the Doppler short-term memory (LSTM), an attention-based
frequency change to estimate the velocity and bi-directional long short-term memory
location of the humans. Besides, [89] adopts the (ABLSTM) neural network is proposed to
body velocity profile (BVP) algorithm to apply extract 2-dimensional features from WiFi CSI
the earth mover’s distance to integrate the data, representing human activity. In the results,
multiple spectrum’s characteristics to classify the recognition of six different activities in public
gestures (see Fig. 7). In each BVP, the velocity places, recorded an accuracy of more than
component is projected onto the normal direction 97.5%. In [40] the author applies the CNN
of a physical WiFi link and contributes to the classification algorithm, which records a higher
power of the corresponding radial velocity accuracy in comparison with the SVM classifier.
component in the DFS profile. Due to the path Similarly, SignFi [87], and 1D-CNN [55]
propose the use of different CNN structures for CNN framework to estimate the pose. However,
WiFi sensing. The 1D-CNN performs better than in the mentioned 2D human skeleton restoration,
the KNN method (average 4% higher in 1D- there are few discussions of the robustness. Due
CNN), and SignFi improved 2% - 4% accuracy to the sensitivity of CSI signals, environment has
compared to the KNN-DTW method proposed in the severe impact on channel information, which
[82], [102]. Instead of using external neural means the overfitting issue is inevitable. Because
networks (less than five layers) as alternate 2D pixels obviously can not map all human
nonlinear operators, [68] proposed a novel activities, especially for NLOS side, with CSI
method to extend the size of CSI input from 30 × variance. To improve the reliablity, the study of
1 × 1 to 6 × 224 × 224 with bi-linear [49] improves the BVP to 3D velocity profile
interpolation, which provided an image-like through changing the antennas’ height. These
structure for further deep learning. It offers ideas create the condition of more applications
conditions to apply different backbone networks development with pose estimation.
like AlexNet, visual geometry group (VGG)
network, inception cluster, etc. The deep learning III. CHALLENGES AND FUTURE
network framework proved that body perception DIRECTIONS
of CSI sequences forWiFi could accomplish: two Due to the popularity and consistent upgrade of
body characterization problems of biometrics WiFi devices, WiFi sensing is the technology
estimation (including body fat, muscle, water, with considerable potential. However, the
and bone rate) and identification, two activity popularisation of technology in healthcare will
recognition: gesture recognition and fall inevitably encounter not only technical
detection. For both traditional ML and DNN limitations as applications introduced but also
methods, the performance suffers from the ethical problems in Section IV. Specific
distribution shift that arises from different challenges and future directions are presented
circumstances/locations. To avoid the repeated and discussed in this section.
training of the model and fitting new areas, A. Challenges of WiFi Sensing in Healthcare
transfer learning methods can be utilized with Section IV has introduced various types of WiFi
lower computation resources [88]. Furthermore, sensing systems for healthcare that achieved high
the metric learning approach also helps the accuracy in a specific task. However, most of the
model generalize to new environments for work is challenging to implement at home
applications such as gesture recognition [90]. simply because the environment is distinct,
Although all above methodologies apply distinct which means the performance is limited with
network structures, the central task is the same, regards to different scenarios (see the
which is adopt DNN to match the CSI signal comparison regarding six different factors in
with the artificial label. Moreover, pose Table VI,VII,VIII,IX,X). This section discusses
estimation adopts the label from camerabased these issues and gives the corresponding
methods, and proposes a novel DNN structure to technical-level solutions.
match the human skeleton to WiFi CSI data. In 1) Robustness: Robustness is essential for the
the training stage, the skeleton of a human can be future development of WiFi healthcare sensing,
acquired from image processing with cameras. resulting in whether the experiment’s
Afterward, the collected WiFi data is labelled repeatability and validity can be guaranteed in
and correlated with different patterns of skeleton different environments. Although most learning-
coordination and trained by a neural network. based methods have good experimental results,
The authors of [103] proposed a novel network due to the method itself on the specific data, the
to apply a fully convolutional network (FCN) for performance of such methods in unknown
estimation of a single person’s pose from the scenarios cannot be promised. In the comparison
collected data and annotations. This work aims tables, most challenges are related to achieving
to train the specific neural network to map the generalization of sensing methods under
CSI variance to the human skeletons, and get the different conditions: distance or location,
fine-grained human skeletons from CSI signals. environments, identity difference, and
Furthermore, they developed another structure orientation of action. These factors are discussed
for multi-persons’ pose estimation [48]. Based in the studies and show the limitation behind the
on a similar theory, [104] proposes a image- overall performance. Therefore, sensitivity to
based preprocess method to get a CSI-image for changes in the physical environment is a double-
edged sword, which supports the high for networking, with stable transmitted
performance of detecting specific activity but frequency. Current drivers of WiFi device is able
allows much noise from surroundings to disturb to increase the frequency to meet the requirement
the process. For example, for the methods using of higher frequency of CSI packets collection
DNN and ML for activity recognition, the size of that most of the systems rely on, which will
the experimental setup is kept in a limited produce empty packets for networking. In the
variance of the noise. For the complex real-world case where the empty package takes up more,
environment, the barriers around the they will interfere with typical networking tasks.
circumstance can take serious adverse effects on Hence, it is challenging to operate a WiFi device
the accuracy. For example, estimation of human to complete sensing and networking tasks
respiration rate needs to filter out the noise simultaneously.
component of other activities. However, even if
unconscious human activity is filtered out, 4) Privacy and Security: Privacy and
conscious rhythmic activity can easily interfere security are being threatened by WiFi passive
with detection results and other objects’ sensing technology. In state-of-theart
activities. methodologies, WiFi sensing can be used in the
NLOS range for human and object behavior. A
2) Complicated Implementation of Setup: well-trained system can be used to recognize the
Meanwhile, it is also a challenge to set up the gesture and keystrokes of the humans. Suppose
WiFi devices while using. In , the study involves WiFi sensing is used to steal other people’s
a robust system for gesture recognition using 3 - private information due to the portability and
6 receivers with the predetermined location. generalization of WiFi equipment. In that case, it
Objectively, it’s not possible for each consumer is difficult for people to recognize privacy-
to set the devices in the same position due to the invasion behavior from those who collect that
limited physical spaces or other issues. In private information. Fortunately, thanks to the
addition, sampling frequency’s setting has a limitations of NIC manufacturers on channel
significant impact on performance as shown in information decoding, only a limited number of
Table VI, which needs experiment validation to devices can collect CSI data through open-source
achieve a trade-off between low power drivers. However, with the miniaturization of
consumption and high accuracy performance. NICs and the maturity of sensing technology,
These problems have hindered the popularisation this issue will be much more concerning in the
of the WiFi sensing technique. future.

3) Multiple Subjects Sensing: The performance B. Future Directions of WiFi Sensing in


of different WiFi sensing systems becomes Healthcare
worse as the number of subjects involved in the Although WiFi sensing has significant
experiment increases, as shown in Table X. challenges for generalization, there is still great
Majority of works do not mention the multiple potential for healthcare applications in the real
human scenarios due to the low angle resolution world. To overcome the issues discussed above,
of WiFi. Although the AoA technique based on the technique is expected to improve in four
MIMO is accurate enough to distinguish the directions.
human and count the number of people, it is not
enough to distinguish the signal from a different 1) A Unified Framework of WiFi Sensing:
person and get a specific result. To improve the One of the most challenging problems of WiFi
resolution of sensing, efficient multiple subjects sensing robustness is various experimental setup
recognition method must be developed and and devices. Although theoretically, all WiFi
improved for more practical and real-world sensing methods should get the same
setups. Meanwhile, it is challenging to track the performance as any type of WiFi device. In
person’s identity with specific respiration for in- practice, even the sampling rate of WiFi can
home healthcare analysis in the multiple subjects significantly influence the performance (see
environment. Table VI). It is necessary to follow a framework
from hardware to software of WiFi sensing
4) Performance of WiFi Networking: CSI is system for future generalization, which has a
collected using NICs, which are primarily used completely unique setup and test standard for
different methodologies to assess their approaches of human action estimation without
performance in the indoor environment. For training, especially in vitals detection and
example, the framework should contain the tracking. For activity recognition, most studies
available sampling frequency, type of antennas still adopt DNN based classification method to
and NICs, human location, distance between get the result with better performance due to the
transmitter and receiver, number of subjects and influence of unexpected human actions. The
etc. Based on the framework, extra modules for trends of joint sensing can be separated into two
mobile edge computing can be incorporated in aspects, the first one is joint training and second
the WiFi sensing systems to accelerate the one is joint sensing. Joint training will combine
processing speed and decrease the influence on the WiFi signals and different types of data from
WiFi networking system. other sources like skeleton key-points from
2) Spatial Sensing for Wide Applications: images as ground truth datasets for the training
WiFi sensing applications can sense ambient step of the estimation system with WiFi signals.
information regardless of direction due to the Hence, WiFi signals can be used in other tasks
omni-directional antennas of WiFi devices. with higher resolution and more functions in
However, this characteristic is not helpful in human support without label limitation. On the
some cases. If the WiFi sensing system can other hand, DNN is available in large size of
monitor the vitals or activities of individuals, for training and mining the feature from data for
example, only detecting the vital signs of people multiple human sensing . Joint sensing needs to
on the fixed bed in the hospital, instead of establish a whole framework of general indoor
detecting caregivers. It will be more efficient to environments for the users. Due to the restriction
analyze the data without massive ambient noise of performance versus WiFi devices’ setting, as
from other directions. Nevertheless, due to CSI demonstrated in Section V-A, CSI data cannot be
data collected from WiFi devices that have low used to perform multiple tasks within one type of
resolution and high sensitivity, it is challenging implementation in complex real-world scenarios.
to separate signals from a specific space. Extensive data analysis has been the trend for the
Beamforming technology with an intelligent future healthcare . CSI signal can be integrated
reflecting surface (IRS) and directional antennas with data from other sensors to monitor the
are considered methods to overcome this health status of humans using artificial
disadvantage and improve the performance. With intelligence techniques. Cooperative sensing
spatial sensing, WiFi sensing of human activities with different sensors will improve the precision
is not limited to residential environments. For with a larger size of precise data. Different kinds
instance, they can be of great use in vehicles to of radar sensors (millimeterwave radar, LIDAR),
detect drivers’ tiredness levels, which is and other sensors like infrared sensors, cameras,
significant for the safety of the driver and the microphones, are able to provide data for users to
passengers. The authors of have successfully set achieve specific tasks . Joint sensing around the
up the WiFi testbed in a vehicle, and eight household environment is potential to improve
human activities from the driver and the the humanization of the future healthcare
passengers were accounted for in the CARIN monitoring system in the whole-home range.
system, including pushing, pulling, and swiping.
The experiment results have shown an average VI. CONCLUSION
accuracy of 90.0% for more than 3000 real- Intelligent sensing based on commercial
world activity traces. Also, the vitals detection WiFi devices is an emerging technology for
in-cabin can be more efficient than the detection next-generation healthcare monitoring with great
indoor because the position of people in the potential for future development, due to its low-
traffic tools is constant in most cases. It will not cost and availability. This paper presents an
take effort to change sensing area with spatial extensive review of the recent techniques, open
sensing like directional antennas are others. research challenges, and development trends of
non-contact WiFi sensing related to healthcare.
3) Joint Sensing in Home for Healthcare: Different classes of healthcare applications are
Implementation in real-world environments of described, including large-scale and small-scale
WiFi sensing is one of the most challenging activity recognition like detection of falling and
tasks. Although many model-based algorithms gestures, vital signs’ detection, and localization.
described in Section III-B2 provide the These clinical applications have the potential to
reduce the future pressure from the rapidly rising (Switzerland), vol. 20, no. 9, 2020, Art. no.
aging population mitigating some of the 2479.
associated societal and economic challenges.

REFERENCES
1. P.-Y. Hsu, P.-H. Hsu, T.-H. Lee, and H.-L.
Liu, “Heart rate and respiratory rate
monitoring using seismocardiography,”
inProc. 43rd Annu. Int. Conf. IEEE Eng.
Med. Biol. Soc. (EMBC), 2021, pp. 6876–
6879.
2. S. Patel, H. Park, P. Bonato, L. Chan, and M.
Rodgers, “A review of wearable sensors and
systems with application in rehabilitation,” J.
Neuroeng. Rehabil., vol. 9, no. 1, pp. 1–17,
2012.
3. L. P. Malasinghe, N. Ramzan, and K. Dahal,
“Remote patient monitoring: A
comprehensive study,” J. Ambient Intell.
Humanized Comput., vol. 10, no. 1, pp. 57–
76, 2019. [Online]. Available:
http://dx.doi.org/10.1007/ s12652-017-0598-x
4. Q. Huang, H. Chen, and Q. Zhang, “Joint
design of sensing and communication systems
for smart homes,” IEEE Netw., vol. 34, no. 6,
pp. 191–197, Nov./Dec. 2020.
5. S. Majumder, T. Mondal, and M. J. Deen,
“Wearable sensors for remote health
monitoring,” Sensors (Switzerland), vol. 17,
no. 1, 2017, Art. no. 130.
6. D. Xiong, D. Zhang, X. Zhao, and Y. Zhao,
“Deep learning for EMGbased human-
machine interaction: A review,” IEEE/CAA J.
Automatica Sinica, vol. 8, no. 3, pp. 512–533,
2021.
7. M. Andriluka, L. Pishchulin, P. Gehler, and
B. Schiele, “2D human pose estimation: New
benchmark and state of the art analysis,” in
Proc. IEEE Conf. Comput. Vis. Pattern
Recognit., 2014, pp. 3686–3693.
8. M. B. Khan et al., “A systematic review of
non-contact sensing for developing a platform
to contain COVID-19,” Micromachines, vol.
11, no. 10, pp. 1–23, 2020.
9. M. Alizadeh, G. Shaker, and S. Safavi-Naeini,
“Remote heart rate sensing with mm-Wave
radar,” in Proc. 18th Int. Symp. Antenna
Technol. Appl. Electromagnetics, 2018, pp.
1–2.
10. F. Khan, A. Ghaffar, N. Khan, and S. H. Cho,
“An overview of signal processing techniques
for remote health monitoring using impulse
radio UWB transceiver,” Sensors

You might also like