Professional Documents
Culture Documents
Caviedes 2020
Caviedes 2020
Caviedes 2020
fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 1
Abstract— Physical therapy (PT) exercise is an evidence-based brochure was given to each participant, the exercises were still
intervention for non-specific chronic low back pain, spinal performed inaccurately [3].
deformities and poor posture. Home based PT programs are Wearable flexible sensors are presently used to monitor
aimed at strengthening core muscle groups, improving mobility
and flexibility, and promoting proper posture. However, assessing
human activity and human health. Physiological parameters
unsupervised home-based PT outcomes is a generally difficult including physical (e.g. heart rate, blood pressure) and
problem due to lack of reliable methods to monitor execution biochemical parameters (e.g. pH, Sodium, Potassium) can be
correctness and compliance. We propose a monitoring method monitored using wearable sensors. Sensor networks allow data
consisting of a wearable sensor array to monitor three geodesic transfer from wearable sensors to monitoring components for
distances between two points on the surface of the shoulders and analysis. Among the standard data transfer protocols, ZigBee,
one point on the lower back. The sensor array may be built into a Bluetooth, WiFi and WiMax, Bluetooth Low Energy (BLE) is
custom garment or a light weight harness wirelessly linked to a preferred because of low cost and ease of use, although it may
pattern recognition algorithm implemented in a mobile app. We be limited by its short range and security concerns. A review of
use a new type of triangular stretch sensor array design which can
generate a unique signature for a correct spine therapy exercise
flexible sensors including sensor networks and applications can
when performed by a specific subject. We conducted a pilot test be found in [4].
consisting of three experiments: (i) two exercise patterns simulated Monitoring spine posture and motion has been tackled using
by a mechanical device, (ii) one PT case of a scoliosis therapy three types of sensors: stretch, bend and inertial sensors. Papi et
exercise including spinal flexion, extension, and rotation al. conducted a systematic review of the state of the art usage of
performed by one volunteer patient, and (iii) a set of three lower wearables for the assessment of spine kinematics and kinetics
back flexibility exercises performed by six subjects. Overall, the [5]. Their results show that there is a broad variety of sensor
results of correctness recognition show 70-100% sensitivity and types, number of sensors and placement options; they also
100% specificity. The pilot test provides key data for further indicate that the small number of publications found on portable
development including clinical trials. The significance of the
method includes simplicity of design and training method, ability
assessment of spine motion revealed limited adoption of this
to test with simulated signals, and potential to provide real time technique, which is at an early stage of development and
biofeedback. translation. The authors conclude that data logging and
processing, systems design and fixation are areas to be
Index Terms—biofeedback, soft sensors, spine posture improved to fully exploit the wide applicability of wearable
monitoring, stretch sensors, therapeutic exercise, wearable sensors technologies.
Accurate real time 3D motion capture of the human spine is
of interest for medical diagnosis and rehabilitation of postural
I. INTRODUCTION disabilities. A motion sensing system comprised of 3 inertial
S pinal exercise physiology deals with improving strength, measurement units (IMUs) attached to the head, torso and hips
is used in [6], and motion modeling is coupled to a spinal model
flexibility, and stability through therapeutic and fitness
which can be animated and monitored in real time. Monitoring
exercises [1]. After training a subject on a given exercise
was conducted for regular daily activities such as sit, stand and
routine, a physical therapist visually verifies that the exercise
pick up objects. Motion analysis for exercise routines
has been performed correctly before the patient leaves to start correctness was not included in the study.
the home-based program. Compliance and execution A wearable system for spinal posture monitoring while
correctness monitoring for home-based therapeutic exercise sitting has been reported in [7]. It consists of a garment-
programs depends on patient self-reporting and post-program integrated plastic optical fiber sensor (effectively 3 bend
clinical evaluation [2]. When the patient is on his/her own, an sensors) and demonstrated comparable accuracy to expert
automated method to monitor execution, track progress and visual analysis of detection and transition between good and
provide real-time feedback is not readily available. One study bad posture. The authors suggest it has potential for
reported that even though each exercise had been described to biofeedback but indicate issues with inaccuracy of the expert
the patients by visually performing it, and a descriptive visual analysis used as reference criteria. A more recent paper
*
Authors are with Arizona State University, Tempe, AZ, USA (correspondence e-mail: jorge.caviedes@asu.edu).
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 2
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 3
A key enabling technology to recognize correct execution is Check the number of contours
the algorithmic component to process sensor signals and Assess heights of left and right shoulder
recognize the unique signature of a given exercise for a specific Measure the angle of left and right shoulders
subject. Research in human activity recognition (HAR) using Measure the distance between right and left shoulders
on-body inertial sensors addresses the challenge of general based on pelvic reference line
methods suitable for machine learning (ML) algorithms, Estimate interval between pelvic reference line and neck
namely that they can only be trained if large amounts of data reference line, and
are available [21], [22]. HAR methods are useful to recognize Estimate misalignment between thoracic and lumbar
human gestures, actions, and behaviors using data intensive spines against a set of reference values
feature engineering and multidimensional classifiers [23], [24]. Although, the sensitivity of this technique as a screening
Individualized biomechanical sensor data of low tool is good (74%), Asamoah et al. have reported that its false-
dimensionality are preferred and are well suited for the use of negative values between 17–25% can be improved by other
single or multi-class classifiers. In order to improve robustness, non-invasive methods such as ultrasound [27].
biomechanical sensor designs must be complemented by data
preprocessing such as denoising, signal normalization and
alignment. Biomechanical events and exercise routines can be
treated as bio signal patterns analog to simple ones like those
characteristic of cardiac and neurologic activity (see for
example ECG preprocessing methods used to improve classifier
performance reported in [25]).
From the introductory review in this section we can highlight
the following gaps and opportunities:
1. There is room to further reduce the complexity of
wearable sensor arrays that will benefit the development
of personalized mobile systems.
2. Algorithms to detect correct execution of at-home PT
routines may fill the expert supervision gap and may
enable real time biofeedback.
3. Progress in dynamic, personalized spine modeling has the Fig. 4. Moiré fringe topography of a normal subject and image
potential to support immersive, biomechanical analysis [19].
biofeedback, i.e. "when technology offers the possibility
to obtain information that is out of the reach of human In general, rasterstereography allows an analysis not only of
senses or the information that is beyond human senses the posterior torso surface, e.g. to assess cosmetic changes due
capabilities [26]." to the deformity, but also of the underlying spine. Dynamic
In this paper we will address recognition of correct rasterstereography has been used to analyze dynamic spinal
therapeutic exercise execution using a sensor array simpler than curvature during gait [28]. As shown in Fig. 5, a set of markers
other published methods and argue for its potential to enable placed in triangular fashion is used during scoliotic gait
biofeedback and augmented biofeedback. The method includes analysis. The method allowed measuring the sides of the four
a triangular sensor array design, a pattern recognition triangles with high accuracy while the subjects walked on a
algorithm, and a mobile app implementation. treadmill. Motion analysis in turn allows quantification of
The remaining sections are organized as follows: Section II spinal mobility and flexibility. Another study by the same
describes the sensor array design, Section III presents the researchers indicates that in dynamic conditions the use of only
pattern recognition algorithm, Section IV provides details of the three markers, one over the spinous process of the 7th cervical
experimental method, Section V includes a summary of the vertebra and two over the lumbar dimples (shown in dashed
results, Section VI discusses performance validation of the lines connecting points 0-10-11 on left side of Fig. 5), are
mobile app, Section VII presents a discussion of the work, and sufficient for an accurate reconstruction of the back surface
Section VIII provides our conclusions. across time [29]. To prove the concept, they used a simulator
consisting of a wooden surface marked with the 3 fixed
II. STRETCH SENSOR ARRAY anatomical landmarks driven by a robotic arm programmed
with several motion patterns (see right side of Fig. 5).
Accurate measurement of spinal curvature, necessary to
determine appropriate treatment, is obtained by methods
including radiological exam and biomechanical tests. Moiré
topography rasterstereography is a method used for mass
screening for scoliosis (see Fig. 4). A 3D surface of the shape
of the trunk is acquired and by the following steps, a specialist
or an automated method determines presence and extent of the
deformity [19]:
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 4
TABLE I
STRETCH SENSOR DIMENSIONS
Zone Length Tolerance Width Tolerance
(mm) (mm) (mm) (mm)
Active Sensing Zone 70.0 ±1.00 10.0 ±1.00
Overall Silicone Zone 85.0 ±2.00 22.0 ±2.00
Fabric Backing 127 ±2.00 35.0 ±4.00
Coaxial Cable Length 1000 ±1.00 0.445
4 5
Stretch sensors are mainly used as actuators in human computer interfaces, www.stretchsense.com
static measurements, and to monitor conditions subject to a threshold.
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 5
𝑛= (1)
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 6
We placed the vertices of the triangular sensor array on the ● 13/16 true positives or 81.25% sensitivity
periphery of an oval-shaped wooden surface that is rotated ● 27/27 true negatives or 100% specificity
using a manual crank. To create signal patterns resembling ● 1 of 3 fast executions passed
lumbar exercise, the setup corresponds to an isosceles triangle. We also recorded data sequences generated using a different
The triangular array vertices are mounted on 3 spring loaded pattern (lobe-shaped) and tested them. The simulator with the
sliding rollers pressed on towards the surface centroid to keep oval and lobe-shaped patterns is shown in Fig. 10.
them on the outer surface during rotation. When the surface is
manually rotated about its centroid, the data resulting from the
stretching of the 3 sensors in one revolution represent a unique
pattern as shown in Fig. 9. As a result of using an isosceles
triangle to resemble spinal exercise, we can observe that the
signal amplitude for sensor 2 (in orange color) is the smallest
and similar to the inter-shoulder distance, and the others (blue
and gray) exhibit a phase shift and similar to the distances from
the lower back to each shoulder.
6
Dr. Andy Pivonka, http://www.pivonkahealth.com/
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 7
1. Right lateral bend in the lumbar spine which also raises improvement with respect to prior experiments in which we
the left shoulder. tested mounting the sensor array on a contraption made of
2. Lower rib cage rotation to the right (clockwise looking elastic straps to support the stretch sensors. When using the
from the top). strapped sensor method, we captured a set of 20 training cases,
3. Rotate the upper rib cage to the left against the lower rib and a set of 15 test cases including 7 correct executions
cage (counter-rotation). including increased variance in range of motion, and 4 incorrect
4. Left lateral bend in thoracic spine to level her shoulders. executions. In that test, we achieved 70% sensitivity and 100%
Mean exercise execution time was 11.8s, with a standard specificity.
deviation of 2.25s. Fig. 11 shows the x-ray of the spine, the It is also worth mentioning that attaching the sensor array
garment with the sensor array, and a diagram of the corrective
directly to the skin using kinesiology tape was also tested but
exercise. The stretch sensors are labeled 1 for the left side, 2 for
the method did not appear to be reliable. The anchoring points
the top side, and 3 for the right side of the inverted triangle.
could not easily be replicated, and the stretching of the skin
during exercise appeared to introduce excessive variability.
C. Third experiment: lower back flexibility exercises
For the third experiment we chose exercises suitable for
lower back pain therapy and fitness. We selected 3 exercises
involving flexion, extension, bending and rotation of the spine,
as shown by the diagram in Fig. 13.
Fig. 12. Sensor signals for scoliosis correction exercise. Flex 3 way (F3W) Start standing with arms
stretched
- Flex to touch opposite
For the training set, we recorded 35 correct executions. The foot with right arm and
inter-execution signal variance was very low for all three back up
channels, so we chose a threshold of about 1.8 times the max - Flex to touch opposite
SPMD of the training set. For the testing set, we recorded a set foot with left arm and
of 9 expert validated correct executions and 7 recordings of back up
other four-phased spine exercises. - Raise arms straight up and
flex forward
Running the pattern recognition algorithm and data capture - Raise trunk and arms back
on a laptop PC, the results were the following: up and return to initial
position
● 9/9 true positives or 100% sensitivity
● 7/7 true negatives or 100% specificity
The use of a custom garment also showed performance Fig. 13. Lower back exercises and descriptions.
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 8
For this test we introduced a light weight, adjustable elastic For the three exercises, i.e., cat-cow rotation, child’s
harness as a method to mount the wearable sensors that can be pose 3 way, and flex 3 way average sensitivities were
worn by multiple users, as opposed to the personalized custom 85%, 97% and 85% respectively. The lowest individual
garment shown before. Fig. 14 shows the light harness with sensitivity for a single subject was 60% for the flex 3
buckles and straps at the ends of the triangular sensor array way exercise.
which are used to adjust and visually test the initial stretch so The average execution times for each of the 3 exercises
that sagging is minimized. If needed, the initial readings could were 24, 20 and 15 seconds. The shortest average
be recorded and reproduced at the beginning of each exercise execution time was for the flex 3 way exercise.
session. An elastic band around the mid chest is used to keep Specificities were 100% in all cases. Specificity was
the sensor array close to the spine surface. tested with incorrect executions (e.g. incorrect
movement sequence, repeat moves, skip moves), and
different exercises (e.g. same moves executed standing
instead of kneeling, abs exercise such as bird-dog). We
tested 3-5 incorrect executions for each subject. Testing
with a full set of data for a different exercise for the same
subject did not result in any false positives.
We checked whether the training is subject-specific by
testing with data for the same exercises but performed by
different subjects. In only one case, the child’s pose 3
way, the recognition algorithm for one subject
recognized execution by another subject, recognizing
47% of the executions as correct. In the same reversed
test, the recognition algorithm for the second subject did
not recognize any of the executions of the first one.
V. SUMMARY OF RESULTS
In total, to test the pattern recognition algorithm, the pilot
included three experiments in 3 different categories: simulated
data (2 patterns), scoliosis therapy for one patient (2 wearable
sensor methods), and 3 lower back exercises performed by 6
subjects, for a grand total of 1100 individual executions
including training. For each test we report the size of the data
Fig. 14. Light weight harness with sensor array. set, sensitivity and specificity. Table VI below shows the
summary of the results. The ground truth for each test set is
Even though the sample was not designed to represent any indicated as the total, followed by the number of true positives
specific population or spine condition, the volunteer data (TP) and true negatives (TN).
distribution shows a broad range in age, height and weight.
Table V shows the subject data. Table VI
SUMMARY OF RESULTS
TABLE V Training Test Set
LOWER BACK EXERCISE SUBJECT DATA Test Sensitivity Specificity
Set Size Size
Min. Max. Avg. 47:
Simulator
Age (years) 23 64 37 86 17TP, 81.21% 100%
Oval Pattern
30TN
Height (ft, in) 5’ 5’ 11” 5’ 6”
Simulator
Weight (lb) 112 180 142 86 15TN - 100%
Lobe Pattern
Scoliosis 16:
The 3 exercises were performed by 6 subjects, 4 females and Therapy
2 males. One of the females was the scoliosis patient from 35 9TP, 100% 100%
Exercise
another test, the remaining patients did not report any back (garment) 7TN
condition or undergoing treatment. Training set size was 21 Scoliosis 15:
executions, and test set size was 10 executions in all cases. Therapy
20 7TP, 70% 100%
Overall average execution time per exercise was 20 seconds. Exercise
Each subject performed at least 31 exercises for each case after (strap) 4TN
a short period of stretch, instruction and practice. Data 3 lower back 31 each:
collection sessions including the 3 exercises lasted 2 hours for flexibility 21 each 10TP 89% avg 100%
each subject. Video recordings were made for parts of each test. tests
Test correctness was visually supervised by the scientist (6 subjects) 25TN
administrating the test. Test results were as follows:
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 9
It is important to take into account that there are four data indication. The two check buttons at the bottom of the screen
types: simulated data, scoliosis exercise with custom garment, allow selecting whether the test is for the simulator (SIM) or the
scoliosis with exercise with strapped sensors, and lower back garment (GAR). As indicated before, the pass/fail decision is
exercises (5 subjects using light harness, 1 subject using custom based on the normalized test set and the distance threshold
garment). The sensitivity column in Table VI shows maximum computed during training. The app computes the SPMD
sensitivity for the scoliosis exercise wearing the custom between the test data and the average of the normalized training
garment mounted sensors, and the lowest sensitivity when using sequences.
strapped sensors at 70%. The lower back exercises using a
lightweight adjustable harness suitable for multiple users, In order to validate the performance of the pattern
shows the next best combined specificity of 92% (excluding the recognition algorithm running on Android, the app has been
custom garment subject who reports 80% sensitivity). The tested with the garment as well as the simulator setup. We
overall confusion matrix is shown in Table VII. conducted two app test sessions using the garment sensors for
the scoliosis patient, the first with 21 executions and the second
Table VII with 26 executions. The real-time sensitivity was 80% for the
first test, and 70.37% for the second test. If we combine the app
OVERALL CONFUSION MATRIX
test and the off-line test results for the scoliosis detection, the
overall sensitivity is 78.6%.
Pass Fail Performance
We tested the app with the simulator setup by conducting and
Correct 162 21 Sensitivity: 88.5% monitoring 15 executions. Sensitivity and specificity were
Incorrect 0 371 Specificity: 100% 100% for that test.
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 10
The time and effort associated with designing a custom monitor balance and motion which would require position
garment has benefits including simplifying experimental setup sensors. Signal dimensionality and computational
(e.g. attaching straps and sensors to a volunteer is cumbersome complexity implications will need to be addressed.
and time consuming) and improving reproducibility (e.g.
kinesiology tape placement could not be easily replicated). The VII. CONCLUSIONS
cost of a custom garment including tailoring, sensors and We have presented a technology and method to monitor
transmitter was $1500 and took several weeks to complete. An compliance and correctness of therapeutic spine exercise
alternative solution was found for the 6-subject test in which an performed under no supervision in the privacy of the person’s
elastic, light weight adjustable harness was used to hold the home. The wearable sensor component proposed may be
sensors as shown in Fig. 14. designed as a personalized, customized exercise garment, or as
The method we have presented is based on tracking 3 points a light harness made of adjustable elastic straps which can be
on the surface of the back during exercise. We acknowledge worn by different subjects without customization. The wearable
that the signals from the stretch sensors contain a pattern that is sensor solution using a custom garment is ideal for single
unique only in the specific context of a patient performing a subject tests, while multi-subject cases may be suited with the
given exercise. However, the high specificity results obtained adjustable light harness approach. The customized solution
in multiple experiments and settings suggest that the solution is would be the fallback if the light harness were not suitable
well suited for correctness monitoring. during future clinical tests.
Data collection required to train and test the system for one For the pilot test reported here, all subjects were asked and
user took an average of 40 minutes per exercise. That may indicated no issues regarding comfort and unencumbered
suggest that it may be feasible to prepare a personalized ability to exercise. Moreover, during breaks between exercises,
exercise program of 5 exercises in about 3.3 hours. the subjects were able to move around and behave freely
Our system design is not purported to be unique, but highly without need to re-adjust the sensor array before continuing the
efficient and robust for dynamic spinal posture monitoring. It exercises. However, we acknowledge that full usability surveys
is, however, the first to demonstrate that a wearable, triangular of the wearable sensor approach must be conducted during the
stretch sensor array built into a custom garment can be used to at-home, unsupervised phase of an exercise program during
detect PT exercise execution correctness in real time. future clinical trials.
The Android app implementation showed the feasibility of The pattern recognition algorithm is based on a simple
real time monitoring enhanced by a simple biofeedback classifier and associated distance metric and has shown
mechanism including text message and audio signal. We have encouraging performance in terms of sensitivity and specificity.
assumed that if a wearable sensor system can monitor correct The sensitivity and specificity obtained were the highest for the
exercise execution, then it would be feasible to conduct further custom garment (100%, 100%) while the simulator reached
research on biofeedback mechanisms to help improve 81% sensitivity and 100% specificity. For the scoliosis case
correctness rates. using strap mounted sensors we reached 70% sensitivity and
The long-term approach to biofeedback for PT exercise is 100% specificity and for the light harness method we reached
probably more complex than a simple audio reinforcement 89% sensitivity and 100% specificity for lower back exercise
signal. Visual biofeedback has been reported as the preferred case.
modality for biomechanical biofeedback [26], and with the Exercise correctness detection enabled implementation of a
rapid evolution of immersive visualization technology we simple biofeedback mechanism. The effect of PT on spine
expect it to be of relevance to PT exercise as suggested by the biomechanics, i.e. spine posture and curve changes open the
emergence of a physio-games industry [33]. door to pursuing dynamic visualization of patient specific
Although the approach presented here is believed to be models during exercise as a potential form of biomechanical
sound, there is still room for improvement. Several limitations and cognitive biofeedback.
remain and will be subject of continuing research and future The results of the pilot test reported are indicative of the
development: potential of the pattern recognition algorithm and training
method, while the proposed methods to mount the wearable
1. Develop a clinically approved LBP-PT exercise suite that sensor array did not show issues that would rule out their use in
can be supported by our design and investigate strategies future clinical trials and product development tests. We
to handle special cases such as exercises in which the back envision a future wearable product that will enable monitoring
comes in contact with the floor or gym equipment. PT patients in home-based programs aimed at achieving clinical
2. Scaling the triangular array method and algorithm to outcomes comparable to those of supervised PT. The need for
broaden its applicability. Multiple parts of the anatomy home based program support is highlighted by multiple studies.
could be monitored simultaneously by using more than For example, in a study with 74 women, when compliance was
one triangular array, i.e., a lower triangle, between hips determined by whether the exercise was performed at least 70%
and lower back, could be added for exercises involving of the prescribed frequency, compliance for the supervised
the hips or lower limbs. training program was 70% vs. 38% for the home based program
3. Incorporating other sensor types. The exercises [34]. We anticipate that accurate monitoring may also support
considered so far can be monitored efficiently with stretch approaches to improve PT adherence. A review of barriers to
sensors. However, we are open to the possibility of treatment adherence in physiotherapy was can be found in [35].
incorporating other types of sensors without sacrificing A key factor leading to a potential breakthrough is the
simplicity. For example, we may need to simultaneously
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2020.2971907, IEEE
Transactions on Biomedical Engineering
TBME-01699-2018 11
availability of patient data on compliance and correctness [20] L. Humbert et al. “3D reconstruction of the spine from biplanar X-rays
using parametric models based on transversal and longitudinal
which could be correlated with clinical outcomes. New and
inferences,” Med. Eng. Phys., vol. 31, no. 6, pp. 681-687, July 2009.
improved PT clinical trials will be possible with the proposed [21] A. Bulling et al., "A tutorial on human activity recognition using body-
approach including comparison of alternative exercise methods, worn inertial sensors," ACM Comp. Surv., Vol. 46, No. 3, Jan. 2014.
combined therapies, and personalized therapy. [22] H. Cao et al., "An integrated framework for human activity classification,"
in ACM Int. Conf. Ubiq. Comp., Pittsburgh, PA, UbiComp 2012, pp. 331-
340.
ACKNOWLEDGMENTS [23] T. E. Lockhart et al., "Wavelet based automated postural event detection
This work was supported by seed grants from Arizona State and activity classification with single IMU (TEMPO)," Biomed Sci.
Instrum., vol. 49, pp. 224-233, Aug. 2013.
University Global Sport Institute and the Fulton School of [24] T. Zhigang et al., "MSR-CNN: Applying motion salient region based
Engineering Research faculty Support Seed Program. The descriptors for action recognition," in Int. Conf. on Pattern Rec. (ICPR),
scoliosis therapy tests would not have been possible without the Cancun, Mexico, 2016, pp. 3524-3529.
[25] L. Goras and M. Fira, “Preprocessing method for improving ECG signal
valuable insights, advice and supervision of Dr. Anthony classification and compression validation,” in From Physics to Control
Pivonka, D.C. Through an Emergent View, L.Fortuna, A. Fradkov, and M. Frasca, Eds.,
pp. 20-25, 2010.
[26] Kos A., Umek A. (2018) “Biomechanical Biofeedback,” In:
REFERENCES Biomechanical Biofeedback Systems and Applications. Human–
[1] C. Kisner et al., “The Spine: Posture,” in Therapeutic Exercise: Computer Interaction Series. Springer, Switzerland, 2018, ch. 2, pp. 36-
Foundations and Techniques, 7th ed. Philadelphia, F.A. Davis, 1990, ch. 52.
14, pp. 429-471. [27] V. Asamoah et al., “Measuring the surface of the back. Value in diagnosis
[2] K.S. Bagraith et al., “Self-reported disability according to the of spinal diseases,” Orthopade vol. 29, pp. 480–489, June 2000.
International Classification of Functioning, Disability and Health Low [28] M. Betsch, et al., “Evaluation of a novel spine and surface topography
Back Pain Core Set: Test-retest agreement and reliability,” Disabil. system for dynamic spinal curvature analysis during gait” PloS one vol.
Health J., vol. 10, no. 4, pp. 621-626, Oct. 2017. 8, no. 7, July 2013.
[3] S. Ö. Anar, “The effectiveness of home-based exercise programs for low [29] M. Betsch et al., “Reliability and validity of 4D rasterstereography under
back pain patients,” J. Phys. Ther. Sci., vol. 28, no. 10, pp. 2727-2730, dynamic conditions,” Comput. Biol. Med., vol. 41, pp. 308–312, Apr.
Oct. 2016. 2011.
[4] A. Nag et al., "Wearable flexible sensors: a review," IEEE Sensors J., vol. [30] H. Berdishevsky et al., “Physiotherapy scoliosis-specific exercises - a
17, no. 13, pp. 3949-3960, July 2017. comprehensive review of seven major schools” Scoliosis and spinal
[5] E. Papi et al., “Wearable technology for spine movement assessment: A disorders, vol. 11, no. 20, Aug. 2016.
systematic review.” J Biomech., vol. 64, pp. 186-197, Nov. 2017. [31] J.M. Fritz et al., “Physical therapy for acute low back pain: associations
[6] C. Goodvin et al. “Development of a real-time three-dimensional spinal with subsequent healthcare costs,” Spine, vol. 33, no. 16, pp. 1800-1805,
motion measurement system for clinical practice,” Med. Biol. Eng. July 2008.
Comput., vol. 44, no. 12, pp. 1061–1075, Dec. 2006. [32] T. Kuru et al., “The efficacy of three-dimensional Schroth exercises in
[7] L. E. Dunne et al., "Wearable monitoring of seated spinal posture," IEEE adolescent idiopathic scoliosis: A randomized controlled clinical trial,”
Trans. Biomed. Circuits Syst., vol. 2, no. 2, pp. 97-105, June 2008. Clini. Rehabil. vol. 30, no. 2, pp. 181–190, 2016.
[8] A. Fathi and K. Curran, “Detection of spine curvature using wireless [33] C. Wibmer et al., "Video-game-assisted physiotherapeutic scoliosis-
sensors.” J. King Saud Univ. Sci., vol. 29, no. 4, pp. 553–560, Oct. 2017. specific exercises for idiopathic scoliosis: case series and introduction of
[9] O.M. Giggins et al. “Biofeedback in rehabilitation.” J. Neuroeng. a new tool to increase motivation and precision of exercise performance,"
Rehabil., vol. 10, no. 60, June 2013. Scoliosis and Spinal Disord., vol. 11, no. 44, pp. 1-9, Nov. 2016.
[10] N. Pop-Jordanova and A. Demerdzieva, “Biofeedback training for peak [34] H. Bentsen et al. “The effect of dynamic strength back exercise and/or a
performance in sport - case study,” Maced. J. of Med. Sci. vol. 3, no. 2, home training program in 57-year-old women with chronic low back pain.
pp. 113-118, Oct. 2010. Results of a prospective randomized study with a 3-year follow-up
[11] S.K. Lynn et al., “Validity and reliability of surface electromyography period,” Spine, vol. 22, pp. 1494-1500, July 1997.
measurements from a wearable athlete performance system” J. Sports Sci. [35] K. Jack et al. “Barriers to treatment adherence in physiotherapy outpatient
Med., vol. 17, no. 2, pp. 205-215. May 2018. clinics: a systematic review,” Man. Ther., vol. 15, no. 3, pp. 220-228, June
[12] G. Kwok et al., "Evaluation of myoelectric activity of paraspinal muscles 2010.
in adolescents with idiopathic scoliosis during habitual standing or
seating," BioMed Res. Int., vol. 2015, pp. 1-9, 2015.
[13] N. Kavcic et al., "Determining the Stabilizing Role of Individual Torso
Muscles During Rehabilitation Exercises," SPINE, vol. 29, pp. 1254-
1265, June 2004.
[14] B. Dworkin et al., “Behavioral method for the treatment of idiopathic
scoliosis,” Proc. Natl. Acad. Sci., vol. 82, pp. 2493-2497, Apr. 1985.
[15] E. Sardini et al., "Wireless wearable T-shirt for posture monitoring during
rehabilitation exercises," IEEE Trans. Instrum. Meas., vol. 64, no. 2, pp.
439-448, Feb. 2015.
[16] C. Coillard et al., "A new concept for the non-invasive treatment of
adolescent idiopathic scoliosis: the corrective movement principle
integrated in the SpineCor system," Disabil. Rheabil. Assist. Technol.,
vol. 3, no. 3, pp. 112-119, May 2008.
[17] L. Cohen et al., "Non-radiographic methods of measuring global sagittal
balance: a systematic review," Scoliosis Spinal Disord., vol. 12, no. 30,
Oct. 2017.
[18] Y. Santiesteban et al., “A method for detection and modeling of the human
spine based on principal curvatures,” in Progress in Pattern Recognition,
Image Analysis and Applications, Martínez-Trinidad J.F., Carrasco Ochoa
J.A., Kittler J. (eds). CIARP 2006. Lecture Notes in Computer Science,
vol 4225. Springer, Berlin, Heidelberg, 2006.
[19] A. Antal et al. “Virtually and depth sensor generated Moire pictures in
screening and treatment of scoliosis,” Optics, vol. 4, no. 3-1, pp. 24-28,
Aug. 2015.
0018-9294 (c) 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: University of Canberra. Downloaded on April 29,2020 at 17:58:01 UTC from IEEE Xplore. Restrictions apply.