Improving Fall Risk Assessment in Home Care: Interdisciplinary Use of The Timed Up and Go (TUG)

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Improving

Fall Risk
Assessment
in Home Care

The Timed Up and Go (TUG) is a popular, effec-


tive, and valid test of functional mobility and fall
risk that is often completed by registered nurses
(RNs) and physical therapists (PTs) throughout the
Interdisciplinary
course of a home care episode. As reimbursement
becomes tied to outcomes, it is essential that all
disciplines are consistent in their methods when
Use of the Timed
Up and Go (TUG)
administering the TUG. Results of this study con-
firm the hypothesis that test-specific training will
significantly improve reliability of the TUG when
completed by 2 different disciplines. The purpose
of this article is to describe an initiative that pro-
vided tool-specific training to all clinical staff at
our home care agency. The inter-rater reliability
Kristen Murphy, PT, MS, DPT, and
between PTs and RNs improved significantly from Susan Lowe, PT, DPT, MS, GCS, CEEAA
0.77 to 0.86 (p = 0.001) after standardized training
on administration of the TUG.

vol. 31 • no. 7 • July/August 2013 Home Healthcare Nurse 389

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Introduction as a tool, along with assessment of at least one
Fall Risk Assessment and Outcome and other nonmobility risk factor, to meet the criteria
Assessment Information Set for question M1910 (Anamaet & Krulish, 2011).
In 1999, the Centers for Medicare and Medicaid
Services (CMS) began requiring all Medicare- Literature Review
certified home healthcare agencies (HHAs) to col- Using the TUG to Determine Fall Risk
lect and report performance data using a tool The TUG is a simple, effective, and common test of
called Outcome and Assessment Information Set functional mobility. The TUG assesses a subject’s
(OASIS) (Centers for Medicare & Medicaid Ser- ability to stand up, walk 3 m, turn, walk another
vices, 2012a). The data collected are meant to 3 m, and then sit back down. It can provide a quick
represent the core items needed for a comprehen- assessment of functional strength, ability to ambu-
sive assessment of adult patients receiving home late, and dynamic balance (Podsiadlo & Richard-
care services (Centers for Medicare & Medicaid son, 1991). A great amount of clinical information
Services, 2012a). The information can be used by can be learned from the TUG. Normative reference
the HHA and CMS to measure patient outcomes values are available by age to determine above
and to assist with outcome-based quality improve- and below average scores (Bohannon, 2006).
ment. In addition to providing for patient assess- Extended TUG times have been shown to be pre-
ment and outcomes, OASIS data can and should dictive of difficulty with activities of daily living
be used for care planning. In 2010, OASIS-C was (Wennie Huang et al., 2010). Herman et al. (2011)
rolled out as the latest version of the data set. concluded that elevated TUG scores correlate
OASIS-C added process measures related to fall with early onset of mild cognitive decline. Alexan-
risk assessment and prevention. dre et al. (2012) found the TUG to be an accurate
Process quality measures are used to assess measure for screening the fall risk in older adults,
the rate of completion of specific evidence-based using a cut-off score of 12.47 seconds. There are
processes of care for high-risk, high-volume, several different cut-offs discussed in the litera-
problem-prone areas. Fall risk is one of these ture but the Alexandre study is the most recent.
areas (Centers for Medicare & Medicaid Services,
2012b). Although not required, CMS tracks and Inter-rater Reliability of the TUG
incentivizes HHAs to complete a fall risk assess- Reliability of the TUG is considered to be excellent
ment using a tool that is valid, standardized, and with an intraclass correlation (ICC) greater than
multifactorial. The completion of this fall risk as- 0.95 (Nq & Hui-Chan, 2005). It has been shown to be
sessment is documented in OASIS question reliable in a variety of clinical situations including
M1910 (Table 1). Failure to complete a multifac- in cases of Parkinson’s disease with an ICC = 0.80
tor fall risk assessment will negatively impact the (Huang et al., 2011), dementia with an ICC of 0.90
agency’s process measure report. Public report- (Blankevoort et al., 2013), and hip fracture after
ing of this finding is expected to encourage HHAs surgery with an ICC of 0.95 (Kristensen et al., 2011).
to follow best practices for fall prevention and The TUG is both sensitive and specific in re-
assessment (Anamaet & Krulish, 2011). The gards to identifying community-dwelling older
Timed Up and Go (TUG) test is commonly used adults (CDOAs) that are at risk to fall (Shumway-
Cook et al., 2000). It has been shown to be sensi-
Table 1. Outcome and Assessment tive to change and to have good reliability among
Information Set Question M1910 clinicians of varying levels of experience
M1910 Has This Patient Had a Multifactor Fall Risk (Shumway-Cook et al., 2000). Researchers have
Assessment (e.g., Falls History, Use of Multiple determined values for a minimally important
Medications, Mental Impairment, Toileting clinical difference ranging from 3.5 seconds in
Frequency, General Mobility/Transferring
Impairment, Environmental Hazards)? patients with Parkinson’s disease (Huang et al.,
2011) to 6.2 seconds in patients who average an
0 No multifactor falls risk assessment conducted initial time of 20 seconds (Kristensen et al., 2011).
1 Yes, and it does not indicate a risk for falls

2 Yes, and it does indicate a risk for falls


Predictive Value of the TUG
Source: Data from Centers for Medicare & Medicaid Services,
Although there are consistent data about the
2012b. ability of the TUG to identify subjects with a past

390 Home Healthcare Nurse www.homehealthcarenurseonline.com

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
history of falls, there is less conclusive evidence Methods
about the ability of the TUG to predict future Pretest
falls. Beauchet et al. (2011) identified only one One physical therapist (PT) and one registered
study that found a significant association between nurse (RN) administered the TUG to 15 CDOAs
TUG time and future falls during their systematic without any specific instructions or training. The
review. In their discussion, the variation of ad- home care agency had not completed any specific
ministration of the TUG among the various stud- training of the TUG for its clinical staff before this
ies was identified as a possible confounding fac- study. The CDOAs were volunteers recruited from
tor. Bergmann et al. (2009) showed that procedural an exercise class held at local senior center. The
differences, including verbal instructions, volunteers were predominantly women (13 women
distance marker, and chair type, can negatively and 2 men) with an average age of 68 years. The
affect reliability of the TUG. volunteers were divided into two groups. One
group completed the TUG with the nurse first and
Importance of Good Reliability then completed the TUG with the PT. The other
Reliability of a clinical measure is one of the most group completed the TUG initially with the PT and
important characteristics of a test. Reliability is then with the nurse. Each clinician had the CDOAs
the ability of a test score to be consistent when complete a practice run-through of the TUG and
repeated. A measure is thought to be reliable if two timed trials of the TUG. The average of the two
consistent scores are obtained under consistent trials was used for statistical purposes. The physi-
conditions. When analyzing the effectiveness of cal setup, including measurement of the 3-m
therapy interventions, it is critical that the data course, was established by the author and was
used to determine these outcomes are reliable. consistent for each clinician. The data were not
Given the importance these data can have in de- shared among clinicians. Inter-rater reliability was
termining functional outcomes, it is imperative determined between each discipline.
that the testing be completed as described by
best practice guidelines. The value of the score is Training
only as good as the quality of the data. One week later, the RN and PT participated in a
specific training session for administration of the
Problem TUG. The training was completed in an agency-
Using TUG Scores to Determine Outcomes sponsored training event offered to the entire
Although the inter-rater reliability of the TUG is clinical staff (RNs, PTs, and occupational thera-
good between physical therapists (PTs), there pists) of the HHA. The training protocol was
does not appear to be any literature on the reli- based on best practices as indicated in the CDC’s
ability of the TUG between different disciplines. “Tools to Implement the Otago Exercise
The TUG test is often completed by nurses at program”(National Center for Injury Prevention
the initial nursing visit as part of the require- and Control, 2012) (Table 2). A post-training ques-
ment to complete a multifactor fall risk assess- tionnaire was filled out by all clinicians who par-
ment. The degree to which the admitting nurse ticipated in the training session (Table 3). The
or PT is trained in the administration of the TUG questionnaire surveyed the clinicians’ confidence
varies between agencies. The variation in the in administration of the TUG and perception of
way the TUG is completed can be related to a the TUG before and after the training session.
lack of consistent training. The TUG is a popular
test among PTs when it is time for reassessment. Posttest
There are frequent occurrences where a clini- Five days after the training, the PT and the RN
cian would like to compare the reassessment administered the TUG to 15 different CDOAs
TUG score to the score obtained at the admis- using the same procedure. Again, inter-rater
sion visit for outcomes studies. For the purpose reliability was calculated between disciplines.
of this study, outcomes are defined as the prog-
ress made on the TUG as the result of therapy. If Results
the initial TUG was completed by the nurse, can There were no significant differences found be-
the therapist use that score as a baseline to tween the two groups of CDOA that participated
determine progress? in the TUG trials in terms of age or gender. The

vol. 31 • no. 7 • July/August 2013 Home Healthcare Nurse 391

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
inter-rater reliability of the TUG was calculated the TUG. The interdisciplinary reliability of the
by using the Pearson correlation coefficient. The TUG scores improved after standardized training
reliability of the TUG scores between the PT and (r = .86), indicating a level of consistency among
the nurse prior to the training session was 0.77, scores that is considered good (Portney &
indicating a level of consistency among the Watkins, 1993). The change in inter-rater reliability
scores that is good but not as high as the inter- was significant at a level of p = .001 (Figure 1).
rater reliability normally found when performing Observation analysis of the testing procedures
prior to training revealed several inconsistencies
Table 2. Standardized Timed Up and between the clinicians’ administration of the test.
Go Protocol Variations in verbal instructions included different
Standardized Verbal Instructions instructions regarding walking speed (normal or
fast pace) and the exact location to turn and return
When I say “Go,” I want you to: to the chair (walk past the line or walk to the line).
There was a lack of consistency between clinicians
1. Stand up from the chair.
2. Walk to the line on the floor at your normal pace. and between trials of the same clinician in regards
3. Turn. to exact start and stop time recorded via the stop-
4. Walk back to the chair at your normal pace. watch. Several different start times were used,
5. Sit back down again. including when the CDOA started to move, when
Standardized Timing Instructions the CDOA actually lifted off the chair, and when the
clinician said go. It was observed that during some
On the word “Go” begin timing. trials no command of “go” was given and the tim-
ing started when the CDOA started to move. Stop
Stop timing after patient has sat back down and record. times varied as well, though not to the same ex-
Time: ______________ (seconds) tent. After training, improved consistency of ver-
bal instructions and timing criteria was observed.

Table 3. Post-training Questionnaire

Please indicate your discipline RN PT

Please indicate your level of confidence when performing the TUG:


No Some Very
NA Confidence Confidence Confident Confident
0 1 2 3 4

Prior to this training, how confident were you in


your ability to complete the TUG properly? 0 1 2 3 4

After completing this training, how confident do


you feel in your ability to assess a patient's fall risk? 0 1 2 3 4

Not Somewhat Very


NA Likely Likely Likely Likely
0 1 2 3 4

After completing this training, how likely is it that you


will complete the TUG with your patients more often
than at start of care? 0 1 2 3 4

After completing this training, do you have a greater appreciation for the TUG? Yes No

Notes: PT = physical therapist; RN = reigstered nurse; TUG = Timed Up and Go test.

392 Home Healthcare Nurse www.homehealthcarenurseonline.com

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Interdisciplinary Reliability: Pre- and Post-training
Pearson Correlation Coefficient (p = .001)
1

0.9
0.86

0.8
0.77

0.7

0.6

0.5
Pretest r value Posttest r value

Figure 1. Inter-rater reliability.

Discussion of Findings 1. Consistent physical setup: As described in


Results of this study confirm the hypothesis that the original study, Podsiadlo and Richardson
test-specific training will significantly improve reli- (1991) used an upright chair with a seat
ability of the TUG test when completed by two dif- height of 47 cm. In a patient’s home, it is
ferent disciplines. The key to improved reliability critical to find an appropriate chair from
between disciplines appears to be specific instruc- which to start the test. Low couches, soft
tion in best practice guidelines for proper physical recliners, or chairs without armrests are
setup, verbal instructions, and timing criteria. not appropriate for use with the TUG. To
improve consistency of the measurement of
A Model for Mandatory Training the 3-m walking course, 3-m lengths of string
In-service training was provided to approxi- were provided to all clinicians for use in the
mately 120 clinicians at Visiting Nurses & Health home. Clinicians were instructed to use the
Services of CT over the course of 1 day. The string to mark the course and then remove
staff was divided into groups of four to five clini- the string for the actual test. It was assumed
cians who were assigned a specific training time that measuring 3 m in the home was a great
scheduled at 15-minute intervals. The RN and source of variability between clinicians.
PT who participated in the research study Anecdotally, during the training sessions,
attended this training event. Training consisted several clinicians attempted to confirm the
of instruction in proper physical setup, verbal accuracy of pacing out 3 m with their own
instructions, and timing guidelines (Figure 2). steps only to be surprised at how poorly this
Groups of clinicians timed one volunteer sub- method correctly measures 3 m. Consistent
ject as they walked the TUG. Scores were com- physical setup is crucial to reliable data.
pared between the clinicians. Clinicians were 2. Standardized verbal instructions: Podsiadlo
deemed competent in administration of the TUG and Richardson (1991) published specific in-
when scores were within 0.5 seconds of each structions to be used during the test (Table 2).
other. This wording is considered to be the standard.

vol. 31 • no. 7 • July/August 2013 Home Healthcare Nurse 393

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Without specific and standardized instruc- TUG scores obtained at admission by RNs are to
tions, variability among scores will increase. be compared to TUG scores obtained by PT at
Patients are instructed to ambulate at a time of reassessment, HHAs should be instituting
“normal pace.” It is a common misconception an education process for all staff to assure con-
that the patient should be told to ambulate as sistency. The level of reliability can be adequate
quickly as possible. The verbal instructions for accurate reassessment of progress if the
also include directions to walk “to the line.” recommendations identified are followed.
There is no need to go past the line. Reliability After training on the TUG, the interdisciplin-
is greatly improved when patients are pro- ary reliability improved to the level of 0.86. This
vided with the same instructions at all times. is less than previously documented inter-rater
3. Established timing criteria: Timing of the TUG reliability between PTs. Kristensen et al. (2011)
test should be completed with a stopwatch reported an ICC of .95 in patients with hip frac-
or timer. A stopwatch feature can be found ture. The inter-rater reliability was found to be
on almost all cell phones. Use of the second .91 in a study of the effect of cognitive deficits
hand on a watch is not an acceptable method on the TUG (Nordin et al., 2006). The difference
of timing. Instructions for start and stop in the reliability between PTs and RNs may be
times are very clear. Timing of the TUG test related to the experience and training PTs have
should start on the word “Go.” It is important in movement observation and analysis. Addi-
to capture the patient’s ability to process tional methods of training may be beneficial,
the command and react to it. Patients with including training with actual agency patients in
mild cognitive impairment may have delays their own home. Future studies may be indi-
in the processing of this command and this cated to further determine how interdisciplin-
delay needs to be captured in the TUG score ary reliability of functional screening tests can
(Herman et al., 2011). By starting the timing be improved.
on the word “Go,” the TUG is assessing a pa-
tient’s ability to rise from a chair in a timely Clinician Confidence Pre- and Post-training
manner. As a patient’s strength improves and In an effort to assess the perceptions and confi-
the sit-to-stand transfer becomes easier, the dence level of the clinicians related to their abil-
TUG score will reflect that improvement only ity to complete the TUG, 103 clinicians completed
if the start time is accurate and consistent. a questionnaire after the training session—see
The timing should end when the patient has Table 3. Only 9% of RNs reported they were “very
returned to sitting and the back of the patient confident” in their ability to administer the TUG
contacts the back of the chair. By clearly before the training session. In contrast, 100% of
defining the exact moment to start and stop the PTs reported they were “very confident” in
the timing of the test, reliability of the TUG is their administration of the TUG. After the train-
greatly improved. ing session, 83% of RNs surveyed responded as
being “very confident” in their ability to properly
TUG Scores for Outcome Studies complete the TUG—see Figure 3. Of these 83%,
Without specific training, the inter-rater reliabil- 62% stated they would now be more likely to
ity of the TUG, in this pilot study, is not adequate complete the TUG at time points other than at
to determine progress at time of reassessment. If the start of care as needed. Although the TUG is

Standardized Standardized Standardized


Mandatory Reliable
Physical Set- Verbal Timing
Training Data
Up Instructions Criteria

Figure 2. A model for clinician training.

394 Home Healthcare Nurse www.homehealthcarenurseonline.com

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Administering the TUG:
RN Confidence Before and After Training
100%

90% % Very Confident


83%
80%

70%

60%

50%

40%

30%

20%
9%
10%

0%
Before Training After Training

Notes: RN = registered nurse; TUG = Timed Up and Go test.


Figure 3. Clinician confidence.

a required part of the initial start of care visit for based on best practice standards of administra-
this agency, the TUG can be used intermittently tion of the TUG at time of initial hiring and annually
as determined by the clinician to assess progress after that as a part of annual competencies. Consis-
and fall risk. One hundred percent of all clinicians tent verbal instructions, consistent timing guide-
surveyed reported a greater appreciation for the lines, and consistent physical setup are required to
TUG and its clinical value after the in-service maximize reliability and the value of any outcomes
training. that use the TUG data. With adequate training,
initial TUG scores can be used for comparison at
Limitations time of reassessment regardless of which disci-
This is a small pilot study that compared inter- pline completed the test at start of care.
rater reliability between one PT and one RN.
Although the entire clinical staff of the agency Need for Ongoing Research
(RNs, PTs, occupational therapists) completed Given the collaborative nature of healthcare, it is
the training, the interdisciplinary reliability was imperative that adequate reliability is present in
calculated with one PT and one RN on a small all assessments that are completed by multiple
number of CDOAs. Future studies should include disciplines. Although the interdisciplinary reli-
a larger number of clinicians and subjects. ability of the TUG improved significantly with this
Another limitation was the use of healthy CDOAs training program, there is still room for improve-
as compared to actual patients. Similarly, the TUG ment. Additional ways to improve consistency
test was completed in a controlled environment in across disciplines include training with actual
the community (a senior center) as compared to patients, training in the home environment, and
in the home. Finally, this study addresses these more frequent training. Future studies may want
concerns in one agency within one state and the to investigate not only the TUG but also other
results may not carry over across the country. valuable clinical tools that are commonly used
across disciplines and in the home.
Discussion and Implications
The findings of the study indicate that home Kristen Murphy, PT, MS, DPT, is a Physical Thera-
healthcare clinicians should complete a TUG train- pist at Visiting Nurse & Health Services of CT, and
ing program and pass a competency examination a recent Doctoral Graduate, CPS Bouve College of

vol. 31 • no. 7 • July/August 2013 Home Healthcare Nurse 395

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Health Sciences, Northeastern University, Manchester, Bohannon, R. W. (2006). Reference values for the Timed
Connecticut. Up and Go test: A descriptive meta-analysis. Journal
Susan Lowe, PT, DPT, MS, GCS, CEEAA, is of Geriatric Physical Therapy, 29(2), 64-68.
the Director of the Transitional DPT Program, CPS Herman, T., Giladi, N., & Hausdorff, J. M. (2011). Proper-
ties of the “Timed Up and Go” test: More than meets
Bouve College of Health Sciences, Northeastern
the eye. Gerontology, 57(3), 203-210.
University, Boston, Massachusetts.
Centers for Medicare & Medicaid Services. (2012a). Home
This article was submitted in partial fulfillment health quality initiative. Retrieved from http://www
of a doctorate of physical therapy degree for the .cms.gov/Medicare/Quality-Initiatives-Patient-Assess
Bouve Institute, Northeastern University, Boston, ment-Instruments/HomeHealthQualityInits/index.html
Massachusetts. Centers for Medicare & Medicaid Services. (2012b). Home
The authors extend special thanks to Dr. Susan health quality initiative/quality measures. Retrieved
Lowe and Dr. Khalid Bibi of Northeastern University from http://www.cms.gov/Medicare/Quality-Initiatives-
for guidance with research design and statistical Patient-Assessment-Instruments/HomeHealthQuality
analysis and to the management team and clinical Inits/HHQIQualityMeasures.html
staff of Visiting Nurse & Health Services of CT for Huang, S. L., Hsieh, C. L., Wu, R. M., Tai, C. H., Lin, C. H., &
Lu, W. S. (2011). Minimal detectable change of the Timed
support and active participation in the research
“Up & Go” test and the dynamic gait index in people
and training interventions.
with Parkinson disease. Physical Therapy, 91(1), 114-121.
The authors and nurse planners have disclosed Kristensen, M. T., Henriksen, S., Site, S. B., & Bandholm,
that they have no financial relationships related to T. (2011). Relative and absolute intertester reliability
this article. of the Timed Up and Go test to quantify functional
Address of correspondence: Kristen Murphy, PT, mobility in patients with hip fracture. Journal of the
MS, DPT, Visiting Nurses & Health Service of CT, American Geriatrics Society, 59(3), 565-567.
8 Keynote Dr., Vernon, CT 06066 (kristy.murphy@ National Center for Injury Prevention and Control. (2012).
snet.net). Tools to implement the Otago exercise program: A
program to reduce falls. Atlanta, GA: Centers for Dis-
ease Control and Prevention.
DOI:10.1097/NHH.0b013e3182977cdc
Nordin, E., Rosendahl, E., & Lundin-Olsson, L. (2006).
Timed “Up & Go” test: Reliability in older people
REFERENCES dependent in activities of daily living—focus on cog-
Alexandre, T. S., Meira, D. M., Rico, N. C., & Mizuta, S. nitive state. Physical Therapy, 86(5), 646-655.
K. (2012). Accuracy of Timed Up and Go test for Nq, S. S., & Hui-Chan, C. W. (2005). The Timed Up & Go
screening risk of falls among community-dwelling test: Its reliability and association with lower-limb
elderly. Revista Brasileira de Fisioterapia (Brazil), impairments and locomotor capacities in people
16(5), 381-388. with chronic stroke. Archives of Physical Medicine
Anamaet, W. K., & Krulish, L. H. (2011). Fall risk as- and Rehabilitation, 86(8), 1641-1647.
sessments in home care: OASIS-C expectations. Podsiadlo, D., & Richardson, S. (1991). The Timed “Up
Home Health Care Management & Practice, 23(2), & Go”: A test of basic functional mobility for frail
125-138. elderly persons. Journal of the American Geriatrics
Beauchet, O., Fantino, B., Allali, G., Muir, S. W., Montero- Society, 39(2), 142-148.
Odasso, M., & Annweiler, C. (2011). Timed Up and Portney, L. G., & Watkins, M. P. (1993). Foundations of
Go test and risk of falls in older adults: A systematic Clinical Research: Applications to Practice. Norwalk, CT:
review. Journal of Nutrition, Health, & Aging, 15(10), Prentice Hall.
933-938. Shumway-Cook, A., Brauer, S., & Woollacott, M. (2000).
Bergmann, J. H., Alexiou, C., & Smith, I. C. (2009). Pro- Predicting the probability for falls in community-
cedural differences directly affect Timed Up and dwelling older adults using the Timed Up & Go test.
Go times. Journal of the American Geriatrics Society, Physical Therapy, 80(9), 896-903.
57(11), 2168-2169. Wennie Huang, W. N., Perara, S., VanSwearingen, J., &
Blankevoort, C. G., Van Heuvelen, M. J., & Scherder, E. J. Studenski, S. (2010). Performance measures predict
(2013). Reliability of six physical performance tests onset of activity of daily living difficulty in commu-
in older people with dementia. Physical Therapy, nity-dwelling older adults. Journal of the American
93(1), 69-78. Geriatrics Society, 58(5), 844-852.

For 68 additional continuing nursing education articles on


research topics, go to nursingcenter.com/ce.

396 Home Healthcare Nurse www.homehealthcarenurseonline.com

Copyright © 2013 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.

You might also like