Professional Documents
Culture Documents
Michael Et Al-2013-Journal For Healthcare Quality
Michael Et Al-2013-Journal For Healthcare Quality
Keywords
ambulatory/physician
office
community/public
health
patient satisfaction
performance
improvement models
quality improvement
The authors have disclosed they have no significant relationships with, or financial interest in, any commercial
companies pertaining to this article.
C 2013 National Association for
Healthcare Quality
Intended Improvement
The purpose of the quality improvement (QI)
pilot project described here was to increase
patient satisfaction by minimizing wait times
in a Florida county health department (CHD)
Adult Primary Care Unit (APCU) practice using
the Dartmouth Microsystem Improvement Curriculum (DMIC) framework (Nelson, Batalden,
& Godfrey, 2007) and the Plan-Do-Study-Act
(PDSA) improvement process (Institute for
Healthcare Improvement, n.d.). Key study objectives included (a) identification of factors
that contribute to long waiting room and exam
room wait times, (b) identification of opportunities for improvement, (c) implementation of
one or more process improvements using the
PDSA model for improvement, and (d) evaluation of the impact on patient wait times, patient
satisfaction with wait times, and overall satisfaction with the care experience. Project approval
was obtained from the Florida Department of
Health and the University of Florida Behavioral/NonMedical Institutional Review Boards.
Methods
Setting
The CHD where the pilot was conducted is the
principal primary care safety net provider in
the community, with three practice sites and an
aggregate practice panel of more than 35,000
patients (Florida Department of Health, 2010).
The study was conducted in the APCU at the
Health Departments central practice location.
In a typical month the practice team in this unit,
consisting of two physicians and two advanced
practice nurses (APN), provides care for approximately 1,500 patients. Approximately 79%
of patients are White, 16% are Black/African
American, 2% are Asian, and 23% are Hispanic. Prevalent health problems include hypertension, diabetes, hyperlipidemia, depression, and chronic pain. Patient satisfaction
survey scores in the wait time category have historically lagged other satisfaction measures by
six to ten percentage points. Clinic managers
reported complicated visit routines involving
too many steps and delays as key obstacles to
timely patient care.
Establishing a functional relationship between process change and healthcare outcome variation is fundamental to the PDSA QI
methodology (Speroff & OConnor, 2004). The
pretest/posttest preexperimental design is consistent with these objectives and was selected
for this project. It is also consistent with iterative learning, which is fundamental to the PDSA
method. An eight-phase implementation plan,
based on principles and concepts of the DMIC
as described by Nelson et al. (2007), was followed. The project unfolded over a period of
6 months. Key objectives, activities, tools, and
methods used in each phase are summarized in
Table 1.
Members of the project study team and
APCU staff members met initially to complete
the tasks associated with project phases one
through three, which include defining, measuring, and analyzing drivers of patient dissatisfaction with wait times. The results are summarized in the Ishikawa diagram shown in
Figure 1. Four main categories of causes
emerged: front-end operations, back-end operations, patient work-up, and ancillary services.
Within this study design, as outlined in
Table 1, the first phase of the PDSA cycle was
launched in project phase four. Key tasks associated with this phase included selection of specific test of change strategies and collection of
baseline data for future comparison. The highly
participative multivoting method enabled the
group to establish a clear set of priorities. Using
this method, APCU team members decided to
focus the intervention on front-end operations.
In addition to tasks associated with patient registration, team members working in this area
were also responsible for performing reception
duties, answering phones, and responding to
inquiries from patients and staff. These additional tasks resulted in a continuous stream
of interruptions and delays in completion of
registration processes. Baseline data collected
during the preintervention data collection period revealed a mean waiting room wait time of
28 min and a mean exam room wait time of
14 min; initial wait time targets for each category were set at 20 and 10 min, respectively.
Implementation
In project phase five, three specific strategies
were implemented with the goal of reducing
interruptions for the front office staff and allowing them to focus on patient registration
51
52
Phase 2
Phase 3
Phase 4
Increase knowledge of
APCU clinical
microsystem and
opportunities for
improvement
Identification and selection
of a theme for
improvement
Focus and align
improvement efforts
with improvement
theme; connect theme
to daily work processes
Plan: Define and focus
improvement activities;
connect improvement
theme and aims to daily
work processes
Phase 5
Phase 6
Phase 7
Phase 8
Follow through on
improvement
Key Activities
Tools/Methods
Assessment of clinical
microsystem using the 5Ps
(Nelson et al., 2007)
framework
Brainstorming; multivoting
Accessible at www.clinicalmicrosystem.org.
tasks. A temporary reception station was created in the main hallway just outside the entrance to the APCU. A receptionist from the
clerical float pool was assigned to greet, assist,
Methods of Evaluation
The evaluation plan included two key wait time
process measures: waiting room wait time and
exam room wait time. Waiting room wait time was
defined as the time elapsed between requesting
that the patient be seated in the waiting room
and the time he/she was called to be placed in
an exam room. Exam room wait time was defined as the amount of time elapsed from the
time the patient was seated in an exam room
and the time the physician or APN entered the
room.
Convenience sampling was employed. Waiting room and exam room wait time data were
collected for all APCU patients seen during
the preimplementation and postimplementation wait time data collection periods. An instrument developed by study team members allowed APCU staff to record (a) time of patient
arrival, (b) time the patient was seated in the
53
54
Analysis
All data were initially entered into two Microsoft
Office Access databases created exclusively for
the purpose of managing patient wait time data
and patient satisfaction data, respectively. The
data were subsequently imported into Microsoft
Excel and analyzed using Excel and Centers for
Disease Controls Epi Info. Two primary analyses were conducted. The t-test was used to compare mean wait times prior to and following
implementation of the test of change intervention. Chi-square was used to examine and compare patient satisfaction with waiting room and
exam room wait times, as well as the likelihood
of referring friends and family, for the pre- and
postimplementation periods. An alpha level of
.05 was used for all statistical tests.
Results
Sample Description
A comparison of the age and gender characteristics of the sample population and the entire
APCU population are summarized in Table 2.
The proportion of patients in the 18- to 44year age group was significantly lower and the
proportion in the 45- to 64-year age group was
significantly higher in the sample population
when compared to the entire APCU patient
population.
Wait time data were captured for 98%
(349/355) of patients seen by APCU providers
during the preimplementation wait time data
collection period and for 97% (365/375) of patients seen during the postimplementation wait
time data collection period. Missing and ambiguous data elements were identified in one
or both data categories for 6% of visits sampled
Postimplementation
Participants
APCU
Population
Age Groups
n = 262
n = 285
N = 10,057
1844
4564
>65
124 (47%)
119 (45%)
19 (7%)
133 (47%)
135 (47%)
17 (6%)
6,258 (62%)
3,240 (32%)
559 (6%)
n = 263
n = 284
N = 10,057
111 (42%)
152 (58%)
126 (64%)
158 (56%)
4,046 (40%)
6,011 (60%)
Gender
Male
Female
2 = 52.99
df = 4
<.001
2 = 2.33
df = 2
.312
Wait Time
The results of a comparison of mean waiting
room wait times for the pre- and postimplementation periods are summarized in Table 3. Mean
waiting room wait time for patients seen during
the postimplementation period was 5.33 min
shorter when compared to the preimplementation period. This difference was significant
(p = <.001). Mean exam room wait time following test of change implementation was 1.81
min shorter. This difference was also significant
(p = .047). Although these results were significant, targeted wait time goals (i.e., 20 min in
the waiting room category and 10 min in the
exam room category) were not met.
Patient Satisfaction
Results of the Chi-square analysis of patient satisfaction scores in the waiting room wait time,
exam room wait time, and likelihood of refer-
55
56
Range
SD
327
355
1133
1153
28.38
23.05
18.94
16.83
3.89
<.001
331
352
063
057
14.45
12.64
12.15
11.56
1.99
.047
Scale Response
Fair
2
OK
3
Good
4
Great
5
Waiting
Room
Pre
Post
42
24
40
36
71
76
76
93
38
59
= 10.77
df = 4
.029
Exam
Room
Pre
Post
31
16
27
31
66
72
86
89
51
71
2 = 8.06
df = 4
.089
Likely to refer
Pre
Post
6
8
5
3
23
19
85
91
126
142
2 = 1.69c
df = 4
.793
Preintervention period patient responses. Postintervention period patient responses. An expected value is <5. Chi-square may not be
valid.
Discussion
Summary and Relation to Other Evidence
The APCUs baseline waiting room wait time
of 28 min is consistent with those reported in
other large-scale studies (Leddy et al., 2003;
Press Ganey, 2009). Using the DMIC framework
and PDSA improvement process, significant reductions in the mean waiting room and exam
room wait times along with a significant increase in patient satisfaction with waiting room
wait time were achieved. No significant changes
in patient satisfaction with exam room wait time
or the likelihood of referring friends or family
were identified.
Although the wait time data collection instrument proved adequate, APCU and study
team members identified opportunities for instrument improvement in future PDSA cycles.
They also identified the need for improvement
in the accuracy and synchronization of timepieces used to collect wait time data.
Interpretation
Limitations
Key study limitations include use of a preexperimental pretest/posttest design, convenience
sampling strategy, and lack of historical information on the psychometric properties of
the patient satisfaction survey instrument. One
of the defining characteristics of QI relates
to demonstration of the relationship between
process and system improvements, which are
frequently multifaceted, and significant differences in targeted outcome or process measures
that are sustained over time (Ogrinc et al.,
2008). The results of the analyses reported here
provide only preliminary support for the hypothesis that the strategies implemented during this pilot resulted in meaningful improvements for APCU patients and staff. Replication
and consistent movement of key measures in
the desired directions over time using rigorous evaluation methods will provide the level of
evidence required for informed decision making regarding future improvement efforts using
this model.
A comparison of race and ethnicity characteristics of sample participants and the entire
APCU population was precluded by inconsistencies in methods used to categorize and collect data between the patient satisfaction survey
instrument and SCHDs information technology reporting systems. These issues will need to
be addressed prior to implementation of subsequent PDSA cycles.
The relative weights of the three process improvement strategies employed during the pilot cannot be quantified, however, at the conclusion of the study APCU staff members, managers, and study team member agreed that construction of a separate permanent reception station near the entrance of the unit would be
essential to achieving and sustaining targeted
wait time objectives. This recommendation was
approved by the CHD administration and the
construction was completed within a few weeks
of pilot conclusion.
57
58
Conclusion
The results of this project provide additional
support in favor of the DMIC framework and
PDSA improvement method as viable options
for conducting QI and achieving wait time
process improvements. The pretest/posttest
preexperimental study design employed is consistent with iterative learning which is fundamental to the PDSA method. It provides a
model for conducting sequential repetitive tests
of change over time that can lead to meaningful and sustained improvement in the delivery
of care and practice performance in a variety of
ambulatory care settings.
Acknowledgments
The authors wish to acknowledge and express
their gratitude to the following individuals who
participated in the planning and implementation of this project: Amanda Daly, Dianne
Nugent, Elizabeth Smith, Linda Flanagan, Marguerite Rappoport, Barbara OConnor, and
members of the Adult Primary Care Unit team.
References
Centers for Medicare and Medicaid. (2010). National health expenditures fact sheet. Retrieved March 1,
2011, from www.cms.gov/NationalHealthExpendData/
25_NHE_Fact_Sheet.asp.
Drain, M. (2007). Will your patients return? The foundation for
success. Retrieved June 24, 2010, from www.pressganey.
com/galleries/default-file/medical-practice_4.pdf.
Florida Department of Health. (2010). Personal health users
report [Data file]. Retrieved December 1, 2010, from
http://dohiws.doh. state.fl.us.
Garman, A. N., Garcia, J., & Hargreaves, M. (2004). Patient
satisfaction as a predictor of return-to-provider behavior:
Analysis and assessment of financial implications. Quality
Management in Health Care, 13, 7580.
Health Resources and Services Administration. (n.d.).
Health center patient satisfaction survey. Retrieved July
7, 2010, from http://bphc.hrsa.gov/patientsurvey/
default.htm.
Institute for Healthcare Improvement. (n.d.). Plan-DoStudy-Act (PDSA) worksheet (IHI tool). Retrieved July
15, 2010, from www.ihi.org/IHI/Topics/Improvement/
Improvement Methods/Tools/Plan-Do-Study-Act+%28
PDSA%29+ Worksheet.htm.
Authors Biographies
Melanie J. Michael, DNP, MS, FNP-C, CAPPM, CPHQ,
is an Assistant Professor at the University of South Florida
College of Nursing in Tampa, Florida, where she teaches
nursing leadership, healthcare quality improvement, and
patient safety.
Susan Schaffer, PhD, ARNP, FNP-BC, is Clinical Associate Professor and Chair, Department of Womens, Childrens Family Nursing at University of Florida College of
Nursing in Gainesville, Florida, where she also coordinates
the Family Nurse Practitioner Track. She is Editorial Board
Member for Clinical Nursing Research, An International
Journal and reviewer for Biological Research for Nursing.
Patricia L. Egan, MSN, RNC, CNL, CAPPM, is a Nursing Program Consultant at the Sarasota County Health
a.
b.
c.
d.
a.
b.
d.
r
r
Questions:
1. An examination of the Pareto chart analysis presented suggests that
a.
b.
c.
d.
c.
Objectives
r Explain the relationship among wait time, pa-
59
60
a.
b.
c.
d.
8. The results of this pilot provide additional support for the hypothesis that
a.
b.
c.
d.
Measure the proportion of primary care patients referred by other practice patients
b.
c.
d.
11. Within the Dartmouth Clinical Microsystem Curriculum framework, the method of choice for testing change ideas is the
a.
b.
c.
d.
Chi square
Pareto chart
PDSA model for improvement
Delphi technique