Professional Documents
Culture Documents
Large Scale Spread High Impact Interventions Massoud Et Al
Large Scale Spread High Impact Interventions Massoud Et Al
Large Scale Spread High Impact Interventions Massoud Et Al
IMPROVEMENT
PROJECT
HARVARD
School of Public Health
T E C H N I C A L R E P O RT
SEPTEMBER 2010
This report was prepared by the USAID Health Care Improvement Project (HCI), implemented by University Research Co., LLC (URC), for review by
the United States Agency for International Development (USAID) and by request of the World Health Organization (WHO) Patient Safety Programme
and the Harvard School of Public Health. It was authored by M. Rashad Massoud (URC), Katlyn L. Donohue (URC), and C. Joseph McCannon (Institute for
Healthcare Improvement). The USAID Health Care Improvement Project is made possible by the generous support of the American people through USAID.
T E C H N I C A L R E P O RT
SEPTEMBER 2010
DISCLAIMER
The views expressed in this publication are those of the authors and do not necessarily reflect those of USAID, the United States
Government, the World Health Organization Patient Safety Programme, or the Harvard School of Public Health.
Acknowledgements
The authors kindly acknowledge the contribution of the reviewers of this document, who included: Lisa Schilling and Alide Chase,
Kaiser Permanente; Gail Nielson, Iowa Health System; Ann Hendrich and David Pryor, Ascension Health; Edward Kelley, World
Health Organization; Atul Gawande and Angela Bader, Harvard School of Public Health; and Marie Schall, Institute for Healthcare
Improvement.
This report was prepared by University Research Co., LLC (URC) for the USAID Health Care Improvement Project (HCI), which is
made possible by the generous support of the American people through the United States Agency for International Development
(USAID). HCI is managed by URC under the terms of Contract Numbers GHN-01-01-07-00003-00 and GHN-0I-03-07-00003-00.
URC’s subcontractors for HCI include EnCompass LLC, Family Health International, Health Research Inc., Initiatives Inc., the Institute
for Healthcare Improvement, Johns Hopkins University Center for Communication Programs, and Management Systems International.
For more information on HCI’s work, please visit www.hciproject.org or contact hci-info@urc-chs.com.
Recommended citation: Massoud MR, Donohue KL, and McCannon CJ. 2010. Options for Large-scale Spread of Simple, High-
impact Interventions. Technical Report. Published by the USAID Health Care Improvement Project. Bethesda, MD: University Research
Co. LLC (URC).
Executive Summary.......................................................................................................................................iii
I. Introduction..............................................................................................................................................1
II. Background...............................................................................................................................................1
VII. References.............................................................................................................................................. 22
Figure 11: Russia: Percentage of neonates arriving NICU Neonatal intensive care unit
at the neonatal center with hypothermia, 1999–2001................... 14 NKE Nurse Knowledge Exchange
Figure 12: Russia: Neonates with respiratory distress PDSA Plan, Do, Study, Act Cycle
who died in the first week of life, 2000–2002..................................... 14 PMTCT Prevention of mother-to-child transmission of HIV
Figure 13: Russia: Declines in neonatal QAP Quality Assurance Project
and infant mortality, Tver Oblast, 1998–2008...................................... 14
URC University Research Co., LLC
Figure 14: The Nurse Knowledge Exchange
US United States
at Kaiser Permanente......................................................................................... 15
USAID United States Agency for International Development
Figure 15: Metrics one month after going live...................................... 16
WHO World Health Organization
Figure 16: Outcome metric: Pilot site,
December 2002-March 2006....................................................................... 16
Figure 17: 100,000 Lives Campaign map................................................. 17
Figure 18: 100,000 Lives Campaign field
operations structure........................................................................................... 18
Figure 19: Iowa Health System: Percentage of
sampled charts with harm-level adverse drug
events, November 2001–June 2003.......................................................... 19
Figure 20: Ecuador: Percentage of deliveries where
AMTSL was implemented in accordance with standards............. 20
n How will we spread it? Having summarized the scientific basis for spread, the
report offers several illustrative approaches for spread
The framework for spread requires a superior model or
and lessons learned from applying them. The approaches
practice that has proven itself on a small scale through
include:
improved system results as well as a group of leaders
committed to spreading this superior model. The model n Natural diffusion, which is the adoption of an idea or
needs to be developed and packaged for optimal intervention by members of a social system in the
adoption by members of the social system in question. absence of a formal dissemination effort.
n The affinity group, developed by Ascension Health, n Leverage existing networks and identify partners to
where two or three hospitals are recruited to supply crucial resources to ensure rapid growth at a
develop a superior model for a priority care area. low cost.
Once the innovation is developed and confirmed, a To determine which approach should be used to
large conference-style meeting informs other sites in disseminate the surgical checklist, we recommend
the system of its use. consideration of three processes. At the individual
n Collaborative, which brings together several teams provider level, we need to know how to foster buy-in.
from independent facilities for structured learning and This will involve examining providers’ dissatisfaction with
exchange around shared aims, measures, and goals. current practice and enabling system change. At the facility
n Virtual collaborative, where participants meet virtually, level, after individual adoption, whole-facility adoption will
via phone, WebEx, etc. require connecting the facility’s strategy and the priority.
At the health system level, we must build on the inputs
n Wave sequence, a systematic approach to rapidly
of the individual adoption phase and facility-level spread
spread to a large, nested system in which care is
efforts. Leadership and connection with strategy become
provided at multiple levels (tertiary, secondary,
more prominent as does alignment between the system
primary), often in a hierarchical structure.
and the facilities within it. Additional factors that may
n Campaigns, where a targeted social system connects influence adoption include policies, regulations, incentives,
with a shared, quantitative aim. This approach builds disincentives, and resources.
on a platform (evidence-based interventions to
be spread), a simple measurement system, broad After considering whether to recommend a single,
communications, and distributed field operations. unified approach to disseminating checklists, the authors
and reviewers agree that we not are in a position today
n Hybrid approaches, where combined elements from
to recommend one approach universally. Different
different approaches form a new approach.
approaches are appropriate, depending on the nature of
Lessons learned from large-scale spread inform our the checklist and the systems in which it will be spread.
understanding of the way forward for the spread of
the surgical checklist and other simple, high-impact
interventions. These lessons include:
n Recognize that impressive results from pilots will drive
spread.
n Take the successful elements from the pilots and
incorporate them in the spread strategy.
n Enable people in health systems to make changes in
their work.
n Provide them with normative and regulatory resources,
leadership, and other forms of support.
n Accumulate evidence of success.
Leadership
• Topic is a key strategic initiative
• Goals and incentives aligned
• Executive sponsor assigned
• Day-to-day managers identified
Com
mun
ication
Knowledge Management Stra
tegie
s (aw
aren
ess &
tech
nica
l)
Numbers adopting
the innovation
in order to identify positive deviance Early Adopters
and increase the up-take of effective
Innovators Laggards
PMTCT practices.
100 15 16
8 13
6
14
7
80 11
9 10
5
Percentage of patients
0
10/31/2002 12/9/2002 1/28/2003 3/11/2003 4/22/2003 6/3/2003 7/15/2003 8/28/2003
11/20/2002 1/6/2003 2/20/2003 4/3/2003 5/13/2003 6/24/2003 8/5/2003
Week
Source: Institute for Healthcare Improvement
E. Affinity Group
Figure 6: Running multiple PDSA cycles to improve care towards Approach
a single aim This approach was successfully
developed by Ascension
Reduce PPH Health, a system of more than
70 acute care hospitals in
the United States. Ascension
Health set eight priorities,
based upon 50 consecutive
death chart reviews at each
hospital, to make it the safest
system in the country. In the
Supply Skilled planning phase, alpha sites
Chain Midwifes were selected to develop
and test a superior model for
each priority area. The sites
Cold Chain Pre-filled Syringes were selected upon several
Ascension Health’s five-year goal, set in 2003, was to reduce mortality by 900 lives by 2008.
the peer-to-peer learning that takes place between teams
In three quarters of FY2010 alone, 3,852 lives were saved. To date, over 16,514 lives have been saved as they are exchanging their improvement experiences.
Source: Ascension Health This motivates and energizes teams—creating healthy
competition. It also enables the rapid testing of multiple
changes simultaneously.
Figure 8: Observed mortality rate and case mix
index at Ascension Health, FY2004–third quarter An improvement collaborative brings together multiple
FY2010 teams, usually at least 20–50, from numerous, independent
facilities, for structured learning and exchange (using a
2.20 1.48
2.14 1.4687 variety of media) around shared aims, measures, and
2.15 1.46
2.10 1.4492
goals (IHI 2003; Fraser 2008). A collaborative typically
2.10 1.44
lasts 9–18 months. Because a collaborative involves
Mortality per 100 discharges
2.05 1.42
2.00 1.4145 many sites, in itself it represents a spread approach.
Case mix index
2.00 1.40
1.95
1.3868
1.3869
1.3970
1.38
Additionally, collaborative improvement has been adapted
1.92
1.90
1.3734
1.91 1.91 1.91
1.36
in many other ways to enable spread (USAID Health
1.85 1.34
Care Improvement Project 2008; Franco et al. 2009). For
1.80 1.32 example, often following the initial collaborative (usually
1.75 1.30 called a “demonstration” or “phase I” collaborative), a
1.70
FY2004 FY2005 FY2006 FY2007 FY2008 FY2009 FY2010
1.28 follow-on spread collaborative (often referred to as a
through Q3
“phase II” collaborative) is undertaken to spread the
First nine months of FY10 risk-adjusted results–1,085 fewer deaths compared to baseline
superior model developed in the phase I collaborative to
Observed Mortality Rate Case Mix Index
other sites. In other instances, the collaborative continues
Source: Ascension Health to add on teams from new sites. These new sites quickly
build on the work of their peers from the initial sites.
factors, but most importantly the strength of the local The collaborative approach is applicable when the nature
leadership’s will to lead change on behalf of the system. It of the intervention is systemic and cross-functional, and
was predicted that alpha to beta spread might take 12-18 where shared learning in implementation is an advantage.
months, but the early successful alpha results simulated It is as applicable when the organizational structure is
“viral” spread. Within a matter of months, many hospitals dispersed and not connected as it is for facilities within
adopted successful practices to emulate similar results. a system. The social system is often created or enhanced
Once the superior models were developed and the during a collaborative. Importantly, the collaborative
Prepare for
implementation
Tools, training materials, Act Plan
monitoring system,
support and sharing Study Do
mechanisms, site
preparation
Source: USAID Health Care Improvement Project (2008). Adapted from the IHI Breakthrough Series Model (IHI 2003).
approach is applicable when one can reach the target of a virtual collaborative is 40–100 participants. During a
population all at once. It does require face-to-face virtual collaborative, it is crucial for everyone involved to
meetings. The USAID Health Care Improvement Project’s be able to access information and changes simultaneously.
adaptation of the IHI Breakthrough Series model is in
The process for a virtual collaborative includes developing
Figure 9.
an aim statement, a change package, meetings, and – as
Box 1 shows the results of national level spread in Niger of in a standard collaborative – testing changes, returning to
active management of the third stage of labor, a bundle of the group, and reporting on the impact of those changes.
three interventions. A collaborative implemented in Niger by Creating an electronic mailing list of collaborative team
the Quality Assurance Project achieved 10-2 level of reliability members is useful to encourage communication, distribute
with a corresponding drop in postpartum hemorrhage. information, and foster commitment to virtual meetings
and sharing.
Box 2 describes the spread experience of an
improvement collaborative implemented in Rwanda by
the Quality Assurance Project (QAP). H. Wave Sequence Approach
Wave sequence (or “multiplicative”) spread is a systematic
G. Virtual Collaborative approach to rapidly spread multi-level interventions (i.e.,
interventions that cross tertiary, secondary, and primary
In a virtual collaborative participants don’t meet in person,
care settings and might even branch into the community).
only virtually, via tools such as phone, web conferencing,
This approach builds on the collaborative improvement
and video conferencing. This approach is used when
approach and emphasizes developing champions from
the intervention requires collaborative learning, but
within the system to carry out the subsequent spread. As
restraints preclude meeting in person, necessitating other
shown Figure 10, a slice of the system representing the
communication means. Common barriers include time
different levels of care in each administrative division is
restraints, geography, and prohibitive cost. The ideal size
A collaborative was launched in 2006 under Teams thought through the process of how to
the USAID Quality Assurance Project, make the best practice of AMTSL available with
HCI’s predecessor, with the goal of successful a realistic knowledge of the resources available.
implementation of the active management of One change was pre-filling a syringe with
the third stage of labor (AMTSL) in Niger. The Oxytocin and keeping it chilled on an ice pack
AMTSL bundle has three elements: intravenous or in a cooler to have available without need of
Oxytocin at the third stage of labor, controlled the pharmacist. With this change in process, it
cord traction, and external uterine massage. is then available at the third stage of labor for
administration at any time.
As seen in the figure below, upon beginning
the work, few instances showed complete The graph shows that the percentage of
use of the AMTSL bundle. Challenges in compliance in implementing all three steps
implementing AMTSL included the difficulty of AMTSL increased with this intervention,
of accessing Oxytocin, which was kept in a overcoming a major challenge in providing
locked refrigerator (it is thermally unstable) at quality care at the time of delivery.
night; women arriving at the health center after
delivery; and time restraints in tending to the
woman’s and newborn’s other needs.
Active management of the third stage of labor reduces postpartum hemorrhage in Niger
Postpartum hemorrhage
J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D
2006 2007 2008
Percent of partners tested at Muhura Health Center PMTCT Program, Rwanda (Jan 2003–Jan 2005)
100
90
80
Percent of Partners Tested
70
60 Intervention
50
40
30
20
10
0
J F M A M J J A S O N D J F M A M J J A S O N D J
2003 2004 2005
20
17.2
13.4 14.4
and structure and started with a kick-off and mass training
15
11.9 events to introduce the system changes. These were
10.3
10
9.6 followed up with local support. At the end of spread, the
8.4 7.6
10.3 6.6
5.7 system had effectively incorporated all Kaiser facilities by
5
6.3
6.0
5.4
3.9
empowering the staff, creating leadership, promoting the
4.5 2.8 results of an effective pilot, and giving autonomy to each
0
1998 2000 2002 2004 2006 2008 hospital to control its trainings.
Early Neonatal Mortality Neonatal Mortality Infant Mortality
Figures 15 and 16 show some of the metrics used to A campaign approach builds on a platform (evidence-
show the results of the NKE as it was spread through based interventions to be spread), a simple measurement
the Kaiser System. Figure 15 shows the reduction in system, broad communications, and distributed field
minutes between arrival of new nurses and completion operations. Interventions that are less complex, requiring
of the handoff process, while Figure 16 shows improved less process redesign, lend themselves well to the
outcomes (increase in the amount time between falls) campaign approach. This approach has been successfully
following the adoption of NKE. used in several countries.
50 43
40
30
17
20 12
9 8 10
10
0
Prepare Change 1st Patient
Baldwin Park Hawaii
60
60
50
50 42
40 35
40
30 23 30
17 21 21
20
11 20
11
10 5 5 7 6
10
0
0
Prepare Change 1st Patient
Prepare Change 1st Patient
Prototype
Prepare: Time from arrival on unit to when the nurse receives first patient report out
Baseline
Change: Time from the first patient report out to the last patient report out
1st Patient: Time it takes from arrival on unit until the nurse physically see their first patient
Source: Kaiser Permanente
80
70
60
Days Between Falls
50 Post-Implementation
NKE Implemented
Pre-Implementation
40
Linear (Pre-Implementation)
30 Linear (Post-Implementation)
20
10
0
Dec- Jun- Jan- Aug- Feb- Sep- Mar-
02 03 04 04 05 05 06
Health System (IHS), which set out to spread a number to influence local colleagues. Not all target sites could be
of safety practices – including Unit Briefings, Executive reached at once, given the nature of the changes.
Walk Rounds, and Medication Reconciliation – from one
hospital to the remaining 10 hospitals in IHS. The objective K. Lessons Learned from Large-scale Spread
was to reduce adverse drug events (ADEs) within two
Experience with several spread efforts has contributed
years. Critical to the success of this improvement was
to our current understanding of large-scale spread. Key
deliberately targeting a change in the organization’s
learning from these efforts includes:
culture. IHS developed its own spread approach, which
combined elements of having a full-scale plan at the n Recognize that good improvement results that are
outset, including a system-level strategic aim, a system- “spread-worthy” and that were obtained in the
wide patient safety implementation team, prototype demonstration phase are the key drivers for large-scale
slices at different levels of the system of care, and two spread.
initial pilots followed by an internal collaborative for the n Take the successful elements from the pilot phase
remaining 10 hospitals. Several leadership and deployment and incorporate them in the spread strategy. If more
structures and interactions were set up as an integral part core elements can be standardized in the planning
of the spread effort. Figure 19 shows the system-wide phase, this will increases the likelihood of success,
results achieved in 2001-2003. provided allowance is made for certain modifications
to components of the intervention, appropriate to the
Hybrid approaches are applicable when the nature of
local context.
the intervention(s) is complex, requires cultural change,
and spans more than one microsystem. In the IHS case, n Enable targeted adopters in health systems to make
it required creating an organizational structure to bring changes in their own work: Equip them with systems
together parts of a system that otherwise function as thinking and a change model, such as the PDSA Cycle.
independent entities. The social system was strengthened n Provide them with normative and regulatory resources,
and a system-wide, multi-disciplinary team was formed leadership, and other forms of support.
20
20 Reduced Sample Size
% of Charts
14
11
10 10 10
10 9 9
6 6 6 6 6
2003 Target 4% 4 5 5 4
3 2 3
0
N-01 D-01 J-02 F-02 M-02 A-02 M-02 J-02 J-02 A-02 S-02 O-02 N-02 D-02 J-03 F-03 M-03 A-03 M-03 J-03
n Accumulate evidence of success of productive n Use many levers to stimulate change, applying positive
outcomes for constituents as the intervention is incentives (e.g., recognition and rewards) and negative
expanding. Share this to continue to motivate old and consequences (transparency, chastising) at different
new teams. times.
n Ensure shared, structured learning, which occurs in In going to scale, thinking through and organizing the
the collaborative improvement approach (even in scale-up effort has proven to be critical: projects must
the demonstration phase): Such learning enables the begin with the full scale in mind. Defining the full scale
development of better models in a shorter period. before embarking on the demonstration enables the
Energize staff by providing additional assistance to teams creation of superior models that are scalable to the
through site visits: Role modeling and leadership behaviors required levels. It also allows for the design of optimal
affect the functioning and hence success of the teams. spread plans. In doing so, it is important to look for any
n Understand the role of technology within the culture nested systems that could be leveraged and to consider
and practices. Time and again, we see people respond creating any form of “system-ness” around the units that
creatively to constraints, when given license to do will go to full scale. If we can go full scale all at once, there
so, reinforcing the adage, “Necessity is the mother of is no reason to delay the spread process. If not, then a
invention.” wave sequence approach is an alternative.
n Leverage existing networks and identify partners to Another major learning regards the important role of
supply crucial resources to ensure rapid growth at a the champions who develop the prototypes in leading
low cost. the scale-up. The homophily effect, a preference for
n Emphasize the importance of well-managed logistics in ties to peers or similar colleagues, has over and again
coordinating the spread process; inattention to detail shown its advantage. Creating positive peer pressure for
can stop an initiative in its tracks. change is key. As spread efforts require multiple factors
Figure 20: Ecuador: Percentage of deliveries where AMTSL was implemented in accordance
with standards
Three groups of hospitals (started 2003-2004, n=55; 2005, n=21; 2007, n=10) . Total 86 hospitals reporting 2003-2009.
100
Percent of deliveries in which oxytocin was
administered within one minute of birth
80
60
0
2003 2004 2005 2006 2007 2008 2009