Professional Documents
Culture Documents
Include Invest: Innovate
Include Invest: Innovate
Hans Kluge (Division of Health Systems and Public Health at WHO Regional
Office for Europe) and Josep Figueras (European Observatory on Health
Systems and Policies) acted as series editors for these policy briefs commissioned
and published in time for the Tallinn 2018 conference on “Health Systems for
INCLUDE
POLICY BRIEF
INVEST
site (http://www.healthobservatory.eu).
The Division of Health Systems and Public Health supports the Member
States of the WHO Regional Office for Europe in revitalising their public health
systems and transforming the delivery of care to better respond to the health Ellen Nolte
challenges of the 21st century by: addressing human resource challenges,
improving access to and quality of medicines, creating sustainable health
financing arrangements and implementing effective governance tools for
increased accountability.
INNOVATE
ISSN 1997-8065
Cover_Policy_PB_TALLINN_PRINT.qxp_Cover_policy_brief 07/08/2018 13:43 Page 2
Keywords: © World Health Organization 2018 (acting as the host organization for, and Joint Policy Briefs 18. How can countries address the efficiency and equity
secretariat of, the European Observatory on Health Systems and Policies) implications of health professional mobility in Europe?
Delivery of Health Care 1. How can European health systems support investment in and
Adapting policies in the context of the WHO Code and EU
the implementation of population health strategies?
– organization and administration freedom of movement
Address requests about publications of the WHO Regional Office David McDaid, Michael Drummond, Marc Suhrcke
Irene A. Glinos, Matthias Wismar, James Buchan,
Health Care Reform for Europe to: 2. How can the impact of health technology assessments Ivo Rakovac
be enhanced?
19. Investing in health literacy: What do we know about the
Efficiency, Organizational Publications Corinna Sorenson, Michael Drummond, Finn Børlum
co-benefits to the education sector of actions targeted at
Kristensen, Reinhard Busse
WHO Regional Office for Europe children and young people?
Organizational Innovation 3. Where are the patients in decision-making about David McDaid
UN City, Marmorvej 51
Diffusion of Innovation their own care?
DK-2100 Copenhagen Ø, Denmark 20. How can structured cooperation between countries address
Angela Coulter, Suzanne Parsons, Janet Askham
health workforce challenges related to highly specialized
4. How can the settings used to provide care to older health care? Improving access to services through voluntary
Alternatively, complete an online request form for documentation, health people be balanced? cooperation in the EU.
information, or for permission to quote or translate, on the Regional Peter C. Coyte, Nick Goodwin, Audrey Laporte Marieke Kroezen, James Buchan, Gilles Dussault,
Office web site (http://www.euro.who.int/pubrequest). 5. When do vertical (stand-alone) programmes have Irene Glinos, Matthias Wismar
a place in health systems? 21. How can voluntary cross-border collaboration in public pro-
Rifat A. Atun, Sara Bennett, Antonio Duran curement improve access to health technologies in Europe?
All rights reserved. The Regional Office for Europe of the World Health Jaime Espín, Joan Rovira, Antoinette Calleja, Natasha
6. How can chronic disease management programmes
Organization welcomes requests for permission to reproduce or translate its operate across care settings and providers? Azzopardi-Muscat , Erica Richardson,Willy Palm,
publications, in part or in full. Debbie Singh Dimitra Panteli
The designations employed and the presentation of the material in this 7 How can the migration of health service professionals be 22. How to strengthen patient-centredness in caring for people
managed so as to reduce any negative effects on supply? with multimorbidity in Europe?
publication do not imply the expression of any opinion whatsoever on the part
James Buchan Iris van der Heide, Sanne P Snoeijs, Wienke GW Boerma,
of the World Health Organization concerning the legal status of any country, François GW Schellevis, Mieke P Rijken. On behalf of the
territory, city or area or of its authorities, or concerning the delimitation of its 8. How can optimal skill mix be effectively implemented ICARE4EU consortium
and why?
frontiers or boundaries. 23. How to improve care for people with multimorbidity in
Ivy Lynn Bourgeault, Ellen Kuhlmann, Elena Neiterman,
The mention of specific companies or of certain manufacturers’ products does Sirpa Wrede Europe?
Mieke Rijken, Verena Struckmann, Iris van der Heide, Anneli
not imply that they are endorsed or recommended by the World Health Organi- 9. Do lifelong learning and revalidation ensure that physicians Hujala, Francesco Barbabella, Ewout van Ginneken, François
zation in preference to others of a similar nature that are not mentioned. Errors are fit to practise? Schellevis. On behalf of the ICARE4EU consortium
and omissions excepted, the names of proprietary products are distinguished Sherry Merkur, Philipa Mladovsky, Elias Mossialos,
Martin McKee 24. How to strengthen financing mechanisms to promote care
by initial capital letters. for people with multimorbidity in Europe?
10. How can health systems respond to population ageing? Verena Struckmann, Wilm Quentin, Reinhard Busse, Ewout
All reasonable precautions have been taken by the World Health Organization Bernd Rechel, Yvonne Doyle, Emily Grundy, van Ginneken. On behalf of the ICARE4EU consortium
to verify the information contained in this publication. However, the published Martin McKee
25. How can eHealth improve care for people with
material is being distributed without warranty of any kind, either express or 11 How can European states design efficient, equitable multimorbidity in Europe?
implied. The responsibility for the interpretation and use of the material lies with and sustainable funding systems for long-term care Francesco Barbabella, Maria Gabriella Melchiorre, Sabrina
the reader. In no event shall the World Health Organization be liable for for older people? Quattrini, Roberta Papa, Giovanni Lamura. On behalf of the
José-Luis Fernández, Julien Forder, Birgit Trukeschitz, ICARE4EU consortium
damages arising from its use. The views expressed by authors, editors, or expert Martina Rokosová, David McDaid
groups do not necessarily represent the decisions or the stated policy of the 26. How to support integration to promote care for people with
12. How can gender equity be addressed through multimorbidity in Europe?
World Health Organization. health systems? Anneli Hujala, Helena Taskinen, Sari Rissanen. On behalf of
Sarah Payne the ICARE4EU consortium
13. How can telehealth help in the provision of 27. How to make sense of health system efficiency comparisons?
integrated care? Jonathan Cylus, Irene Papanicolas, Peter C Smith
This policy brief is one of a What is a Policy Brief? Karl A. Stroetmann, Lutz Kubitschke, Simon Robinson,
Veli Stroetmann, Kevin Cullen, David McDaid 28. What is the experience of decentralized hospital governance
new series to meet the needs A policy brief is a short publication specifically designed to provide policy makers with
in Europe?
evidence on a policy question or priority. Policy briefs 14. How to create conditions for adapting physicians’ skills
of policy-makers and health Bernd Rechel, Antonio Duran, Richard Saltman
• Bring together existing evidence and present it in an accessible format to new needs and lifelong learning
system managers. The aim is 29 Ensuring access to medicines: how to stimulate
• Use systematic methods and make these transparent so that users can have confidence Tanya Horsley, Jeremy Grimshaw, Craig Campbell
to develop key messages to innovation to meet patients’ needs?
in the material 15. How to create an attractive and supportive working
support evidence-informed Dimitra Panteli, Suzanne Edwards
• Tailor the way evidence is identified and synthesised to reflect the nature of the policy environment for health professionals
policy-making and the editors question and the evidence available Christiane Wiskow, Tit Albreht, Carlo de Pietro 30 Ensuring access to medicines: how to redesign pricing,
will continue to strengthen reimbursement and procurement?
• Are underpinned by a formal and rigorous open peer review process to ensure the 16. How can knowledge brokering be better supported across Sabine Vogler, Valérie Paris, Dimitra Panteli
the series by working with independence of the evidence presented. European health systems?
authors to improve the Each brief has a one page key messages section; a two page executive summary giving a John N. Lavis, Govin Permanand, Cristina Catallo,
succinct overview of the findings; and a 20 page review setting out the evidence. The BRIDGE Study Team
consideration given to policy
idea is to provide instant access to key information and additional detail for those involved
options and implementation. 17. How can knowledge brokering be advanced in The European Observatory has an independent programme
in drafting, informing or advising on the policy issue.
a country’s health system?
Policy briefs provide evidence for policy-makers not policy advice. They do not seek to of policy briefs and summaries which are available here:
John. N Lavis, Govin Permanand, Cristina Catallo,
explain or advocate a policy position but to set out clearly what is known about it. They may
BRIDGE Study Team http://www.euro.who.int/en/about-us/partners/
outline the evidence on different prospective policy options and on implementation issues, observatory/publications/policy-briefs-and-summaries
but they do not promote a particular option or act as a manual for implementation.
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 1
How do we ensure that innovation in health service delivery and organization Editors
is implemented, sustained and spread?
Hans Kluge
Josep Figueras
Contents
Series Editor
page Anna Sagan
Boxes and figures 3
Key messages 5
Associate Editors
Josep Figueras
Executive summary 7
Hans Kluge
Introduction 9 Suszy Lessof
What we mean by ‘innovating service design 9 David McDaid
and delivery’ in the context of this brief Elias Mossialos
Introducing innovation in service organization 10 Govin Permanand
and delivery: a brief review of main frameworks Erica Richardson
and factors that support ‘implementation processes’
Introducing service innovation in service 15 Managing Editors
organization and delivery: learning from Jonathan North
experiences in Europe Caroline White
What now? 18
Appendix 21
References 22
Author
ISSN 1997-8073
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 2
Policy brief
ACKNOWLEDGEMENTS
The following individuals reviewed The country examples used in this brief draw on
or commented on this policy brief: work that was partly supported by the World
Trish Greenhalgh Bank as part of the project ‘Case Studies on
People Centered/Integrated Health Care in
Elke Jakubowski OECD countries’; case studies were prepared by
Ihor Perehinets Sidsel Marie Runz-Jørgensen and Anne Frølich
(Denmark), Helmut Hildebrandt, Alexander
Erica Richardson Pimperl, Oliver Gröne et al. (Germany), and
Juan Tello Hubertus JM Vrijhoef and Guy J Schulpen
(Netherlands).
Hubertus Vrijhoef
2
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 3
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
Figures
Figure 1: The NASSS framework for considering
influences on the adoption, nonadoption, abandonment,
spread, scale up and sustainability of patient-facing
technologies 14
3
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 4
Policy brief
4
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 5
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
5
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 6
Policy brief
6
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 7
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
7
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 8
Policy brief
– development of accountability agreements, in Much progress has been made but more needs
particular where multiple collaborating partners and to be done to achieve lasting, large-scale and
organizations are involved; effective transformation towards people-centred
– development of performance agreements, including health systems
the use of sanctions for breaching processes and Those considering innovations need to be clear whether a
procedures; and given innovation is worth introducing, namely its value
– provision of sustained support to participating proposition. Innovations are often assumed to be
organizations. beneficial, but they may have unintended, and sometimes
undesirable, consequences. Due attention needs to be given
• Widespread stakeholder involvement, including key
to who will benefit and how, and the likely unintended
and front-line staff, most often in the context of
consequences, in particular as these relate to access,
developing structures, guidelines and indicators in order
uptake and use of the new service or technology. For
to secure ‘buy-in’ from participating staff, in particular
example, the introduction of digital health technologies may
physicians, and organizations.
exacerbate existing health inequalities if implementation
• Dedicated and continuing resources in the form of: strategies fail to consider the persistent digital divide in the
– a design and implementation team to guide population. Implementers also need to be aware of
implementation; competing or complementary innovations, which may
lead to disengagement, fatigue and uncertainty among
– start-up funding to strengthen capabilities and
stakeholders, and, possibly, increased cost.
readiness (although this was not necessarily seen as a
key factor that facilitated implementation); Continued evaluation of service innovations is fundamental
– sufficient time to enable organizations and services to to enable sustainable implementation and wider spread or
learn to work in new ways; and scale up. There are likely to be trade-offs between what
evidence is desirable and what is available. In times of
– strategic investment in staff and capacity-building.
resource constraints, perspectives on evidence may
• Adaptation to local context by building on local emphasize cost savings or efficiencies. This may be
relationships and local capacity, thereby allowing a focus challenging to show for more complex innovations and
on what is relevant and what works locally. Wider spread longer-term evaluation frameworks may be needed to
of innovative service models beyond the local area will demonstrate evidence of effect.
likely require some modification to enable take up. For
Finally, the ultimate end-users of the innovation, namely
this to be successful requires building strong
patients, their carers and the wider community, are
foundations of political support at the different
frequently not considered in innovation efforts. There is
tiers of the system and, likely, adapting funding
need for the explicit consideration of the perspectives
models.
and priorities of the public in service innovation if
• Ongoing monitoring and feedback through the countries are serious about achieving people-centred health
systematic collection of data to assess performance and systems.
identify opportunities for improving access, quality,
efficiency and patient experience. Monitoring may also What we do not know
include efforts to identify problems to be fed back to
The factors described here represent those that have been
participating organizations. Lack of strategic investment
identified in the published literature. There is an urgent need
into effective communication may lead to suboptimal
for longitudinal studies that systematically evaluate the
implementation, and, possibly, performance of the service
introduction of service innovation over time to better
innovation.
understand the impact of those factors, such as the role of
• Demonstration of effect through systematic and power relationships between different stakeholders at the
ongoing evaluation in terms of processes and outcomes different levels of the health system, that have received less
as well as utilization and cost. Evidence of effectiveness attention. This should also include systematic assessment
was vital for the wider diffusion and dissemination of of the types of strategies that are likely to work best
successful initiatives. in what context and under what conditions, keeping
the complexities involved in mind. A single, overarching
strategy that seeks to implement change at scale is unlikely
to be effective if local idiosyncrasies are not taken into
account.
8
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 9
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
9
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 10
Policy brief
In the health sector, a wide range of activities are often Sustainability emerges from and succeeds implementation.
collectively referred to as innovations, such as new ideas, Also called maintenance or routinization, the concept of
beliefs, knowledge, practices, programmes and technologies sustainability describes a process by which the innovation
[17]. However, thinking of innovation simply as something has become an ongoing or routine element in an
that is new may be misleading: something can be new, but organization’s or community’s activities [1, 23] .
it does not necessarily have to be better. Innovations are Spread is frequently used interchangeably with diffusion; it
often assumed to be beneficial, but they may have generally describes an organic process of the diffusion of an
unintended, and sometimes undesirable, consequences. For innovation within a setting [1, 24]. Diffusion has been more
example, digital health technologies are widely advocated as specifically defined as an unplanned, informal and
a means to strengthen patient empowerment, especially for decentralized process by which an innovation is being
people with chronic conditions. Yet, those who are least spread (passive spread), as opposed to dissemination,
likely to take up digital technologies tend to be most which refers to active and planned efforts to persuade target
vulnerable in terms of health risks and chronic illness. Such groups to adopt an innovation [1].
technologies could thus exacerbate social inequalities in
health [18]. Scale up describes a systematic approach used in the
context of rolling out a successful local programme to higher
Keeping this in mind, added value, or improvement, is thus levels, or simply any process that aims to expand the
a core attribute of health innovations as discussed in this coverage of an innovation [24] .
policy brief. We use the definition by Greenhalgh and
colleagues [1, 2], which interprets innovation in health Each of these involves a series of processes in themselves,
service delivery and organization as: and they rarely follow a linear and predictable sequence. In
reality, implementation tends to be a rather “messy, stop–
a novel set of behaviours, routines, and ways of working start” process [2], in particular for more complex
that are discontinuous with previous practice, are organizational innovations [25-27]. It is for this reason that
directed at improving health outcomes, administrative many implementation frameworks, which we review in the
efficiency, cost effectiveness, or users’ experience and next section, distinguish components or domains, rather
that are implemented by planned and coordinated than stages or phases. This is to emphasize that the
actions. processes involved tend to be dynamic, recursive, and
A key element of this definition is that the innovation interact in ways that are often not knowable. Also, the
requires those involved to adopt a novel set of behaviours, assumption of a linear, continuous sequence implies that
routines and ways of working. The types of innovations that innovations will be implemented and continued more or less
fall within this definition are wide ranging. It considers new as originally planned [28]. Yet, service innovations usually
technologies, such as digital technologies (e.g. eHealth); require adaptation to the local context if they are to be
new procedures (e.g. minimally invasive surgery); the successfully introduced, from adoption to scale up, and we
creation of new roles (e.g. nurse practitioners in primary come back to this below.
care); the relocation of services from hospital into the Clearly, some innovations in service organization and
community; the creation of new services (e.g. case delivery are easier to implement, and likely sustained and
management); or the introduction of new models of care spread, than others. This depends, mainly, on the level of
(e.g. integrated delivery systems). All of these will have complexity involved. Even a seemingly simple innovation
significant impacts on ways of working. may be difficult or complex to implement, for example, if it
raises regulatory issues, or if professional bodies consider its
From adoption to scale up: unpacking the use in clinical care as compromising professional practice, as
‘implementation processes’ can be the case with some digital health technologies [29].
The introduction of service innovation is not a single event This highlights the need to consider the innovation in the
but a process that in itself consists of different processes, context of the implementation processes, the intended users
stages, phases or steps. The categorization, terminology and and other stakeholders involved, and the setting within
order of these processes vary widely [19]. The most which the innovation is being introduced.
frequently used terms are adoption, implementation, Importantly, what is seen as service innovation in one setting
sustainability, spread or diffusion, dissemination and might already constitute routine practice in another one.
scale up. For ease of reading, we here summarize these This is particularly the case for innovations that are being
under ‘implementation processes’ as an umbrella term, translated from one health system to another one. This is
while recognizing that the individual processes are discrete, because strategies that are being implemented tend to
if overlapping.
10
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 11
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
reflect the characteristics of individual health systems, such focused on the processes of sustaining and scaling more
as the relationships between, and responsibilities of, specifically, often in the context of more complex
different stakeholders in the regulation, funding and delivery innovations that require system-level adoption decisions [24,
of health care. This issue presents an important challenge for 25, 33].
policy-makers and practitioners looking elsewhere for
Many published models and frameworks build or expand on
inspiration to innovate service organization and delivery.
the seminal work by Greenhalgh et al. on the spread of
While it is not possible, in the context of this policy brief, to
innovations in service organizations [1, 2]. In the following
also examine this important question specifically, many of
sections, we briefly review this framework. It helps
the lessons learned from the implementation literature that
understand and explain what influences the introduction of
we examine here are relevant for the cross-system
innovation in health services and describes a wide range of
translation of innovations, too.
factors that have been shown to support the successful
adoption, implementation and sustainability of service
innovations. Other frameworks have specifically focused on
Introducing innovation in service the scaling up of innovations in health and they have
organization and delivery: a brief identified similar factors. This is perhaps not surprising given
review of main frameworks and factors the close interconnectedness of related research [27].
However, there are also important additional issues to
that support ‘implementation consider for the sustainability and scaling up of innovations,
processes’ which we examine below.
The study of take up of innovation in health has attracted What enables the adoption, implementation
much academic interest and there are many reviews that and sustaining of innovation in health service
have focused on the process of implementation in particular. organization and delivery?
By 2012, over 60 implementation models or frameworks
had been published [30]. These range from models that aim Greenhalgh et al. carried out a systematic review of the
to describe or guide implementation, help understand and theoretical and empirical evidence on the spread of
explain what influences implementation or evaluate innovations in service organizations [1, 2]. Informed by the
implementation [31]. However, as noted earlier, what is review, they developed a conceptual model, which identifies
meant by ‘implementation’ has varied. Many published a range of components of the successful adoption,
frameworks focus on the initial phases and consider implementation and sustaining of innovation in service
adoption and implementation together. Yet, a seemingly organization and delivery. These are: characteristics of the
successful initial implementation of a service innovation, innovation itself; characteristics of the adopters;
such as the introduction of new roles or integrated care organizational antecedents; organizational readiness; wider
pathways, does not always lead to sustained, longer-term system context; diffusion and dissemination; and
change [32]. Also, it is often not clear why an innovative implementation process. The review further identified the
delivery model is not being adopted in the first place, or key factors that are associated with each of these
indeed, why innovations are being abandoned soon after components (Box 2). Other widely used frameworks include
they have been introduced [29]. More recent work has thus the Consolidated Framework for Implementation Research
(CFIR) [34] and the further development of the Promoting
Box 2: Determinants of the adoption, implementation and sustaining of innovation in health service delivery and organization
11
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 12
Policy brief
Action on Research Implementation in Health Services Most often, evaluations of sustainability only focus on the
(PARIHS) framework [35]. These have described comparable maintenance of programme activities, without taking
components or domains and they all identify a similar range account of health benefits. This might lead to a situation
of factors as influential for the successful adoption and whereby ineffective or undesirable practices are being
implementation of innovations in health. continued. An undue focus on maintaining the innovation or
programme as originally intended may also hinder its
When considering the components of the conceptual
adaptation to local circumstances; yet, as we noted earlier,
framework shown in Box 2, it is important to understand
adaptation to the local context is key to the entire process,
that they are closely linked, with multiple (and often
from adoption to sustainability.
unpredictable) interactions between each other and wider
contextual factors. These interactions vary between contexts The importance of adaptation to local context can be
and settings; however, it is the interaction between these illustrated by a series of case studies of the sustainability of
that determine the success or failure of a given service service innovation in clinical genetics in the English National
innovation. Health Service (NHS), which is described in Box 3.
Clearly, all components are relevant. But it is difficult to say,
from the outset, how important each of these factors will be
in supporting implementation, or whether the same Box 3: Innovation sustainability in challenging health care
approach will work similarly in a different context. At the contexts: an example from the English NHS
same time, Greenhalgh et al. were able to identify a subset Martin et al. conducted a longitudinal study of four organizational
of factors that were found to be specifically associated with innovations in the field of clinical genetics in the English NHS that
had sustained post-pilot stage [32]. This identified a number of
the successful implementation and subsequent sustaining challenges that the service was facing. One was the shifting of policy
of service innovation. These are: priorities over time, away from an emphasis on clinical genetics that
• an organizational structure that is adaptive and had led to the service being implemented in the first place. Instead,
other (top-down) priorities started to dominate, along with bud-
flexible, with structures that support devolved decision- getary constraints that had emerged in the intervening period. This
making; required organizations to refocus their service areas. The shift in
• leadership and management, involving top priorities was further fuelled by a relative lack of evidence of
(cost-)effectiveness of clinical genetics. This was partly because of the
management support, articulation of a clear and
challenges of demonstrating evidence of effect in the field of clinical
compelling vision, advocacy of the implementation genetics (given the long-term nature of any effect to emerge). Also,
process and continued commitment; the service tended to be small-scale, and a lack of evaluation capacity
• the early and widespread involvement of staff at all made it difficult to produce robust, research-grade evidence of
effectiveness.
levels; the availability of high-quality training materials
and timely on-the-job training; clarity about changes as Yet, despite this shift, the cases in question were able to sustain, and
this was heavily influenced by their characteristics and the contexts
far as individual roles are concerned;
within which they operated. Several key lessons emerged.
• availability of dedicated and ongoing funding for
• Sustainability was mainly achieved through those leading the
implementation; service using a range of strategies to make a (business) case for the
• effective communication across the organization (intra- value of their work.
organizational communication); shared narrative • Sustaining innovation is an ongoing task that requires continuing
(‘story’); work to ensure that services remain alert and responsive to
changing policies and priorities, and the expectations of the differ-
• interorganizational networks, such as learning ent stakeholders involved (service users, practitioners, managers).
collaboratives, especially where complex innovations are
• There is a need to make the case for ‘value’ of the innovation and
concerned; that there are different ways of demonstrating that.
• feedback involving accurate and timely information • There is a need to tailor strategies to the specific organizational
about the implementation process; and needs.
• adaptation to the local context.
The importance of these factors for sustaining innovation in
health care was confirmed in a more recent systematic Spreading innovation: diffusion, dissemination
review, which specifically focused on sustainability [33]. This and scaling up
emphasized the importance of the availability of dedicated
The various factors that help spread a given innovation can
and ongoing funding (as well as infrastructure, staff, and
be thought of as lying on a continuum between pure
time), ongoing monitoring and feedback of implementation
diffusion and active dissemination. Box 2 lists a set of
progress, and adaptation to local context (integration with
factors that were found to be effective in the diffusion and
existing programmes and policies). In addition, Lennox et al.
dissemination of innovations in health, such as social
highlighted the importance of:
networks, opinion leaders and champions. Formal
• demonstrating effectiveness of the innovation being dissemination programmes are also important [1, 2], and
implemented and sustained, in relation to outcomes and these tend to be more effective if those developing such
impact; and programmes:
• assessment of health benefits.
12
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 13
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
• take account of potential adopters’ needs and Lack of attention to context can have considerable
perspectives (cost and benefits); implications for the introduction of innovations in health.
• tailor different strategies to different demographic, This has, for example, been documented for the
structural and cultural features of different subgroups; introduction of digital health technologies. Some
commentators highlighted that large-scale policy initiatives
• use appropriate messages (style, images, etc.); to rapidly implement telehealth technologies despite known
• identify and use appropriate communication channels; uncertainties around complexity, costs and benefits “have
and led to what might be considered inappropriate allocation of
finite resources” [42]. Box 4 illustrates some of the problems
• incorporate rigorous evaluation and monitoring of
that have been described in this context.
defined goals and milestones.
Different from diffusion and dissemination, which aim to
spread innovations more generally, scaling up describes a Box 4: Why the implementation of eHealth systems fails: the
systematic approach that seeks to roll out a successful local importance of context
programme to regional or national levels. However, the A 2012 review of reviews of the implementation of eHealth systems
boundaries are not clear-cut. Research on scaling up health found that much work had focused on enablers and barriers at
innovations has tended to focus on single or discrete organizational level [43]. Studies generally did not consider the wider
interventions, most often in low- and middle-income social context within which eHealth systems were to be introduced.
countries [24, 36, 37]. There is little guidance on how to Thus, questions about the purpose and benefits of such systems and
their anticipated value to users were neglected, as were factors
scale up innovations addressing more complex and promoting or hindering engagement and participation. Moreover,
multifaceted challenges in high-income settings [27]. There studies rarely examined the likely impacts that eHealth technologies
are several examples of innovative service delivery would have for roles and responsibilities for different end-users (staff,
approaches in high-income countries that have spread patients), and the need to adapt systems to the local context.
beyond the initial pilot or demonstration stages and so Lack of attention to the wider context within which digital health
benefit wider populations. More often than not, these did technologies are being introduced was found to be a major impedi-
not involve systematic scaling up approaches as such. ment to the implementation of a national digital health innovation
Examples include ParkinsonNet in the Netherlands [38] or programme in the United Kingdom [44]. The programme aimed to
stimulate a consumer market for person-centred digital technologies,
the roll-out of a standardized service for the treatment of which involved a wide range of products and services (mobile appli-
moderate depression and anxiety in primary health care in cations (apps), personal health records, telecare, telehealth, wearable
the English NHS [39, 40]. activity trackers, etc.) to enable preventive care, self-care, and inde-
pendent living at scale. Capturing the experiences of a wide range of
Current evidence indicates that many of the factors that stakeholders and over time, Lennon et al. identified several barriers
influence implementation more broadly (i.e. factors listed in to the routinization of technologies into daily practice at all tiers of
Box 2) are likely to impact on scaling up, too. In addition, the system [44]. These included: lack of suitable information technol-
Willis et al. identified several factors that facilitate scaling up ogy infrastructure, uncertainty around information governance, lack
of incentives to prioritize interoperability, lack of precedence on
specifically [27]: accountability within the commercial sector, and a market perceived
• adapting funding models in response to changing as difficult to navigate.
resource requirements;
• conducting or commissioning evaluations at different
time points during scaling up activities;
Clearly, context means different things to different people in
• developing and implementing data sharing or feedback different settings. Pfadenhauer et al. proposed the following
processes; definition [41]:
• identifying and engaging community champions; and Context reflects a set of characteristics and circumstances
• building strong foundations of political support. that consist of active and unique factors, within which
the implementation is embedded. As such, context is not
Understanding the complexity and dynamic nature a backdrop for implementation, but interacts, influences,
of introducing innovation into service organization modifies and facilitates or constrains the intervention and
and delivery its implementation. Context is usually considered in
relation to an intervention, with which it actively
As above, the successful introduction of innovation in service interacts. It is an overarching concept, comprising not
delivery crucially depends on the context within which only a physical location but also roles, interactions and
service innovation takes place. These contextual factors are relationships at multiple levels.
often described as ‘facilitators’ or ‘barriers’, and they tend to
be looked at in isolation. Yet, these contextual factors are This definition reinforces the dynamic nature of innovation
part of the normal conditions of practice [26], and, implementation, which implementers should consider. But
importantly, they interact with each other. Thus, when how to do this in practice remains a challenge. This
considering introducing an innovation in service organization challenge is explicitly addressed in recent work by
and delivery, it is important to take into account that the Greenhalgh and colleagues [29]. It builds on their earlier
relationship between the innovation, its implementation and work and specifically considers the critical role of the wider
the context within which the innovation is being introduced context into which innovations must become embedded.
is dynamic and likely to change over time [41]. Although focusing on the introduction of digital health
13
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 14
Policy brief
Figure 1: The NASSS framework for considering influences on the adoption, nonadoption, abandonment,
spread, scale up and sustainability of patient-facing technologies
7. Continuous
embedding and
adaptation over time
6. Wider system
5. Health/care organization(s)
implementation work,
adaptation, tinkering
1. Condition
2. Technology
Source: [29]
technologies, the resultant Nonadoption, Abandonment, different levels of complexity in each of the domains
Scale-up, Spread and Sustainability (NASSS) framework can identified: from simple (straightforward, predictable, few
also be applied to service innovations more broadly components) to complicated (multiple interacting
(reproduced in Figure 1). components or issues), to complex (dynamic, unpredictable,
not easily broken down into simpler components). Box 5
The framework identifies seven domains that influence the
illustrates this continuum for the seven domains of the
adoption, nonadoption, abandonment, spread, scale up and
framework.
sustainability of technology-based innovations. It considers
14
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 15
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
1. Condition
• Nature of condition/illness Well characterized, clear diagnostic/ Unpredictable and not amenable to
• Comorbidities treatment pathway (e.g. sprained ankle) management by algorithm (e.g.
• Socio-cultural factors multimorbidity in vulnerable group)
2. Technology
• Material properties Dependable, cheap, substitutable (e.g. Requires interoperability across different
• Knowledge needed to use telephone) organizations, regulatory challenges (e.g.
• Knowledge generated information governance)
• Supply model
• Who owns the IP?
3. Value proposition
• Supply-side value (developer) Robust business case, demonstrable Business case rests on limited
• Demand-side value (patient) benefits as shown by HTA experimental data, HTA not available
4. Intended adopters
• Staff Intended users (clinicians, carers, Intended users are not willing or capable
• Patients patients) are willing to use technology to use technology; resistance
• Carers and easy to train
5. Organization
• Capacity to innovate High capacity to innovate, keen to Lack of agreements and partnerships
• Readiness for change change, slack resources available, between organizations, lack of budget
• Nature of adoption/funding decision capacity to monitor and evaluate and capacity
• Extent of change needed to
organizational routines
• Work needed to implement and
evaluate the change
6. Wider system
• Political/policy context Clear policy push with relevant levers Top-down without funding, inconsistent
• Regulatory/legal issues and incentives, regulatory framework policies at different tiers, lack of support
from professional groups
• Professional bodies
• Socio-cultural context
• Inter-organizational networking
15
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 16
Policy brief
given to three examples of integrated care models in settings and contexts and over time. This will likely differ and
Denmark, Germany and the Netherlands that have emerged reflect the starting point and the complexity of the service
from local pilot or research projects, sustained beyond the innovation to be implemented. The distinction between
pilot or project phase and informed novel care approaches individual ‘success’ factors is often not clear-cut, and there
across the country more broadly. Background information will be overlap and mutual dependencies, although, as
and illustrations of how the key factors listed above applied noted, it will be difficult to characterize the nature of these.
to these models are summarized in Box 6. Still, the evidence that we review here provides useful
insights into some of the key issues those seeking to
The available evidence does not allow us to explore the
introduce service innovation that is sustainable and,
nature of interactions between different factors as such, or
potentially, at scale, may wish to consider.
the relative importance of different factors in different
Stakeholder involvement Engagement of frontline staff, most often in the context of developing structures, guidelines and
indicators in order to secure ‘buy-in’ from participating staff and organizations
Effective communication, Setting up dedicated mechanisms to collect data systematically, to assess performance and identify
ongoing monitoring and opportunities for improving access, quality, efficiency and patient experience
feedback
Systematic efforts to measure costs and identify problems to be
fed back to participating organizations
Building on local relationships and local capacity, allowing to focus on what is relevant and what
Adaptation to the local
works locally
context
Evaluations demonstrated evidence of improvements in a number of process and outcome measures,
Evaluation and
along with selected utilization measures. For example:
demonstration of (cost-)
effectiveness
Demonstrated impact on the Demonstrated impacts on Demonstrated impact on the
number of hospital mortality and cost savings cost-effective delivery of
admissions, bed days, and integrated diabetes care and
outpatient visits over a two clinically relevant
year period among people improvements among patients
with COPD with poorly controlled
diabetes
Sources: [46-53]
Notes: *Please see Box A2 in the Appendix for more details.
16
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 17
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
17
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 18
Policy brief
existing programmes and policies for it to be sustainable and schemes for a defined package of chronic care. Equally
improve the chances of successful spread and scale up. This important perhaps was political endorsement of the care
also means that organizations will need to be flexible to group approach to chronic illness care by the government
allow for the adaptation of the service innovation to their [57].
needs.
Evaluation and demonstration of
The experience of the SIKS project in Denmark highlights
(cost-)effectiveness
how the wider spread of innovative service models requires
some modification to enable take up: it was initially set up Evidence of effectiveness is widely regarded as vital to the
as a research project in one district in Copenhagen, which sustainability and roll-out of innovative service models. All
led to the establishment of a new health care centre; after three integrated care models described in Box 6 were subject
completion of the project, similar centres were established in to a series of evaluations that provided evidence of impact
other districts of Copenhagen and, eventually, across on a range of process and outcome measures. The need for
Denmark. The evolution of the Dutch primary care groups systematic evaluation has been highlighted to be of
provides another example, as we explain further in Box 7. particular importance to help understand the differential
impacts of service innovations and ‘what works for whom’.
Lack of evidence of improved outcomes (however
conceptualized) of a given innovation might simply reflect
Box 7: The spread of primary care groups in the Netherlands that the service innovation was not suitable to lead to health
As described in Box 6, the Zio care group in Maastricht evolved from improvement in the first place [59]. Likewise, where
a local programme, the Matador Disease Management Programme in evidence finds that a given service innovation improves
Maastricht [57]. It was developed by Maastricht University, the outcomes for a subgroup of service users only, this might
regional general practitioners (GPs) association, a health insurer and
the Maastricht branch of the Dutch Diabetes Association. It was
indicate that the innovation was suboptimal or not
established in 2001. Innovative components of the Matador model sufficiently targeted at those who would benefit most.
included:
• a team approach with the diabetes nurse linking primary and What now?
secondary care and taking on some of the tasks previously Much progress has been made in developing a better
performed by doctors only; and
understanding of how to ensure that innovation in health
• the use of protocols setting out the primary responsibilities for service delivery and organization is implemented, sustained
three subgroups of patients to a medical specialist (highly complex),
and spread. However, more needs to be done to achieve
a diabetes nurse (intermediate or stable) or the GP and a practice
supporter (low complex) and support of self-management. lasting, large-scale and effective transformation into people-
centred health systems, which we summarize here.
The Matador programme was extensively evaluated [58] and
considered to be successful. Key attributes included its integration of
various levels of care, strong leadership, a shared vision about care Is the innovation worth introducing? Establish the
delivery, and communication and transparency regarding the value proposition and assess the intended and
programme’s objectives. The programme was described by the main unintended consequences of emergent innovations
funder of health research (Netherlands Organization for Health
Research and Development) as ‘prime example’ for well developed Those considering service innovations need to systematically
disease management for diabetes, committing to the further reflect upon whether a given innovation, be it a service or a
dissemination of the so-called ‘Maastricht Model’ across the technology, is actually worth introducing (the value
Netherlands [57].
proposition). This requires clear understanding of the
However, for the model to be acceptable among GPs across the underlying ‘problem’ that the innovation is intended to
Netherlands more widely, it was redesigned. The GP, and primary care solve, and how the new service is meant to solve this. Due
in general, was tasked with the primary responsibility for the
subgroup of patients with intermediate complex care needs. Further
attention needs to be given to who will benefit and how,
adaptations included GPs employing practice supporters, who may or and the likely unintended consequences, in particular, as
may not have a nursing background. This implied a different role for these relate to access, uptake and use of the new service or
the diabetes nurse, who became a consultant for primary care and a technology. For example, the introduction of digital health
caregiver for patients with highly complex care needs. The wider technologies is likely to exacerbate existing health
uptake of the programme was further stimulated and facilitated by
supportive measures, such as the introduction of the bundled
inequalities if strategies fail to consider the persistent digital
payment system for care groups from 2006 [52]. divide in the population. One further example may also be
illustrative of this issue: in times of rising demand on primary
care and the challenges many countries are facing in
recruiting GPs (especially in more rural areas), there is
increasing interest in the use of alternatives to face-to-face
The example of the Dutch primary care groups also
consultations to help reduce pressures, such as via the
illustrates two factors that are associated with the successful
telephone or, more recently, online consultations. However,
scaling up of innovation as discussed above, namely
emerging evidence suggests that at its best, such
adapting funding models and building strong
approaches are unlikely to reduce demand or save costs [60],
foundations of political support [27]. As described in Box
and, at its worst, they may compromise patient safety [61]
7, the spread of primary care groups across the Netherlands
through a tendency to overprescribe, particularly antibiotics
was facilitated, to a great extent, by a change in the funding
and analgesics.
model which involved the use of ‘bundled payment’
18
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 19
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
This does not mean that such innovations should not be Systematically consider the perspectives and priorities
pursued at all. It does however highlight the need for careful of the public in service innovation
assessment of their likely impacts, in particular, whether they
will benefit the population more broadly, and what changes One key stakeholder that appears to be missing frequently in
are needed to embed such services into routine care. There considerations about the adoption, implementation,
is thus a need for responsible innovation that explores the sustainability, spread and scale of innovation in service
impacts and implications, both intended and unintended, of organization and delivery is the voice of the ultimate end-
emergent innovations (e.g. potential to increase inequities user of the innovation – namely patients, their carers and
by excluding more marginalized populations from accessing the wider community. Explicit consideration of service users’
the innovation), and to ensure their benefits are widely perspectives and priorities in service innovation, and their
distributed and shared, are sustainable and meet societies’ participation in the process of implementation is increasingly
needs more broadly [62]. recognized as essential for the successful introduction and
sustainability of innovation in service organization and
Innovation planning, from adoption to sustaining, delivery [54]. Due consideration of the ‘public voice’, as
spreading and, potentially, scaling must take account service users, carers, members of the community or
of the dynamic nature of the processes involved taxpayers, will become ever more important if countries are
serious about their health systems becoming more person-
In this brief we have identified a range of factors that are
or people-centred.
key in supporting the successful adoption and
implementation, sustaining, spread and scaling of innovation More research evidence is needed on the key success
in health service organization and delivery. They include: factors for introducing innovation
leadership, management and widespread stakeholder
The factors described in this brief represent those that have
involvement to ensure advocacy, support and buy-in;
been identified in the published literature [2]. There is urgent
effective communication, ongoing monitoring, feedback and
need for longitudinal studies that systematically evaluate the
evaluation; and dedicated and continuing resources to
introduction of service innovation over time to better
enable these functions and processes. Importantly, for a
understand the impact of those factors that have so far
service innovation to sustain and spread, adaptation to the
received less attention [29]. Further, and more fundamental
local context and its integration with existing programmes
perhaps, mere knowledge of the key success factors for
and policies are vital.
introducing innovation into service delivery as described is
These factors do not exist or act in isolation; instead, they not sufficient to ensure that it will be implemented and
interact with each other, with the innovation and with the sustained. There is a need to more systematically assess
wider context within which the innovation is being what strategies are likely to work best in what context and
introduced. The nature of these interactions varies between under what conditions, keeping the complexities involved in
contexts and settings, often in unpredictable and typically mind. This requires a good understanding of the ‘politics’
complex ways. This means that the successful introduction surrounding the various processes, and in particular of the
of innovation requires a ‘package of interventions, rather power relationships between the various stakeholders
than a single new approach or model’[37] (p. 244) as it involved. Indeed, local processes, as well as professional and
often involves significant change in the way health services ‘microsystem’ considerations, play a significant role in
and systems function. It must take account of the political, adoption and implementation. This also means that a single,
cultural, institutional and other contexts, and that time will overarching strategy that seeks to implement change at
be required to enable organizations and services to (learn to) scale is unlikely to be effective if local idiosyncrasies are not
function in new ways. taken into account [66].
Those considering service innovations should also be aware
Continued evaluation is central to success
of competing or complementary innovations – a significant,
Continued evaluation of service innovations is fundamental albeit frequently overlooked, and even less studied,
to enable sustainable implementation and wider spread or contextual factor [67, 68]. Competing priorities may lead to
scale up. The failure to evaluate innovation may lead to disengagement, fatigue and uncertainty among
‘misattribution of effects’ and, potentially, the wider stakeholders. They may also cause additional costs through
introduction of ‘technologies, practices and ways of working the need to redesign and delay implementation, and this
without proven benefits over existing alternatives’ [42] should be considered.
(p. 572). There are likely to be trade-offs between what
evidence is desirable and what is available. This is a
particular challenge for smaller scale innovations, for which
it is difficult to demonstrate robust data on impact on
outcomes, let alone cost-effectiveness. It may therefore be
necessary to frame the same evidence differently to convince
different stakeholders. Such reframing is especially important
in times of resource constraints, where perspectives on
evidence may emphasize cost savings or efficiencies [63],
which may be challenging to prove for more complex
innovations [64, 65].
19
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 20
Policy brief
20
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 21
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
Appendix
Box A2: Implementing, sustaining and spreading integrated care approaches: examples from Denmark, Germany and the
Netherlands
‘Integrated effort for ‘Gesundes Kinzigtal’ ‘Zio’ care group, Maastricht
people living with chronic network, Kinzigtal valley, region, the Netherlands
diseases’ (SIKS) project, Germany
Copenhagen, Denmark
General information: Set up as a research project in Set up in 2005 as a pilot Set up in 1996 as a pilot
the Østerbro district in project on the initiative of a project by the Maastricht
Copenhagen (2005-2007) and local physicians’ network and University Medical Centre;
funded by the Ministry of a health care management Financed through statutory
Interior and Health; company; Financed by two health insurance using
Interventions implemented as regional statutory health bundled payments for defined
part of the project informed insurance funds chronic conditions (asthma,
the development of similar COPD, cardiovascular
integrated care models diseases, mental health
elsewhere in the country as problems, and frail older
well as policy development for people)
coordinated care approaches
in Denmark more widely
Focus: Implementation of Development of an integrated Initially diabetes type 2 using
rehabilitation programmes for health care delivery system for specialized diabetes nurses;
people with type 2 diabetes, the local population subsequent development into
COPD, heart disease or with primary care group Zio, which
balance problems following covers a broader spectrum of
falls conditions
Target population: Resident population of Entire population in the People with chronic
the Østerbro district of region; around one-third of conditions in the Maastricht
Copenhagen; around the eligible population has region (some 25,000 enrolled
700 patients received services signed up (9,700 by 2016) with Zio in 2016)
over the duration of the
project
Partners: Bispebjerg University Hospital, About 90 core partners, 81 GPs and primary care
specialists, (nurses, mostly office-based professionals working in
physiotherapists, dieticians), physicians, along with 55 general practices,
one community health care hospitals, nursing homes and 1 hospital, allied primary
centre (nurses, home care services, as well as health care professionals
physiotherapists, dietician), other partners such as gyms,
and 52 GPs in Copenhagen pharmacies, etc.
Sources: [47,49,51,53]
21
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 22
Policy brief
22
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 23
How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?
29. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes 43. Mair F, May C, O’Donnell C, Finch T, Sullivan F, Murray E.
G, A’Court C et al. Beyond adoption: a new framework Factors that promote or inhibit the implementation of
for theorizing and evaluating nonadoption, e-health systems: an explanatory systematic review. Bull
abandonment, and challenges to the scale-up, spread, World Health Organ. 2012;90:357-64.
and sustainability of health and care technologies.
44. Lennon MR, Bouamrane MM, Devlin AM, O’Connor S,
Journal of Medical Internet Research. 2017;19(11):e367.
O’Donnell C, Chetty U et al. Readiness for delivering
30. Tabak RG, Khoong EC, Chambers DA, Brownson RC. digital health at scale: lessons from a longitudinal
Bridging research and practice: models for dissemination qualitative evaluation of a national digital health
and implementation research. American Journal of innovation program in the United Kingdom. Journal of
Preventive Medicine. 2012;43(3):337-50. Medical Internet Research. 2017;19(2):e42.
31. Nilsen P. Making sense of implementation theories, 45. Nolte E, Knai C, editors. Assessing chronic disease
models and frameworks. Implement Sci. 2015;10:53. management in European health systems. Country
reports. Copenhagen: WHO Regional Office for Europe,
32. Martin G, Weaver S, Currie G, Finn R, McDonald R.
on behalf of the European Observatory on Health
Innovation sustainability in challenging health-care
Systems and Policies; 2015.
contexts: embedding clinically led change in routine
practice. Health Serv Manage Res. 2012;25:190-9. 46. Elissen A, Duimel-Peeters I, Spreeuwenberg C,
Spreeuwenberg M, Vrijhoef H. Toward tailored disease
33. Lennox L, Maher L, Reed J. Navigating the sustainability
management for type 2 diabetes. Am J Manag Care.
landscape: a systematic review of sustainability
2012;18:619-30.
approaches in healthcare. Implement Sci. 2018;13(1):27.
47. Hildebrandt H, Pimperl A, Gröne O, Roth M, Melle C,
34. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander
Schulte T et al. Case study “Gesundes Kinzigtal”. People
JA, Lowery JC. Fostering implementation of health
centred/integrated health care (PCHC). Hamburg:
services research findings into practice: a consolidated
OptisMedis AG; 2015.
framework for advancing implementation science.
Implement Sci. 2009;4:50. 48. Jacobsen R, Rusch E, Andersen P, Adams J, Jensen C,
Frølich A. The effect of rehabilitation on health-care
35. Harvey G, Kitson A. PARIHS revisited: from heuristic to
utilisation in COPD patients in Copenhagen. Clin Respir
integrated framework for the successful implementation
J. 2014;8:321-9.
of knowledge into practice. Implement Sci. 2016;11:33.
49. Nolte E, Frølich A, Hildebrandt H, Pimperl A, Schulpen
36. Milat A, Bauman A, Redman S. Narrative review of
G, Vrijhoef H. Implementing integrated care: a synthesis
models and success factors for scaling up public health
of experiences in three European countries. Int J Care
interventions. Implement Sci. 2015;10:113.
Coord. 2016;19:5-19.
37. Ovretveit J. Widespread focused improvement: lessons
50. Pimperl A, Schulte T, Mühlbacher A, Rosenmöller M,
from international health for spreading specific
Busse R, Groene O et al. Evaluating the impact of an
improvements to health services in high-income
accountable care organization on population health: the
countries. Int J Qual Health Care. 2011;23:239-46.
quasi-experimental design of the German Gesundes
38. Bloem B, Rompen L, Vries N, Klink A, Munneke M, Kinzigtal. Popul Health Manag. 2017;20:239-48.
Jeurissen P. ParkinsonNet: a low-cost health care
51. Runz-Jørgensen S, Frølich A. SIKS – the integrated effort
innovation with a systems approach from the
for people living with chronic diseases. A case study of
Netherlands. Health Aff (Millwood). 2017;36:1987-96.
people centred/integrated health care in Denmark.
39. Albury D, Beresford T, Dew S, Horton T, Illingworth J, Copenhagen: The Research Unit for Chronic Conditions,
Langford K. Against the odds: successfully scaling Bispebjerg Hospital; 2015.
innovation in the NHS. London: Innovation Unit Press;
52. Vrijhoef H, Huizing A, Udayakumar K, Gonzalez-Smith J,
2018.
Kadakia K, Thoumi A. Case study: Zio integrated care
40. Sausman C, Oborn E, Barrett M. Policy translation network. The Netherlands. Durham (NC): Duke-Margolis
through localisation: implementing national policy in the Center for Health Policy; 2017
UK. Policy & Politics. 2017;44:563-89. (https://healthpolicy.duke.edu/sites/default/files/atoms/
files/netherlands_25jan2017.pdf, accessed 30 March
41. Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl
2018).
KB, Booth A, Hofmann B et al. Making sense of
complexity in context and implementation: the Context 53. Vrijhoef H, Schulpen G. Case study: Integrated health
and Implementation of Complex Interventions (CICI) care for people with type 2 diabetes in the Maastricht
framework. Implement Sci. 2017;12(1):21. region. Maastricht: Maastricht University Medical Centre
and Zio; 2015.
42. Wilson PM, Boaden R, Harvey G. Plans to accelerate
innovation in health systems are less than IDEAL. BMJ 54. Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J.
Qual Saf. 2016;25(8):572-6. Large-system transformation in health care: a realist
review. Milbank Q. 2012;90(3):421-56.
23
Inside Pages TALLINN_03_Nolte_PRINT.qxp_Policy_brief_A4 23/08/2018 12:23 Page 24
Policy brief
55. Ham C. Improving the performance of health services: 64. Mason A, Goddard M, Weatherly H, Chalkley M.
the role of clinical leadership. Lancet. 2003;361:1978– Integrating funds for health and social care: an evidence
80. review. J Health Serv Res Policy. 2015;20(3):177-88.
56. Leutz W. Five laws for integrating medical and social 65. Nolte E, Pitchforth E. What we know: a brief review of
services: lessons from the United States and the United the evidence of approaches to chronic care. In: Nolte E,
Kingdom. Milbank Q. 1999;77:77-110. Knai C, Saltman R, editors. Assessing chronic disease
management in European health systems. Concepts and
57. Elissen A, Duimel-Peeters I, Spreeuwenberg C, Vrijhoef
approaches. Copenhagen: WHO Regional Office for
H, Nolte E. The Netherlands. In: Nolte E, Knai C, editors.
Europe, on behalf of the European Observatory on
Assessing chronic disease management in European
Health Systems and Policies; 2014:9-22.
health systems. Country reports. Copenhagen: WHO
Regional Office for Europe, on behalf of the European 66. Kyratsis Y, Ahmad R, Hatzaras K, Iwami M, Holmes A.
Observatory on Health Systems and Policies; 2015:99- Making sense of evidence in management decisions: the
110. role of research-based knowledge on innovation
adoption and implementation in health care. Health Serv
58. Steuten L, Vrijhoef H, Landewé-Cleuren S, Schaper N,
Deliv Res. 2014;2(6).
van Merode G, Spreeuwenberg C. A disease
management programme for patients with diabetes 67. Dearing J, Cox J. Diffusion of innovations theory,
mellitus is associated with improved quality of care principles, and practice. Health Aff (Millwood).
within existing budgets. Diabet Med. 2007;24(10):1112- 2018;37:183-90.
20.
68. Pendharkar SR, Woiceshyn J, da Silveira GJ, Bischak D,
59. Nolte E, Conklin A, Adams J, Brunn M, Cadier B, Flemons W, McAlister F et al. What happens when
Chevreul K et al. Evaluating chronic disease healthcare innovations collide? BMJ Qual Saf.
management. Recommendations for funders and users. 2016;25(1):9-13.
Santa Monica (CA)/Cambridge: RAND Corporation;
69. Birken S, Powell B, Presseau J, Kirk M, Lorencatto F,
2012.
Gould N et al. Combined use of the Consolidated
60. Newbould J, Abel G, Ball S, Corbett J, Elliott M, Exley J Framework for Implementation Research (CFIR) and the
et al. Evaluation of telephone first approach to demand Theoretical Domains Framework (TDF): a systematic
management in English general practice: observational review. Implement Sci. 2017;12:2.
study. BMJ. 2017;358:j4197.
70. May C. Towards a general theory of implementation.
61. Marshall M, Shah R, Stokes-Lampard H. Online Implement Sci. 2013;8:18.
consulting in general practice: making the move from
71. Moore JE, Mascarenhas A, Bain J, Straus SE. Developing
disruptive innovation to mainstream service. BMJ.
a comprehensive definition of sustainability. Implement
2018;360:k1195.
Sci. 2017;12(1):110.
62. Kerr A, Hill R, Till C. The limits of responsible innovation:
72. Rycroft-Malone J, Seers K, Chandler J, Hawkes CA,
exploring care, vulnerability and precision medicine.
Crichton N, Allen C et al. The role of evidence, context,
Techn Soc. 2018;52:24-31.
and facilitation in an implementation trial: implications
63. Turner S, D’Lima D, Hudson E, Morris S, Sheringham J, for the development of the PARIHS framework.
Swart N et al. Evidence use in decision-making on Implement Sci. 2013;8:28.
introducing innovations: a systematic scoping review
73. Greenhalgh T, Peacock R. Effectiveness and efficiency of
with stakeholder feedback. Implement Sci.
search methods in systematic reviews of complex
2017;12(1):145.
evidence: audit of primary sources. BMJ.
2005;331:1064-5.
24
Cover_Policy_PB_TALLINN_PRINT.qxp_Cover_policy_brief 07/08/2018 13:43 Page 2
Keywords: © World Health Organization 2018 (acting as the host organization for, and Joint Policy Briefs 18. How can countries address the efficiency and equity
secretariat of, the European Observatory on Health Systems and Policies) implications of health professional mobility in Europe?
Delivery of Health Care 1. How can European health systems support investment in and
Adapting policies in the context of the WHO Code and EU
the implementation of population health strategies?
– organization and administration freedom of movement
Address requests about publications of the WHO Regional Office David McDaid, Michael Drummond, Marc Suhrcke
Irene A. Glinos, Matthias Wismar, James Buchan,
Health Care Reform for Europe to: 2. How can the impact of health technology assessments Ivo Rakovac
be enhanced?
19. Investing in health literacy: What do we know about the
Efficiency, Organizational Publications Corinna Sorenson, Michael Drummond, Finn Børlum
co-benefits to the education sector of actions targeted at
Kristensen, Reinhard Busse
WHO Regional Office for Europe children and young people?
Organizational Innovation 3. Where are the patients in decision-making about David McDaid
UN City, Marmorvej 51
Diffusion of Innovation their own care?
DK-2100 Copenhagen Ø, Denmark 20. How can structured cooperation between countries address
Angela Coulter, Suzanne Parsons, Janet Askham
health workforce challenges related to highly specialized
4. How can the settings used to provide care to older health care? Improving access to services through voluntary
Alternatively, complete an online request form for documentation, health people be balanced? cooperation in the EU.
information, or for permission to quote or translate, on the Regional Peter C. Coyte, Nick Goodwin, Audrey Laporte Marieke Kroezen, James Buchan, Gilles Dussault,
Office web site (http://www.euro.who.int/pubrequest). 5. When do vertical (stand-alone) programmes have Irene Glinos, Matthias Wismar
a place in health systems? 21. How can voluntary cross-border collaboration in public pro-
Rifat A. Atun, Sara Bennett, Antonio Duran curement improve access to health technologies in Europe?
All rights reserved. The Regional Office for Europe of the World Health Jaime Espín, Joan Rovira, Antoinette Calleja, Natasha
6. How can chronic disease management programmes
Organization welcomes requests for permission to reproduce or translate its operate across care settings and providers? Azzopardi-Muscat , Erica Richardson,Willy Palm,
publications, in part or in full. Debbie Singh Dimitra Panteli
The designations employed and the presentation of the material in this 7 How can the migration of health service professionals be 22. How to strengthen patient-centredness in caring for people
managed so as to reduce any negative effects on supply? with multimorbidity in Europe?
publication do not imply the expression of any opinion whatsoever on the part
James Buchan Iris van der Heide, Sanne P Snoeijs, Wienke GW Boerma,
of the World Health Organization concerning the legal status of any country, François GW Schellevis, Mieke P Rijken. On behalf of the
territory, city or area or of its authorities, or concerning the delimitation of its 8. How can optimal skill mix be effectively implemented ICARE4EU consortium
and why?
frontiers or boundaries. 23. How to improve care for people with multimorbidity in
Ivy Lynn Bourgeault, Ellen Kuhlmann, Elena Neiterman,
The mention of specific companies or of certain manufacturers’ products does Sirpa Wrede Europe?
Mieke Rijken, Verena Struckmann, Iris van der Heide, Anneli
not imply that they are endorsed or recommended by the World Health Organi- 9. Do lifelong learning and revalidation ensure that physicians Hujala, Francesco Barbabella, Ewout van Ginneken, François
zation in preference to others of a similar nature that are not mentioned. Errors are fit to practise? Schellevis. On behalf of the ICARE4EU consortium
and omissions excepted, the names of proprietary products are distinguished Sherry Merkur, Philipa Mladovsky, Elias Mossialos,
Martin McKee 24. How to strengthen financing mechanisms to promote care
by initial capital letters. for people with multimorbidity in Europe?
10. How can health systems respond to population ageing? Verena Struckmann, Wilm Quentin, Reinhard Busse, Ewout
All reasonable precautions have been taken by the World Health Organization Bernd Rechel, Yvonne Doyle, Emily Grundy, van Ginneken. On behalf of the ICARE4EU consortium
to verify the information contained in this publication. However, the published Martin McKee
25. How can eHealth improve care for people with
material is being distributed without warranty of any kind, either express or 11 How can European states design efficient, equitable multimorbidity in Europe?
implied. The responsibility for the interpretation and use of the material lies with and sustainable funding systems for long-term care Francesco Barbabella, Maria Gabriella Melchiorre, Sabrina
the reader. In no event shall the World Health Organization be liable for for older people? Quattrini, Roberta Papa, Giovanni Lamura. On behalf of the
José-Luis Fernández, Julien Forder, Birgit Trukeschitz, ICARE4EU consortium
damages arising from its use. The views expressed by authors, editors, or expert Martina Rokosová, David McDaid
groups do not necessarily represent the decisions or the stated policy of the 26. How to support integration to promote care for people with
12. How can gender equity be addressed through multimorbidity in Europe?
World Health Organization. health systems? Anneli Hujala, Helena Taskinen, Sari Rissanen. On behalf of
Sarah Payne the ICARE4EU consortium
13. How can telehealth help in the provision of 27. How to make sense of health system efficiency comparisons?
integrated care? Jonathan Cylus, Irene Papanicolas, Peter C Smith
This policy brief is one of a What is a Policy Brief? Karl A. Stroetmann, Lutz Kubitschke, Simon Robinson,
Veli Stroetmann, Kevin Cullen, David McDaid 28. What is the experience of decentralized hospital governance
new series to meet the needs A policy brief is a short publication specifically designed to provide policy makers with
in Europe?
evidence on a policy question or priority. Policy briefs 14. How to create conditions for adapting physicians’ skills
of policy-makers and health Bernd Rechel, Antonio Duran, Richard Saltman
• Bring together existing evidence and present it in an accessible format to new needs and lifelong learning
system managers. The aim is 29 Ensuring access to medicines: how to stimulate
• Use systematic methods and make these transparent so that users can have confidence Tanya Horsley, Jeremy Grimshaw, Craig Campbell
to develop key messages to innovation to meet patients’ needs?
in the material 15. How to create an attractive and supportive working
support evidence-informed Dimitra Panteli, Suzanne Edwards
• Tailor the way evidence is identified and synthesised to reflect the nature of the policy environment for health professionals
policy-making and the editors question and the evidence available Christiane Wiskow, Tit Albreht, Carlo de Pietro 30 Ensuring access to medicines: how to redesign pricing,
will continue to strengthen reimbursement and procurement?
• Are underpinned by a formal and rigorous open peer review process to ensure the 16. How can knowledge brokering be better supported across Sabine Vogler, Valérie Paris, Dimitra Panteli
the series by working with independence of the evidence presented. European health systems?
authors to improve the Each brief has a one page key messages section; a two page executive summary giving a John N. Lavis, Govin Permanand, Cristina Catallo,
succinct overview of the findings; and a 20 page review setting out the evidence. The BRIDGE Study Team
consideration given to policy
idea is to provide instant access to key information and additional detail for those involved
options and implementation. 17. How can knowledge brokering be advanced in The European Observatory has an independent programme
in drafting, informing or advising on the policy issue.
a country’s health system?
Policy briefs provide evidence for policy-makers not policy advice. They do not seek to of policy briefs and summaries which are available here:
John. N Lavis, Govin Permanand, Cristina Catallo,
explain or advocate a policy position but to set out clearly what is known about it. They may
BRIDGE Study Team http://www.euro.who.int/en/about-us/partners/
outline the evidence on different prospective policy options and on implementation issues, observatory/publications/policy-briefs-and-summaries
but they do not promote a particular option or act as a manual for implementation.
Cover_Policy_PB_TALLINN_PRINT.qxp_Cover_policy_brief 07/08/2018 13:43 Page 1
Hans Kluge (Division of Health Systems and Public Health at WHO Regional
Office for Europe) and Josep Figueras (European Observatory on Health
Systems and Policies) acted as series editors for these policy briefs commissioned
and published in time for the Tallinn 2018 conference on “Health Systems for
INCLUDE
POLICY BRIEF
INVEST
site (http://www.healthobservatory.eu).
The Division of Health Systems and Public Health supports the Member
States of the WHO Regional Office for Europe in revitalising their public health
systems and transforming the delivery of care to better respond to the health Ellen Nolte
challenges of the 21st century by: addressing human resource challenges,
improving access to and quality of medicines, creating sustainable health
financing arrangements and implementing effective governance tools for
increased accountability.
INNOVATE
ISSN 1997-8073