Professional Documents
Culture Documents
Health Sector Accreditation Research: A Systematic Review: David Greenfield and Jeffrey Braithwaite
Health Sector Accreditation Research: A Systematic Review: David Greenfield and Jeffrey Braithwaite
1093/intqhc/mzn005
Advance Access Publication: 28 March 2008
Abstract
Purpose. The purpose of this study was to identify and analyze research into accreditation and accreditation processes.
Data sources. A multi-method, systematic review of the accreditation literature was conducted from March to May 2007. The
search identied articles researching accreditation. Discussion or commentary pieces were excluded.
Study selection. From the initial identication of over 3000 abstracts, 66 studies that met the search criteria by empirically
examining accreditation were selected.
Data extraction and results of data synthesis. The 66 studies were retrieved and analyzed. The results, examining the
impact or effectiveness of accreditation, were classied into 10 categories: professions attitudes to accreditation, promote
change, organizational impact, nancial impact, quality measures, program assessment, consumer views or patient satisfaction,
public disclosure, professional development and surveyor issues.
Results. The analysis reveals a complex picture. In two categories consistent ndings were recorded: promote change and
professional development. Inconsistent ndings were identied in ve categories: professions attitudes to accreditation,
Address reprint requests to: David Greenfield, Centre for Clinical Governance Research in Health, Faculty of Medicine,
University of New South Wales, Sydney NSW 2052, Australia. Tel: 612 9385 1474; Fax: 612 9385 4926;
E-mail: d.greenfield@unsw.edu.au
been used in other pertinent reviews [10 12]. In conducting agencies about accreditation research. The RWG-reported
the search, where available, citations, abstracts and complete research having been completed, in progress or being
references were downloaded into Endnote X.0.2, a database planned by their member agencies. The following agencies
referencing program, for subsequent assessment. are currently conducting one of more studies, but have yet to
report publicly about their research: Irish Health Services
Accreditation Board (IHSAB), the United Kingdom CHKS,
Selection criteria
Australian Council on Healthcare Standards (ACHS),
We included empirical work that systematically examined Australian General Practice Accreditation Limited (AGPAL),
accreditation or the accreditation process. The studies Haute Autorite de sante (HAS), Italian Society for Quality of
selected centered on how accreditation works, what it does, Health Care, JCAHO, Canadian Council on Health Services
the results achieved and accreditation surveyors and their Accreditation (CCHSA) and the Spanish accreditation organ-
processes. The selection was limited to contributions in ization Fundacion Avedis Donabedian (FAD).
English.
Snowballing via other databases
Electronic database search
The third search strategy involved a snowballing technique
The rst search strategy was a comprehensive interrogation of following up key materials (discussion papers, articles or
of three electronic bibliographic databases. The literature was reports) via the internet and search engines. The
examined from the Medline database from 1950, EMBASE Web-of-science, Google Scholar and Scirus internet search
from 1980 and nursing and allied health literature from engines were employed to locate documents. Literature from
CINAHL from 1982. 1966 or since the internets inception was searched. The
The initial search utilized the broad keywords quality, snowballing technique identied an additional seven docu-
quality assurance, quality indicators and quality of health ments. These included organizational reports and documents,
care. These keywords produced a large number and wide range and peer reviewed articles.
of references; the majority of which were not relevant to the
173
D. Greenfield and J. Braithwaite
[13] A small majority of participants (medical technologists) preferred working in an accredited laboratory.
They experienced that accreditation improved the traceability of work and improved the procedures.
A large majority of participants considered that accreditation increased their workload. Two laboratories
did not think accreditation improved the quality of results. Concerns were accreditation increased
paperwork, decreased adaptability and perception that attention directed to processes rather than quality.
[14] Health professionals (incorporating nurse managers, nurses, carers and quality coordinators/managers)
generally supported the accreditation program for aged care facilities. However, health professionals also
expressed concern about a lack of consistency among assessors and the cost of the accreditation program
for aged care facilities.
[15] Stakeholders (incorporating doctors, hospital administrators, governmental ofcials and insurance
representatives) expressed a high level of support for an accreditation program (voluntary, standards
based approach, periodic external assessment and quality assurance measures). Concern was expressed
that the biggest obstacle was how to nance the accreditation program.
[16] Accredited organizations cited positive benets of the accreditation process. Most indicated that they
would reapply for accreditation. Accredited organizations discussed challenges complying with standards
and meeting the information requirements.
[17] A large majority of respondents agreed that the accreditation program had been of signicant benet to
their organization. The benets included improving communication, commitment to best practice,
information available for evaluation activities and quality care activities, improved structure for quality,
174
Health sector accreditation research
Table 1 Continued
[28] Respondents (hospital administrators) explained that the largest factor contributing to rural hospital
deterrence to seeking accreditation was cost.
[29] Healthcare professionals (physicians, dentists, pharmacists, and nurses) had been facing many problems
with multidisciplinary process-related issues of an accreditation standard. Surveyors experienced
difculties in conveying the core quality improvement concepts to the professionals.
accreditation results in better organizational performance [13, [24, 27, 30]. Professionals from rural health services have
14, 17, 21] and enables collegial decision-making [17, 18] been asked their reasons for failing to participate in an
and accreditation provides a guide to external stakeholders to accreditation program [16, 28]. The most signicant barriers
how quality and safety is managed within an organization identied were cost [28], difculty in meeting standards and
[16, 18, 24]. However, all studies with one exception, which collecting data [16].
recorded improvements due to accreditation [21], did not
attempt to examine the impact of the programs.
Promote change
Other researches report health professionals critical per-
spectives on accreditation. These studies suggest that The activity of preparing and undergoing accreditation has
health professionals hold concerns about their respective been shown to promote change in health organizations [18,
accreditation programs, including the program is bureau- 31 33]; key results are presented in Table 2. A study in
cratic and time consuming for the organization to use Australia monitored for 2 years a group of 23 hospitals
[13, 14, 16 18, 21, 23, 25, 26], the program is perceived which applied for accreditation and then compared them
175
D. Greenfield and J. Braithwaite
[18] Preparations for accreditation provided hospital staff with an opportunity to reect on the operation
of the organization. It enabled the introduction of a continuous quality program, greater consideration
of exit surveys and improved procedure documentation.
[31] Accredited hospitals could be differentiated by signicant changes in six areas: administration and
management, medical staff organization, review systems, organization of nursing services, physical
facility and safety, hospital role denition and planning. Most affected were nursing organization and
physical facilities and safety; least change was found in areas most directly associated with medical
staff.
[32] Different countries have adopted similar accreditation programs. However, they were implementing
and adapting their accreditation programs to meet their specic policy needs.
[33] Hospital combining both a clinical trial and participation in an international accreditation program led
to a signicant improvement of both dissemination and quality of guidelines on perioperative diabetic
care.
[34] Survey of accredited and non-accredited (rehabilitation) programs suggested no signicant differences
in the organization and delivery of cognitive rehabilitation therapy.
[35] Development of a trauma program and commitment to meeting national guidelines through the
accreditation process appeared to be associated with improved outcome after injury.
[36] The study showed wide heterogeneity in the summaries on accreditation and in accreditation agency
decision-making for different size and status hospitals. Also provided initial insight into common
style and an organizational support for the accreditation larger for small and rural organizations compared with
process have been shown to affect the outcome medium to large and urban locations.
positively [38].
Quality measures
Financial impact
Quality measures incorporate items dened as clinical indi-
The nancial costs of accreditation for organizations are an cators, quality indicators or clinical performance measures.
under-researched area. There are contrasting assessments The relationship between quality measures and accreditation
made in the few studies that have been conducted; key is complex; key results are presented in Table 4. In some
results are presented in Table 3. Three studies judged the work, there does not appear to be a direct relationship
costs to be high for individual organizations and ques- between the two. No relationship is generally found between
tioned whether accreditation was an appropriate use of a specied quality measure and an accreditation outcome
resources [14, 26, 39]. In examining an accreditation [42 45]. One study showed that improved compliance with
program in a developing country, one study found that the accreditation standards had little or no effect on clinical indi-
overall nancial viability of the program and costs for indi- cator performance [46]. A weak relationship between accredi-
vidual organizations was unsustainable [40]. Another study tation and quality measures was identied in one instance
noted the costs incurred in participating in accreditation, [47]. In a similar vein, a relationship did hold for health plan
and argued that these should be viewed as an essential scores when compared with accreditation [42]. However, in
investment [30]. the same study, accreditation and patient-reported measures
A recent work examined the costs for a specic health of quality and satisfaction were found to be unrelated.
service (methadone treatment sites). It concluded that there For some time, accreditation agencies have been develop-
were no signicant nancial differences for organizations of ing, implementing and monitoring quality measures in health
different size and location [41]. However, the study also care organizations. While not always an essential part of their
reported that per-patient accreditation costs were substantially respective accreditation programs, some quality measures
176
Health sector accreditation research
[14] Health professionals expressed concern about the cost of the accreditation program for aged care
facilities.
[26] Senior staff s principal concerns of an accreditation program were related to perceptions that the process
was unwieldy and it offered little value for patient care delivery for the resources required.
[30] A study of expenditures in accreditation argued that the costs should be seen as an essential investment
and demonstration of commitment to quality.
[39] Case study of a neuropsychiatric hospital which questioned whether the quality of care was improved by
the accreditation process and the costs constitute an appropriate use of resources.
[40] Serious resource constraints, both nancial and expertise, had undermined the ongoing viability of the
Zambian hospital accreditation program.
[41] Methadone treatment sites faced similar accreditation costs regardless of characteristics such as size and
location. Rural and smaller sites incurred a greater burden from accreditation. There was no signicance
difference in cost for a site regardless of accreditation outcome; nor did previous accreditation affect the
cost.
Accreditation preparation costs were the majority of the total expenditure, with the majority of
preparation in the nal months prior to survey. Preparation for accreditation was seen as labor intensive.
[42] A study to determine the characteristics of accredited plans, their performance on quality
indicators and the impact on enrolment. The results showed accreditation did not ensure
high-quality care. It is positively associated with some measures of quality, but it did not ensure
a minimal level of performance.
[43] During an accreditation survey, experienced surveyors failed to detect an error-prone medication
usage system (shown by an independent audit). This raised questions about the validity of
survey scores as a measure of safety.
[44] There was a potentially serious disjuncture between outcome measures and accreditation
evaluations. Data showed no relationship of substance, and a confusing pattern of minor and
sometimes conicting associations.
[45] No signicant relationships existed between categorical accreditation decisions (JCAHO) and
quality indicators.
[46] Those hospitals participating in an accreditation program improved their compliance with
accreditation standards; non-participating hospitals did not. However, there was no observed
improvement on the quality indicators.
[47] Analysis revealed a weak relationship between accreditation or certication status and the
indicators of quality of care (the characteristics examined were average cost per patient, per diem
bed cost, total staff hours per patient, clinical staff hours per patient, percent of staff hours
provided by medical staff bed turnover, and percent of beds occupied). Accredited or certied
hospitals were more likely to have higher values on specic indicators than hospitals without
accreditation.
[48] Clinical indicators were reported to have become an accepted part of hospital quality
improvement activities. The inclusion of clinicians in indicator development, along with regular
feedback had resulted in their extensive use, and many actions to improve patient care.
[49] An accrediting agency provided feedback to organizations on their quality indicator data.
A signicant majority of organizations responded to this feedback to improve both the
processes and outcomes of patient care.
(continued )
177
D. Greenfield and J. Braithwaite
Table 4 Continued
[50] A self-evaluation project allowed health services to monitor their own activities in order to asses
critical factors related to patient care. The project had the potential to be the starting point to
improve the quality of services and to compare national and international quality assurance
results.
[51] Quality indicator performance measures encouraged organizations to seek improvements in
patient care (data showed improvement in 15 of 16 inpatient measures).
[52] Including discharge instructions among other evidence-based heart failure core measures
appeared to reduce re-admission or mortality.
[53] Feedback to hospitals on their clinical indicator performance produced consistent improvement
over the study period. Hospitals initially with low levels of performance had greater
improvements than those with higher performance.
[54] A study examining the value of self-reporting standardized performance indicators for hospitals.
Symmetry of disagreement among original abstractors and re-abstractors identied eight
indicators whose differences in calculated rates were statistically signicant.
[55] A study comparing organizations with and without quality improvement activities: the effects of
self-reported quality improvement activities were often small and inconsistent, and in some
instances contrary to expectations.
[56] It was faulty to assume that clinical indicators derived from different measurement systems will
give the same rank order.
[57] Hospitals that participate in a quality improvement program were no more likely to show
have been shown to improve care outcomes in health organ- Program assessment
izations [48 54]. Similarly, participation in an accreditation
Accreditation programs have been assessed and researched
program and a randomized clinical trial promoted improve-
for their validity [17, 21, 23, 27, 43, 60 64]; key results are
ment in a quality measure, in this instance a clinical guideline
presented in Table 5. The ndings from this research are
[33]. However, another study found that the effects of
inconsistent. Accreditation programs in six studies were
quality improvement activities were often small and inconsist-
deemed to be credible [17, 21, 23, 27, 61, 62]. The validity
ent [55]. An important argument has been made that differ-
of accreditation programs was questioned in other cases and
ent quality measures, developed and implemented in
authors have argued for the need for improvements in or
different ways, should not be expected to promote similar
clarication of standards [21, 60, 63, 64]. In one instance,
outcomes [56].
the validity of an accreditation program as a measure of
Conicting ndings hold in comparing accredited and
patient safety was questioned, based on its failure to identify
non-accredited hospital quality indicator performance.
an error-prone medication usage system [43].
Quality indicator results from hospitals that voluntarily par-
Two descriptive studies examined the development or
ticipate with quality improvement organizations could not be
implementation of accreditation programs in developing
differentiated from those hospitals that do not participate
countries [40, 65]. In one, the milestones achieved and chal-
[57]. Similarly, no difference could be found between accre-
lenges facing the program were detailed [40]. In the other,
dited hospitals, non-accredited hospitals and nursing homes
an overview of the program and its development was
for medication errors [58]. However, another study revealed
presented [65].
that accredited hospitals performed better on a range of
An argument has been made in favor of specialized organ-
quality indicators than did non-accredited hospitals, albeit
izations that perform accreditation and establish standards
there was considerable variation of performance within the
for healthcare delivery, at least in the United States [66].
accredited hospitals [59].
178
Health sector accreditation research
[17] A large majority of respondents agreed that the accreditation program had been of signicant benet
to their organization. The benets included improving communication, commitment to best practice,
information available for evaluation activities and quality care activities, improved structure for quality,
greater focus on consumers, supporting planned change and staff management and development.
[21] Most laboratories thought accreditation had resulted in better laboratory performance with more
documentation and better health and safety training procedures. However, a signicant proportion of
laboratories considered accreditation to be overly bureaucratic, inefcient and expensive. A concern
that accreditation covered the domains of other regulatory bodies was also expressed.
[23] Medical fellowship faculty believed that the requirements and criteria were valid for determining
quality of faculty development fellowship programs. However, the accreditation process was
considered by faculty staff to be time-consuming and they thought that it could be shortened.
[27] The study examined the small hospital accreditation scheme in the United Kingdom. The program
(including visits by independent surveyors) was valued by respondents who were also keen to see it
continue to evolve.
[40] Serious resource constraints, both nancial and expertise, had undermined the ongoing viability of the
Zambian hospital accreditation program.
[43] During an accreditation survey experienced surveyors failed to detect an error-prone medication usage
system (shown by an independent audit). This raised questions about the validity of survey scores as a
measure of safety.
While leaving open the question as to whether such accredit- relationships [42, 67, 68]; key results are presented in
ing organizations are ensuring high-quality healthcare, the Table 6. An examination of the relationship between
authors express support for the range of specialized accredit- not-for-prot hospital accreditation scores and patient satis-
ing organizations and programs. The difculties experienced faction ratings found no association, either summatively or
by an accrediting organization in the United Kingdom have formatively [67]. Similarly, patient-reported measures of
also been examined. The study suggested that there was an quality and satisfaction between accredited and non-
imbalance between setting and implementing the standards accredited health plans could not be differentiated [42].
of the accreditation program [64]. Patients and health professionals views about compliance
with accreditation standards have been compared. While differ-
ing in specic details, the satisfaction rank-order correlations
Consumer views or patient satisfaction for the two groups were similar [69]. A survey of patients
Although the relationships between consumer views or during the accreditation of general practices showed patients
patient satisfaction and accreditation remain largely unex- scored practice issues (access, availability and information avail-
plored, the limited work that has taken place found no ability) lower than doctors interpersonal skills [68].
179
D. Greenfield and J. Braithwaite
Table 6 Key results of consumer views or patient satisfaction, public disclosure, professional development and surveyor
issues
[42] A study to determine the characteristics of accredited plans, their performance on quality indicators
and the impact on enrolment. The results showed accreditation did not ensure high quality care. It is
positively associated with some measures of quality, but it did not ensure a minimal level of
performance.
[67] No relationships were identied between hospital accreditation scores and patient-satisfaction ratings,
suggesting a dissociation between them.
[68] As part of an accreditation program for general practices patient views were examined. Patients
considered that doctors need to improve interpersonal skills, access, availability and patient
information.
[70] The study showed a positive association between accreditation scores and public disclosure of
accreditation reports of hospitals.
[71] Students who attended an accredited paramedic program were more likely to achieve a passing score
on a national paramedic credentialing examination.
[72] There were signicant positive relationships between accreditation afliation of nursing programs and
membership in professional nursing organizations and between accreditation afliation of nursing
programs and major contributing factors used to select accrediting agencies.
[73] A re-accreditation program was having benecial effects (increasing the amount and type of activities)
on the continuing medical education activities of many participating general practitioners.
180
Health sector accreditation research
year. Counter-intuitively, in the second year, the performance research program into accreditation. For this research the
of those who trained in a non-accredited program was Centre has industry partners the Australian Council on
assessed to be better than their colleagues from accredited Healthcare Standards and Ramsay Healthcare.
programs.
Surveyor issues
Funding
Research into accreditation surveyors is limited; key results
are presented in Table 6. One study examined the skills and This research was supported under Australian Research
qualities of surveyors and the challenges they faced when Councils Linkage Projects funding scheme ( project number
undertaking accreditation surveys [27]. A comparative study LP0560737).
examined the similarities and differences of surveyors across
six accreditation programs [75]. A more recent Thai study,
which also considered the opinions of health professionals,
demonstrated that both groups shared a similar prioritizing References
of concerns. The surveyors focused more attention on
care-related items than did the health professionals, who 1. Baker S, Dunn D. Accreditation: the hallmark of educational
were focused on multidisciplinary process-related problems quality. Radiol Technol 2006;78:123 30.
associated with the program [29]. 2. Fernandopulle R, Ferris T, Epstein A et al. A research agenda
for bridging the quality chasm. Health Aff 2003;22:178 90.
Discussion and conclusion 3. Mays G. Can Accreditation Work in Public Health? Lessons
from Other Service Industries. University of Arkansas for Medical
Sciences, 2004.
Although we searched in a multi-method, comprehensive
manner, electronic research indexing is generally problematic 4. vretveit J. Which Interventions Are Effective for Improving Patient
Safety? A Review of Research Evidence. Stockholm: Karolinska
181
D. Greenfield and J. Braithwaite
15. Nandraj S, Khot A, Menon S et al. A stakeholder approach 32. Scrivens E, Klein R, Steiner A. Accreditation: what can we
towards hospital accreditation in India. Health Policy Plan learn from the Anglophone model? Health Policy
2001;16:7079. 1995;34:193 204.
16. Casey M, Klingner J. HMOs serving rural areas: experiences 33. Juul AB, Gluud C, Wetterslev J et al. The effects of a random-
with HMO accreditation and HEDIS reporting. Manag Care Q ised multi-centre trial and international accreditation on avail-
2000;8:4859. ability and quality of clinical guidelines. Int J Qual Health Care
Inc Leadersh Health Serv 2005;18:321 8.
17. Kreig T. An Evaluation of the ACHS Accreditation Program: Its
Effects on the Achievement of Best Practice. Sydney: University of 34. Mazmanian PE, Kreutzer JS, Devany CW et al. A survey of
Technology, 1996. accredited and other rehabilitation facilities: education, training
and cognitive rehabilitation in brain-injury programmes. Brain
18. Pomey MP, Contandriopoulos AP, Francois P et al.
Inj 1993;7:319 31.
Accreditation: a tool for organizational change in hospitals? Int
J Qual Health Care Inc Leadersh Health Serv 2004;17:113 24. 35. Simons R, Kasic S, Kirkpatrick A et al. Relative importance of
designation and accreditation of trauma centers during evol-
19. Baker SS, Morrone AS, Gable KE. Allied health deans and
ution of a regional trauma system. J Trauma 2002;52:827 34.
program directors perspectives of specialized accreditation
effectiveness and reform. J Allied Health 2004;33:247 54. 36. Daucourt V, Michel P. Results of the rst 100 accreditation pro-
cedures in France. Int J Qual Health Care 2003;15:463 71.
20. Casamassimo PS, Wilson S. Opinions of practitioners and
program directors concerning accreditation standards for post- 37. Sheahan M. Customer focus: patient, organisation and EQuIP
doctoral pediatric dentistry training programs. Pediatr Dent in collaboration. J Qual Clin Pract 1999;19:139 44.
1999;21:3548.
38. Peterson CA. Management, faculty, and accreditation outcomes:
21. Gough L, Reynolds T. Is clinical pathology accreditation worth a survey of physical therapy faculty and program directors.
it? A survey of CPA-accredited laboratories. Clin Perform Qual J Phys Ther Edu 2003;17:2231.
Health Care 2000;8:195 201.
39. Rockwell D, Pelletier L, Donnelly W. The cost of accreditation:
22. Macfarlane F, Tavabie A, Desombre T. Accredited professional one hospitals experience. Hosp Community Psychiatry
development: a qualitative study of the feasibility, acceptability 1993;44:151 5.
182
Health sector accreditation research
48. Collopy BT. Clinical indicators in accreditation: an effective 62. Hampel MJ, Hastings MM. Assessing quality in nursing home
stimulus to improve patient care. Int J Qual Health Care dementia special care units: a pilot test of the Joint Commission
2000;12:211 6. protocol. J Ment Health Adm 1993;20:236 46.
49. Collopy BT, Williams J, Rodgers L et al. The ACHS Care 63. Huda W, Sajewicz AM, Ogden KM et al. How good is the ACR
Evaluation Program: a decade of achievement. J Qual Clin Pract accreditation phantom for assessing image quality in digital
2000;20:36 41. mammography? Acad Radiol 2002;9:764 72.
50. Gabriele P, Malinverni G, Bona C et al. Are quality indicators 64. Jain N, Willett KM. Maintaining standards in surgical training:
for radiotherapy useful in the evaluation of service efcacy in a how effective is accreditation by the specialist advisory commit-
new based radiotherapy institution? Tumori 2006;92:496 502. tee in the United Kingdom? J Bone Joint Surg
2006;88-B:111115.
51. Silver M, Geis M, Bateman K. Improving health care systems
performance: a human factors approach. Am J Med Qual 65. Whittaker S, Green-Thompson RW, McCusker I et al. Status of
2004;19:93102. a health care quality review programme in South Africa. Int J
Qual Health Care 2000;12:24750.
52. VanSuch M, Naessens J, Stroebel R et al. Effect of discharge
instructions on readmission of hospitalised patients with heart 66. Viswanathan HN, Salmon JW. Accrediting organizations and
failure: do all of the Joint Commission on Accreditation of quality improvement. Am J Manag Care 2000;6:1117 30.
Healthcare Organizations heart failure core measures reect
67. Heuer AJ. Hospital accreditation and patient satisfaction: testing
better care? Qual Saf Health Care 2006;15:414 7.
the relationship. J Healthcare Qual 2004;26:4651.
53. Williams SC, Schmaltz SP, Morton DJ et al. Quality of care in
68. Greco M, Sweeney K, Brownlea A et al. The practice accredita-
U.S. hospitals as reected by standardized measures, 2002-2004.
tion and improvement survey (PAIS). What patients think. Aust
N Engl J Med 2005;353:255 64.
Fam Physician 2001;30:1096 100.
54. Williams SC, Watt A, Schmaltz SP et al. Assessing the reliability
69. Durieux P, Bissery A, Gasquet I et al. Comparison of health
of standardized performance indicators. Int J Qual Health Care
care professionals self-assessments of standards of care and
2006;18:246 55.
patients opinions on the care they received in hospital: observa-
55. Borenstein J, Badamgarav E, Henning J et al. The association tional study. Qual Saf Health Care 2004;13:198 202.
183