Professional Documents
Culture Documents
Heine, 2015 Capd
Heine, 2015 Capd
Heine, 2015 Capd
Keywords Abstract
clinical guidelines, evaluation, systematic
reviews Rationale, aims and objectives An increased interest in Central Auditory Processing
Disorder has seen the publication of several guidelines to help inform clinical practice. The
Correspondence aim of this study was to conduct a systematic search and critically evaluate published
Dr Chyrisse Heine guidelines to inform the ongoing development of evidence-based practice in this area.
Discipline of Speech Pathology Method A systematic search of the literature was conducted according to the Preferred
Department of Community & Clinical Allied Reporting Items for Systematic Reviews guidelines. Nominated guidelines were then
Health critiqued using the Appraisal of Guidelines and Research and Evaluation (AGREE II) tool.
College of Science, Health and Engineering, Results Five clinical practice guidelines in the area of Central Auditory Processing Dis-
School of Allied Health order were identified. The British Society of Audiology guideline achieved the highest
La Trobe University rating for scope and purpose, rigour of development and applicability and overall score.
Bundoora, Vic 3086 Conclusions The AGREE II tool is an effective way to critically evaluate the quality of
Australia methodological reporting of clinical practice guidelines in the area of Central Auditory
E-mail: c.heine@latrobe.edu.au Processing Disorder and provides direction for the ongoing development of these guide-
lines in the future.
Accepted for publication: 12 November 2015
Acronyms and Abbreviations: Central Auditory Processing (CAP); Central Auditory Pro-
doi:10.1111/jep.12494 cessing Disorder (CAPD); Clinical practice guideline (CPG); Preferred Reporting Items for
Systematic Reviews (PRISMA); Appraisal of Guidelines and Research and Evaluation
(AGREE II).
988 Journal of Evaluation in Clinical Practice 21 (2015) 988–994 © 2015 John Wiley & Sons, Ltd.
C. Heine and R. O‘Halloran CAPD: an evaluation of clinical practice guidelines
language pathology and audiology [8] and the BSA [9,10] have guidelines) that may have been published in 2014 or 2015. Search
published position statements or practice guidelines on CAPD. The terms were generated to include the concepts of population and
recommendations in these positions statements and practice guide- publication type. Population search terms included central auditory
lines also vary and it remains unclear which statement or guideline processing disorder OR auditory processing disorder OR auditory
clinicians should use to inform clinical practice. For example, the processing OR central auditory processing OR perceptual disor-
AAA [7] reported that CAPD ‘can be the result of a number of ders. The publication type search terms were practice guideline,
different etiologies that involve deficits in the function of the central clinical guideline, clinical practice guideline, position statement or
auditory nervous system (CANS)’ (p3) and that the diagnosis of systematic review. Eight databases were searched including
CAPD ‘should be made by audiologists who have been properly MEDLINE, Informit health, CINAHL, EMBASE, Cochrane
educated and trained in the area’ (p5). In contrast, the BSA [9] Library, PsycINFO, Health & Medical Complete (ProQuest) and
concluded that CAPD is ‘closely associated with impaired top- Web of Science. An internet search using Google Scholar was also
down, cognitive function. There is no evidence that it is produced by conducted. In addition, searches were made of the following six
a primary, sensory disability’(p6). association websites; American Speech and Hearing Association,
One reason for the variability in the recommendations of these American Academy of Audiology, Royal College of Speech and
practice guidelines may be in how they were developed. Ideally, Language Therapists (UK), British Society of Audiology, Speech
clinical practice guidelines are ‘statements that include recommen- Pathology Australia, Audiological Society of Australia and 10
dations intended to optimize patient care that are informed by a guideline databases; National Health and Medical Research
systematic review of evidence and an assessment of the benefits Council of Australia Clinical Practice Guidelines Portal, Medical
and harms of alternative care options’ [ [11], p1]. When clinical Journal of Australia Clinical Guidelines, New Zealand Guideline
practice guidelines are based on a systematic search of the research Group, National Institute for Health and Clinical Excellence (UK),
evidence, they provide clinicians with a high level of synthesized Scottish Intercollegiate Guidelines Network, International Guide-
research evidence that enables them and their clients to make more line Library (Guidelines International Network), CMA Infobase:
informed decisions about clinical care [12]. However, not all clini- Clinical Practice Guidelines (Canadian Medical Association),
cal practice guidelines are of a high quality and different appraisal National Guideline Clearinghouse (US) and Compendium of EBP
tools have been developed over the years to discriminate high Guidelines & Systematic Reviews (ASHA)].
quality guidelines from low quality ones [13]. In a systematic
review of these appraisal tools, Vlayen and colleagues [13] con-
Inclusion criteria and selection process
cluded that the Appraisal of Guidelines and Research and Evalu-
ation (AGREE) instrument [14] should be used to appraise clinical Following a similar study conducted by Rohde and colleagues
practice guidelines because it is the only tool that has been vali- [17], documents were included in this appraisal if they met the
dated, is easy to use, has been internationally developed and was following four criteria. These were that the document: (i) met the
therefore widely accepted [13]. Further revisions were made to the definition of a CPG as defined by Field and Lohr [21]. That is, that
AGREE instrument resulting in the publication of the AGREE II the document included ‘systematically developed statements to
tool in 2010 [15] which was updated again in 2013 (see http:// assist practitioner and patient decisions about appropriate
www.agreetrust.org/). Detailed information about the history of healthcare for specific clinical circumstances (p2); (ii) addressed
the development of the AGREE tool, modifications to the AGREE the topic of assessment, diagnosis, prognosis or management of
II tool, psychometric properties and translations can be found on CAP or CAPD in children and/or adults; (iii) related to audiology,
the AGREE website [16] and has been used to review the quality speech pathology or multidisciplinary practice in the area of
of clinical practice guidelines across a wide range of topics includ- CAPD; and (iv) were published in or translated into English.
ing the management of aphasia after stroke [17] acute pain in The authors and the research assistant are experienced in the
paediatrics [18] and alcohol and drug misuse in adolescents [19]. field of evidence-based practice and speech pathology. Addition-
The development of this valid, internationally accepted appraisal ally, the first author and the research assistant are experienced in
tool provides the opportunity to evaluate the quality of current the field of audiology. Following a discussion regarding search
clinical practice guidelines in the area of CAPD and provide direc- terms, inclusion and exclusion criteria, the first author conducted
tion for the ongoing development of research evidence in this area. the initial search of the databases. The first author and research
Thus, the aim of this study was to conduct a systematic search of assistant then independently screened the initial yield on the basis
the literature for clinical practice guidelines related to the assess- of title and summary removing duplicates and any other docu-
ment and management of CAPD and to critique these guidelines ments that did not meet all four criteria described above. Then the
using the AGREE II tool. two authors independently read the full text of the remaining 10
documents and independently decided if they should be included
in the appraisal. Throughout the search history, disagreements
Methods and materials were resolved through consensus.
Evidence acquisition
Appraisal using the AGREE II
The literature identification and selection procedure was based on
the Preferred Reporting Items for Systematic Reviews [20]. Spe- The AGREE II [15] comprises 23 items that are categorized into
cifically, a systematic search of the literature was conducted in the six separate domains. The six domains and the number of items
months from June 2013 until December 2013. Another search was used to rate each domain are: Scope and purpose (3 items); Stake-
also conducted in October 2015 for any new CPGs (clinical practice holder involvement (3 items); Rigour of development (8 items);
Results
The literature search yielded 126 documents. A total of 14 docu-
ments were removed due to duplication. A further 102 articles Studies included in
were excluded as they were not consistent with the definition of review
clinical practice guideline (n = 2), not related to CAPD (n = 99) or (n = 6)
not published in or translated into English (n = 1). Both authors
reviewed the full text of the remaining 10 documents. A further Figure 1 Flow chart illustrating the literature search and selection
four documents were removed as they too were not consistent with process.
the definition of clinical practice guideline on close reading. The
six remaining documents that were included in this evaluation
were the (i) AAA Clinical Practice Guidelines [7]; (ii) American
Speech and Hearing Association (ASHA) (Central) Auditory Pro- 19.4% for the AAA guideline. In regards to Rigour of develop-
cessing Disorders technical report [1]; (iii) BSA, Position State- ment, there was a big gap between the two BSA guidelines (which
ment Auditory Processing Disorder (APD) [9]; (iv) Canadian both received a score of around 45%) and the other guidelines
guidelines on auditory processing disorder in children and adults: (Canadian, AAA, Colorado and ASHA) which all received a score
Assessment and Intervention [8]; (v) Colorado Department of around 10–11%. Clarity of presentation scores ranged from a
Education, Auditory Processing Disorders: A team approach to score of 63.8% for the BSA Clinical Guidance guideline to a low
screening, assessment & intervention practices [22]; and (vi) the score of 19.4% for the Colorado guideline. In the domain of
BSA Practice Guidance. An overview of current management of Applicability, all guidelines scored under 30% with the British
auditory processing disorder (APD) [10]. Details of the search Position Statement guideline scoring the highest (27.1%), fol-
results are provided in Fig. 1. lowed by the AAA guideline (with a score of 22.9%), the BSA
How the six guidelines were rated by the two raters on each item Clinical Guidance guideline scoring 20.8%, the Colorado and
of the AGREE II is presented in Table 1 below. A summary of the Canadian guidelines equally scoring 12.5% and the ASHA guide-
calculated quality domain scores of the five guidelines is presented line scoring the lowest value of 8.3%. Again, all guidelines
in Table 2. received a low score (under 10%) for Editorial independence with
As is evident from Table 2, the quality domain scores for stating the Colorado, AAA, ASHA and Canadian guidelines all receiving
the Scope and Purpose of the guideline ranged from 50% (for the a score of 8.3% and the British Clinical Guidance guideline receiv-
BSA Position Guidance guideline) to below 20% (for the Colorado ing a score of 0% in this area. In general, guideline ratings in most
and ASHA guidelines). Similarly, domain scores for Stakeholder domains were low (with the highest rating in a domain around
involvement ranged from 41.6% for the Canadian guideline to 63.8%), primarily due to poor methodological reporting.
Independence
tion Statement guideline was rated highest with a rating of 5 out of
23
1
1
1
1
1
1
1
1
1
1
1
1
Editorial 7. Strengths of the BSA Position Statement guideline included that
the objectives were well-described (item 1), development groups
22 were consulted (item 4), systematic methods were used to develop
3
1
3
1
2
1
3
1
3
1
1
1
the position statement (item 7), the strengths and limitations of the
guideline were clearly described (item 9) and specific recommen-
21
1
1
1
1
1
1
2
1
2
1
2
1
dations were provided (item 15). The second highest rated guide-
lines were the Canadian guideline and British Clinical Guidance
20
5
1
2
1
2
2
1
1
1
1
3
1
guideline, both receiving a quality rating of 4 out of 7. The Cana-
dian guideline was extensive and included a multidisciplinary
Applicability
19
defined (item 6), procedures for updating the guideline were pro-
3
2
3
1
1
1
3
2
2
1
2
1
vided (item 14) and that specific recommendations were provided
(item 15). The British Clinical Guidance guideline was clearly
17
3
1
1
1
2
3
2
1
2
1
5
5 written and included a reference to evidence-based practice. High
Presentation
3
3
3
2
5
6
6
5
4
2
6
6
tives of the guideline (item 1), clearly describing the criteria for the
evidence (item 8) and clearly presenting options for management
15
4
2
3
2
4
4
6
5
3
1
4
3
use in their current form, there were three guidelines that were
3
2
3
1
6
4
1
1
3
1
3
2
3
1
1
1
1
3
1
1
3
1
3
5
3
1
3
2
2
2
1
1
2
1
2
1
AAA, American Academy of Audiology; ASHA, American Speech and Hearing Association.
1
1
2
1
7
5
2
1
2
1
3
4
1
1
2
1
5
3
2
1
2
1
6
6
Discussion
7
3
1
2
1
7
6
2
1
3
1
4
4
2
3
3
5
3
3
7
5
4
3
4
6
overall rating on the AGREE II, this critique also highlighted areas
5
1
1
1
1
1
1
1
1
1
1
1
1
3
3
3
2
5
5
4
3
4
4
5
3
Table 1 Item rating of each guideline by each rater
6
4
2
1
3
5
4
4
3
2
3
3
Furthermore, this guideline only briefly defined CAPD and did not
Purpose
2
1
2
1
2
2
1
1
1
2
3
4
2
2
3
2
6
5
3
4
3
2
5
6
1
2
1
2
1
2
1
2
1
2
1
2
Rater
Rater
Rater
Rater
Rater
Rater
Rater
Rater
Rater
Rater
Rater
Rater
the second highest score for methodological quality and were also
British Clinical
Statement
Canadian
Colorado
Combined
Scope and Stakeholder Rigour of Clarity of Editorial Overall
Guideline Purpose Involvement Development Presentation Applicability Independence Rating
the recommendations made and it did not include information on tant in the AGREE II tool that are not included in the CPGs on
how the guideline would be monitored and changed according to CAPD that are currently available. The AGREE II tool highlighted
developments in the research literature. The British Clinical Guid- some areas where all CPGs in CAPD could be improved. For
ance Guideline included a multidisciplinary approach with refer- example, at present there is very little consultation with target
enced levels of evidence. Although this guideline was clearly population groups (such as medical professionals, teachers, people
written and considered stakeholders, it was restricted in applica- with CAPD and their families) to inform the development of
bility and did not clearly include the views of the funding body and CPGs. Inclusion of a wide array of stakeholders can add to the
competing interests of members of the working party that devel- credibility of the CPG. Explicit and consistent reporting of the
oped the guideline. The three further guidelines (Colorado, ASHA level of research evidence supporting guideline recommendations,
and AAA) were not recommended. Although the AAA guideline external review by experts and the reporting of any competing
does provide the level of evidence for each recommendation made interests of groups members involved in the development of the
in the area of CAPD, it has only included audiologists as the CPG would also enhance the credibility of all CPGs in this area.
stakeholders with little consultation from other professional Further areas in which the CPGs received low ratings included that
groups who may be involved in the assessment and/ or manage- the health question was not specifically outlined and that the
ment of CAPD (item 5 on the AGREE II). Furthermore, whilst the methods for formulating recommendations were not clearly
diagnostic process is extensively presented, the management of described.
CAPD is not covered in great detail, thus the supporting evidence
and recommendations in the management section is limited (items
8 and 9 on the AGREE II). It is unknown who comprised the
Conclusions
reference group and by whom this guideline was reviewed. There The AGREE II tool is a useful tool to compare different clinical
is also no information available regarding recommendations and practice guidelines across a range of different domains. However,
how this guideline will be updated. The Colorado guidelines are as stated by Vlayen and colleagues [13], like all appraisal tools
based on the ASHA (2005) guidelines and provide a comprehen- developed to assess the quality of CPGs, the AGREE II tool
sive but descriptive overview of tests, checklists and treatment provides a way to critique the methodological quality of CPGs but
options for CAPD. This guideline has not been peer reviewed and it does not provide a way to assess the clinical content of CPGs or
thus received a low rating on items 5, 13 and 23 on the AGREE II. the quality of the research evidence informing the recommenda-
Much of the information contained in this guideline is, however, of tions [13]. That is, a CPG could have a very high rating on the
clinical value. Since none of the recommendations of this guide- AGREE II tool even though the research evidence is of very low
line are directly linked to research evidence, it is not possible to quality (for example, all expert opinion) and the clinical recom-
judge the strength of the clinical recommendations provided in the mendations are of little value. Therefore, whilst a high AGREE II
guideline. Similarly, the 2005 ASHA [1] position statement, based rating suggests the CPG has been developed with a high degree of
on the 1996 publication by ASHA [23] is an important landmark methodological rigour, judgment is still required to determine the
compilation of information regarding the clinical assessment and clinical value of the recommendations that are made.
management of CAPD. Even though it does not purport to be a The AGREE II tool provides a structure and direction for the
guideline, it was included in this review because it met the inclu- ongoing development of guidelines in the area of CAPD, particu-
sion criteria. As a position statement supplying technical support, larly in encouraging explicit linking of research evidence to
this document is the initial platform on which other documents support recommendations. Well-written CPGs also provide direc-
have been based and has allowed for fruitful discussion and further tion for further research where there is a lack of research evidence
research in the area of CAPD. A recognized limitation of this study or conflicting research evidence. The development of high-quality
is that guidelines in languages other than English were not CPGs is essential, particularly in a field such as CAPD, which is
included in this study. surrounded by different professional opinions. The availability of
The implication of the finding that most of the domains scored CPGs in the area of CAPD may encourage clinicians to refer to
below 50% suggests that there are many criteria considered impor- and implement them.
Thus, whilst there are a few guidelines available in the area of 9. British Society of Audiology (2011). Position statement. Auditory
CAPD, there is no one standout guideline that in its present form, Processing Disorder (APD). Available at: ftp://ftp.phon.ucl.ac.uk/pub/
without modification, successfully meets the six criteria of the andyf/BSA_APD_Position_Consultation.pdf (last accessed 19
AGREE II tool. The BSA Position Statement guideline did, October 2015).
10. British Society of Audiology (2011). Practice Guidance. An overview
however, receive the highest score and was recommended with
of current management of auditory processing disorder (APD). Avail-
modification. The results of this review have identified the need for able at: http://www.thebsa.org.uk/wp-content/uploads/2014/04/BSA
ongoing development of CPGs in the area of CAPD so that clini- _APD_Management_1Aug11_FINAL_amended17Oct11.pdf (last
cians can be better informed of evidence-based procedures and accessed 19 October 2015).
practices when assessing and managing their clients with CAPD. 11. Institute of Medicine of the National Academies, Graham, R.,
The AGREE II tool is useful to evaluate guidelines and can serve Mancher, M., et al. (eds) (2011) Clinical Practice Guidelines We can
as a tool to guide further guideline development in the area of Trust. Washington, DC: National Academy Press. http://www.iom
CAPD. .edu/Reports/2011/Clinical-Practice-Guidelines-We-Can-Trust/Repor
t-Brief.aspx Report brief (last accessed 19 October 2015).
12. Windish, D. (2013) Searching for the right evidence: how to answer
Acknowledgement
your clinical questions using the 6S hierarchy. Evidence-based Medi-
Ms Liora Symons is acknowledged for her contribution to the cine, 18 (3), 93–97.
updated database search. 13. Vlayen, J., Aertgeerts, B., Hannes, K., Sermeus, W. & Ramaekers, D.
(2005) A systematic review of appraisal tools for clinical practice
guidelines: multiple similarities and one common deficit. Interna-
References
tional Journal for Quality in Health Care, 17 (3), 235–242.
1. American Speech-Language-Hearing Association (ASHA) (2005). 14. AGREE Collaboration (2003) Development and validation of an inter-
(Central) auditory processing disorders: working group on auditory national appraisal instrument for assessing the quality of clinical prac-
processing disorders. Available at: http://www.asha.org/policy/ tice guidelines: the AGREE project. Qual Safe Health Care, 12 (1),
TR2005-00043/ (last accessed 19 October 2015). 18–23.
2. Leonard, L., Ellis Weismer, S., Miller, C., Francis, D., Tomblin, B. & 15. Brouwers, M., Kho, M. E., Browman, G. P., et al. for the AGREE Next
Kail, R. (2007) Speed of processing, working memory, and language Steps Consortium (2010) AGREE II: advancing guideline develop-
impairment in children. Journal of Speech, Language, and Hearing ment, reporting and evaluation in healthcare. Canadian Medical Asso-
Research, 50, 408–428. ciation Journal, doi: 10.1503/cmaj.090449. Available at: http://
3. Dawes, P. & Bishop, D. (2009) Auditory processing disorder in rela- www.agreetrust.org (last accessed 5 July 2010). Electronic version.
tion to developmental disorders of language, communication and 16. AGREE II Enterprise website. Available at: http://www.agreetrust.org/
attention: a review and critique. International Journal of Language agree-ii/ (last accessed 19 October 2015).
and Communication Disorders, 44, 440–465. 17. Rohde, A., Worrall, L. & Le Dorze, G. (2013) Systematic review of the
4. Dawes, P. & Bishop, D. V. M. (2010) Psychometric profile of children quality of clinical guidelines for aphasia in stroke management.
with auditory processing disorder and children with dyslexia. Archives Journal of Evaluation in Clinical Practice, 19, 994–1003.
of Disease in Childhood, 95, 432–436. 18. Lee, G. Y., Yamada, J., Kyololo, O., Shorkey, A. & Stevens, B. (2014)
5. Heine, C. (2005) Central auditory processing in children: a theoretical Pediatric clinical practice guidelines for acute procedural pain: a sys-
and clinical perspective. ACQuiring Knowledge in Speech, Language tematic review. Pediatrics, 133 (3), 500–515.
and Hearing, 7 (2), 56–59. 19. Bekkering, G. E., Aertgeerts, B., Asueta-Lorente, J. F., et al. (2014)
6. Moore, D. R., Rosen, S., Bamiou, D.-E., Campbell, N. G. & Practitioner Review: evidence-based practice guidelines on alcohol
Sirimanna, T. (2013) Evolving concepts of developmental auditory and drug misuse among adolescents: a systematic review. Journal of
processing disorder (APD): a British Society of Audiology APD Child Psychology and Psychiatry, 55 (1), 3–21.
Special Interest Group ‘white paper. International Journal of Audiol- 20. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G. & The PRISMA
ogy, 52, 3–13. Group (2009) Preferred reporting items for systematic reviews and
7. American Academy of Audiology (2010). American Academy of meta-analyses: the PRISMA statement. British Medical Journal, 339,
Audiology Clinical Practice Guidelines. Guidelines for the diagnosis, 332–336.
treatment and management of children and adults with central auditory 21. Field, M. J. & Lohr, K. N. (1990) Clinical Practice Guidelines: Direc-
processing disorder. Available at: http://audiology-web.s3.amazonaws tions for A New Program (ed. Institute of Medicine). Washington, DC:
.com/migrated/CAPD%20Guidelines%208-2010.pdf_539952af956c National Academies Press.
79.73897613.pdf(last accessed 19 October 2015). 22. Colorado Department of Education (n.d.). Auditory processing disor-
8. Canadian Intreorganizational Steering Group for Speech-language ders: a team approach to screening, assessment & intervention prac-
Pathology and Audiology (2012). The Canadian guidelines on audi- tices. Available at: www.cde.state.co.us (last accessed 19 October
tory processing disorder in children and adults: assessment and 2015).
intervention. Available at: http://www.ooaq.qc.ca/publications/doc 23. American Speech-Language-Hearing Association (1996) Central
-documents/Canadian_Guidelines_EN.pdf (last accessed 19 October auditory processing: current status of research and implications for
2015). clinical practice. American Journal of Audiology, 5, 41–54.
Appendix A
A (fictitious) worked example of calculating the domain score for the Domain: Scope and Purpose.
Item 2: The health ques- Item 3: The population to
Item 1: The overall objec- tions covered by the guide- whom the guideline is
tives of the guideline are line are specifically meant to apply is specifi-
specifically described. described. cally described. Total
Appraiser 1 2 2 6 10
Appraiser 2 2 1 4 7
Total 4 3 10 17