Professional Documents
Culture Documents
E20201433 Full
E20201433 Full
a
Wesfarmers Centre of Vaccines and Infectious Diseases, Telethon Kids Institute, Western Australia, Australia; bSchool of Medicine, University of Western Australia, Western Australia,
Australia; cFaculty of Health Sciences, Curtin University, Western Australia, Australia; dDepartment of General Medicine, The Royal Children’s Hospital, Victoria, Australia; eDepartment of
Pediatrics, University of Melbourne, Victoria, Australia; fVaccine Hesitancy, Murdoch Children’s Research Institute, Victoria, Australia; gSchool of Population Health, University of New South
Wales, New South Wales, Australia; hDepartment of Infectious Diseases, Perth Children’s Hospital, Western Australia, Australia; and iDepartment of Microbiology, PathWest Laboratory
Medicine, Western Australia, Australia
To cite: Norman DA, Barnes R, Pavlos R, et al. Improving Influenza Vaccination in Children With Comorbidities: A Systematic Review. Pediatrics. 2021;147(3):
e20201433
Cohort Studies
Four cohort studies met the review’s
inclusion criteria, with 2
prospective10,22 and 2 retrospective
evaluations (Table 2).28,29 All had
sufficient results to be included
FIGURE 1
Article extraction flowchart. within the quantitative analysis and
pooled effect estimate. Moore and
Parker29 evaluated the use of a postal
quantitative analysis. The reasons for QI studies.48–54 One article included letter for an intervention group
exclusion after full article review are both a quasi-experimental study and versus verbal reminders in the
listed in Fig 1. a cohort study.28 control group. Fiks et al28 compared
use of electronic provider reminders
Of the 35 included articles, 33 RCTs with a provider educational session in
examined seasonal influenza All RCTs were singular type an intervention group versus
vaccination exclusively, 1 evaluated intervention of parental influenza a control group who received the
pandemic H1N1/09 influenza vaccination reminders: researchers in educational session alone. Bay and
vaccination21 and 1 examined both 4 studies used postal letter Crawford10 tested electronic
seasonal and pandemic H1N1/09 reminders23,24,26,27 and those in 1 reminders delivered through an
vaccination.22 There were 5 evaluated mobile phone text message online patient portal system with
RCTs23–27 and 4 cohort reminders (Table 1).25 All studies educational material links, compared
studies.10,22,28,29 The remainder, were conducted within the United with a standard of care in a single
defined as quasi-experimental States between 1992 and 2017. Four cohort. Dombkowski et al22 examined
studies, included 20 before and after were conducted at pediatric clinics, of postal letter reminders for a seasonal
intervention studies21,28,30–47 and 6 which 3 only targeted asthmatic and pandemic influenza A/H1N109
5
vaccine compared with standard of studies had nonsignificant changes significantly different (Supplemental
care. in vaccination coverage38,41,45,46 or Table 6).
reported results in which absolute
All cohort studies were conducted Risk of Bias
coverage changes could not be
within the United States and were
ascertained.42,48,49,51 Substantial heterogeneity was
published after 2005. Collectively, observed across studies, with the
cohort studies revealed low to overall and subgroup analyses all
moderate improvements in influenza Pooled Estimates having I2 scores .75% (Fig 2). 55
vaccination coverage. Coverage Overall, a high level of bias was
From 5 RCTs, 4 cohort studies, and
improvements were significant for all observed, with all but 1 study
18 quasi-experimental studies
interventions except that of Fiks et having a high risk of bias in at least
included within the quantitative
al,28 who used a provider electronic 1 of GRADE’s domains (Table 3).
analyses, 33 separate intervention
reminder revealing only RCTs had a lower average number
results had sufficient data for pool
a nonsignificant increase of 3.4% in of high-risk bias domains per study
effect estimates (Fig 2).
coverage for their intervention group of 1.8 compared with quasi-cohort
Researchers in 2 studies examined
versus their control group. The and experimental studies with
3 different telephone-based
greatest improvement was shown by average scores of 3.25 and 4.03,
parental reminders from different
Bay and Crawford,10 with a 20.8% respectively.
types of clinicians (ie, pediatric
increase in coverage for children
oncologist and public health
whose families reported receiving
physicians) using before and after DISCUSSION
a reminder through reminder
intervention designs in separate
messages and education via an online Interventions of vaccination
populations; these were considered
patient portal. reminders and influenza vaccination
as 6 distinct data sets for
education targeting either parents or
quantitative analysis.32,34
Quasi-Experimental Studies providers as well as clinic process
Dombkowski et al 22 evaluated the
Quasi-experimental studies were the changes were all shown to have
impact of the same reminder
most varied, with researchers effectiveness for improving influenza
system for both seasonal and
examining different interventions for vaccine coverage in children with
pandemic influenza vaccinations
comorbidities. Numerous biases and
both respiratory and nonrespiratory programs in 2009. Fiks et al28
comorbidities (Supplemental Table high heterogeneity were observed
conducted both a before and after
4). Multicomponent interventions across all study types because of
study and a prospective cohort
were only evaluated by using quasi- study designs, vaccination status
study examining the introduction of
experimental studies. QI studies ascertainment methods, and
an electronic health record alert.
outcomes reported. These biases
were only conducted post-2006 and Rao et al52 evaluated separate
in the United States, with 60% limited our capacity to determine if
provider reminder and parental
targeting patients of pediatric significant differences existed
education intervention groups to
oncology clinics with between intervention types, and the
a control group within their QI
multicomponent interventions. high level of heterogeneity reduced
study.
Before and after studies took place confidence in the meta-analysis
across a longer time frame, in The effect estimate following results.
Europe, Australia, and North pooling of interventions’ RCTs revealed how simple
America, and examined both singular quantitative results revealed an vaccination reminders targeting
and multicomponent for a range of average increase in influenza vaccine patients’ parents or guardian could
respiratory and nonrespiratory coverage of 60% (risk ratio: 1.60; moderately improve influenza
comorbidities. Appropriate 95% CI: 1.47–1.74) across 368 574 vaccine coverage. Cohort studies
quantitative results were present in participants. Point estimates varied had similarly low to moderate
18 of the included quasi- between intervention types, improvements for influenza
experimental studies for inclusion in singular-component versus vaccination coverage with parental
the pooled effect estimate. Quasi- multicomponent intervention, and reminders. Conversely, researchers
experimental studies had the study methods; however, the relative in quasi-experimental studies
greatest range of influenza risks of specific intervention types examined a variety of intervention
vaccination coverage impacts, with were not significantly different types and moderate-to-high impact
increases from 3.4%28 to 45.5%53 (Supplemental Table 5). Likewise, on increasing influenza vaccine
postintervention. Additionally, the effect estimates of different coverage for a diversity of patients.
a minority of quasi-experimental study methodologies were not Unsurprisingly, RCTs had a lower
7
concerns of not recommending
influenza vaccination to vulnerable
patients.
The high heterogeneity of studies
made identifying discernible trends
across studies methods and results
through meta-analysis difficult. A
narrative synthesis identified a shift
toward multicomponent
interventions, targeting of children
with nonrespiratory comorbidities,
and greater use of information
technologies (ie, electronic medical
records and e-mail or text message
reminders), particularly with more
recent publications (since 2010). This
was likely due to greater use of
multicomponent interventions across
public health, clinical integration of
information technologies, and
recognition of the severe influenza
infection impacts in children with
nonrespiratory comorbidities.
Using quantitative analysis, we found
an average improvement in coverage
by 60% (RR: 1.60 [95% CI:
1.47–1.75]). The high heterogeneity
of studies and strong risk of bias
limited our confidence in this effect
estimate and further subanalyses of
quantitative results. Furthermore, we
could not establish if any single
intervention type or
a multicomponent intervention
showed greater efficacy. Moreover,
differences in point estimates
between different intervention types
FIGURE 2 should be interpreted with caution
Pooled effect estimates and forest plots. a Dombkowski et al22 evaluated both seasonal and pan-
demic A/H1N109 vaccines for the 2009–2010 northern hemisphere influenza season. b Fiks et al28 given overlapping CIs and biases
conducted both a before and after evaluation and a prospective cohort study within their population observed.
for the 2006–2007 northern hemisphere influenza season. c Cecinati et al32 trialed 3 different
variations of parental reminders in 3 distinct populations of pediatric oncology patients and As reported in a previous systematic
therefore results were treated as 3 different before and after studies. d Esposito et al34 trialed 3 review,11 parental letter-based
different variations of parental reminders in 3 distinct populations of pediatric asthmatic patients reminders improve influenza vaccine
and therefore results were treated as 3 different before and after studies. e Rao et al52 evaluated coverage. We additionally identified
both a provider reminder intervention and parental educational tool in distinct populations; as such,
they were treated as 2 separate data sets. df, degrees of freedom. evidence revealing that provider
reminders, educational interventions,
and clinic process changes can also
average number of high risk of bias for intervention design and improve vaccine coverage. We
domains compared with cohort and evaluation provided by cohort and identified a further 17 articles* not
quasi-experimental studies. Future quasi-experimental designs. captured by the previous review11
intervention designers will need to Moreover, researchers in future and excluded 2 that were previously
balance the low bias risk and intervention evaluations should
rigorous design requirements of an implement standards of control * Refs 10, 21, 22, 24, 25, 30, 31, 33, 36–39, 41, 42, 45,
RCT with the capacity and flexibility groups because of the ethical 51–54.
included (a conference abstract56 and clinical trials and evaluations because of the increased severity of
a systematic review of already assessing the relative benefit of influenza infections in these children
included articles57). In the previous different interventions. and potential negative impacts of
review, authors claimed that meta- unnecessary interventions in
analysis was inappropriate because of This is the first attempt to quantify families with high-care needs.
high heterogeneity between studies. the overall impact on interventions Superiority of multicomponent
Although high heterogeneity was designed to improve influenza interventions compared with single
observed, we believe pooled analyses vaccine coverage for children with interventions has been shown in
are important to identify potential comorbidities. Optimizing similar contexts for improving
effect sizes. These pooled estimates interventions to improve influenza vaccine coverage in high-risk
are required to inform development vaccine use in high-risk pediatric adults58 and human papillomavirus
and design appropriately conducted populations is clinically relevant vaccine use,59 but we were not able
Mr Norman conceived and designed the study, led publication review, data extraction, quantitative analysis, qualitative analysis, and risk of bias assessments, and
wrote the manuscript; Prof Blyth oversaw the design of the study, analyses, and manuscript writing; Dr Barnes contributed to the screening of articles, data
extraction, and analysis; Drs Pavlos, Alene, and Bhuiyan contributed to the evaluation of risk of bias for included studies; Dr Moore, Prof Seale, and Prof Danchin
assisted in designing of the review and drafting of the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all
aspects of the work.
This trial has been registered with the National Institute for Health Research (https://www.crd.york.ac.uk/prospero/) (identifier PROSPERO CRD42019090623).
DOI: https://doi.org/10.1542/peds.2020-1433
Accepted for publication Dec 1, 2020
Address correspondence to Daniel A. Norman, MPH, MInfectDis, Telethon Kids Institute, Perth Children’s Hospital, 15 Hospital Ave, Nedlands, WA 6009, Australia.
E-mail: daniel.norman@telethonkids.org.au
PEDIATRICS (ISSN Numbers: Print, 0031-4005; Online, 1098-4275).
Copyright © 2021 by the American Academy of Pediatrics
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
REFERENCES
1. Ruf BR, Knuf M. The burden of seasonal a retrospective observational cohort random-effects models. In: Cochrane
and pandemic influenza in infants and study. BMJ Open. 2016;6(8):e010625 Handbook for Systematic Reviews of
children. Eur J Pediatr. 2014;173(3): Interventions. Version 5.0. Chichester,
9. Schmid P, Rauber D, Betsch C, Lidolt G,
265–276 UK: Cochrane; 2020
Denker M-L. Barriers of influenza
2. Gill PJ, Ashdown HF, Wang K, et al. vaccination intention and behavior - 19. Higgins JP, Thompson SG. Quantifying
Identification of children at risk of a systematic review of influenza vaccine heterogeneity in a meta-analysis. Stat
influenza-related complications in hesitancy, 2005 - 2016. PLoS One. 2017; Med. 2002;21(11):1539–1558
primary and ambulatory care: 12(1):e0170550
a systematic review and meta-analysis. 20. Atkins D, Best D, Briss PA, et al.; GRADE
10. Bay SL, Crawford DJ. Using technology Working Group. Grading quality of
Lancet Respir Med. 2015;3(2):139–149 to affect influenza vaccine coverage evidence and strength of
3. Australian Technical Advisory Group on among children with chronic recommendations. BMJ. 2004;
Immunisation (ATAGI). The Australian respiratory conditions. J Pediatr Health 328(7454):1490
Immunisation Handbook, 11th ed. Care. 2017;31(2):155–160
Canberra, Australia: Australian 21. Gregori G, Faccini F, Bongiorni E, Maffini
11. Aigbogun NW, Hawker JI, Stewart A. I, Sacchetti R. Immunization against
Government Department of Health; 2018 Interventions to increase influenza A/H1N1 pandemic flu (2009-2010) in
4. Grohskopf LA, Sokolow LZ, Fry AM, vaccination rates in children with high- pediatric patients at risk. What might
Walter EB, Jernigan DB. Update: ACIP risk conditions–a systematic review. be the most effective strategy? The
recommendations for the use of Vaccine. 2015;33(6):759–770 experience of an health district of
quadrivalent live attenuated influenza 12. Moher D, Liberati A, Tetzlaff J, Altman Northern Italy. Ital J Pediatr. 2012;38(1):
vaccine (LAIV4) - United States, 2018-19 DG; PRISMA Group. Preferred Reporting 18
influenza season. MMWR Morb Mortal Items for Systematic Reviews and Meta-
Wkly Rep. 2018;67(22):643–645 22. Dombkowski KJ, Cowan AE, Potter RC,
Analyses: the PRISMA statement. Int J
Dong S, Kolasa M, Clark SJ. Statewide
5. Department of Health; Salisbury D, Surg. 2010;8(5):336–341
pandemic influenza vaccination
Ramsay M, Noakes K, eds. Immunisation 13. Cochrane Collaboration. Data collection reminders for children with chronic
against Infectious Diseases, Influenza: form: Intervention review RCTs and non- conditions. Am J Public Health. 2014;
the Green Book. London, United RCTs. 2014. Available at: https://dplp. 104(1):e39–e44
Kingdom: The Stationery Office; 2013 cochrane.org/data-extraction-forms.
23. Daley MF, Barrow J, Pearson K, et al.
6. Costantino C, Vitale F. Influenza Accessed December 1, 2018
Identification and recall of children
vaccination in high-risk groups: 14. Grol RP, Bosch MC, Hulscher ME, Eccles with chronic medical conditions for
a revision of existing guidelines and MP, Wensing M. Planning and studying influenza vaccination. Pediatrics. 2004;
rationale for an evidence-based improvement in patient care: the use of 113(1, pt 1). Available at: www.
preventive strategy. J Prev Med Hyg. theoretical perspectives. Milbank Q. pediatrics.org/cgi/content/full/113/1/
2016;57(1):E13–E18 2007;85(1):93–138 e26
7. Blyth CC, Macartney KK, McRae J, et al.; 15. Eccles M, Grimshaw J, Campbell M, 24. Dombkowski KJ, Harrington LB, Dong S,
Paediatric Active Enhanced Disease Ramsay C. Research designs for studies Clark SJ. Seasonal influenza vaccination
Surveillance (PAEDS); Influenza evaluating the effectiveness of change reminders for children with high-risk
Complications Alert Network (FluCAN) and improvement strategies. Qual Saf conditions: a registry-based
Collaboration. Influenza epidemiology, Health Care. 2003;12(1):47–52 randomized trial. Am J Prev Med. 2012;
vaccine coverage and vaccine 42(1):71–75
effectiveness in children admitted to 16. Hedges LV, Vevea JL. Fixed-and random-
sentinel Australian hospitals in 2017: effects models in meta-analysis. 25. Hofstetter AM, Barrett A, Camargo S,
results from the PAEDS-FluCAN Psychol Methods. 1998;3(4):486 Rosenthal SL, Stockwell MS. Text
collaboration. Clin Infect Dis. 2019;68(6): 17. Cochrane Collaboration. 9.4.4 Meta- message reminders for vaccination of
940–948 analysis of dichotomous outcomes. In: adolescents with chronic medical
Cochrane Handbook for Systematic conditions: a randomized clinical trial.
8. Rajaram S, Steffey A, Blak B, Hickman
Reviews of Interventions. Version 5.0. Vaccine. 2017;35(35 pt B):4554–4560
M, Christensen H, Caspard H. Uptake of
Chichester, UK: Cochrane; 2020
childhood influenza vaccine from 2012- 26. Kemper KJ, Goldberg H. Do computer-
2013 to 2014-2015 in the UK and the 18. Cochrane Collaboration. 9.5.4 generated reminder letters improve the
implications for high-risk children: Incorporating heterogeneity into rate of influenza immunization in an
Updated Information & including high resolution figures, can be found at:
Services http://pediatrics.aappublications.org/content/147/3/e20201433
References This article cites 51 articles, 7 of which you can access for free at:
http://pediatrics.aappublications.org/content/147/3/e20201433#BIBL
Subspecialty Collections This article, along with others on similar topics, appears in the
following collection(s):
Infectious Disease
http://www.aappublications.org/cgi/collection/infectious_diseases_su
b
Influenza
http://www.aappublications.org/cgi/collection/influenza_sub
Vaccine/Immunization
http://www.aappublications.org/cgi/collection/vaccine:immunization
_sub
Permissions & Licensing Information about reproducing this article in parts (figures, tables) or
in its entirety can be found online at:
http://www.aappublications.org/site/misc/Permissions.xhtml
Reprints Information about ordering reprints can be found online:
http://www.aappublications.org/site/misc/reprints.xhtml
The online version of this article, along with updated information and services, is
located on the World Wide Web at:
http://pediatrics.aappublications.org/content/147/3/e20201433
Pediatrics is the official journal of the American Academy of Pediatrics. A monthly publication, it
has been published continuously since 1948. Pediatrics is owned, published, and trademarked by
the American Academy of Pediatrics, 345 Park Avenue, Itasca, Illinois, 60143. Copyright © 2021
by the American Academy of Pediatrics. All rights reserved. Print ISSN: 1073-0397.