Download as pdf or txt
Download as pdf or txt
You are on page 1of 15

Improving Influenza Vaccination in

Children With Comorbidities: A


Systematic Review
Daniel A. Norman, MPH, MInfectDis,a,b Rosanne Barnes, PhD,a Rebecca Pavlos, PhD,a Mejbah Bhuiyan, PhD,a
Kefyalew Addis Alene, PhD,a,c Margie Danchin, MBBS, PhD,d,e,f Holly Seale, PhD,g Hannah C. Moore, PhD,a
Christopher C. Blyth, MBBS, PhDa,b,h,i

CONTEXT: Children with


medical comorbidities are at greater risk for severe influenza and poorer abstract
clinical outcomes. Despite recommendations and funding, influenza vaccine coverage remains
inadequate in these children.
We aimed to systematically review literature assessing interventions targeting
OBJECTIVE:
influenza vaccine coverage in children with comorbidities and assess the impact on influenza
vaccine coverage.
DATA SOURCES:PubMed, Scopus, Embase, Cumulative Index to Nursing and Allied Health
Literature, Cochrane Central Register of Controlled Trials, Allied and Complementary Medicine
Database, and Web of Science databases were searched.
STUDY SELECTION: Interventions targeting influenza vaccine coverage in children with medical
comorbidities.
Two reviewers independently screened articles, extracting studies’ methods,
DATA EXTRACTION:
interventions, settings, populations, and results. Four reviewers independently assessed risk
of bias.
RESULTS: From 961 screened articles, 35 met inclusion criteria. Published studies revealed that
influenza vaccine coverage was significantly improved through vaccination reminders and
education directed at either patients’ parents or providers, as well as by vaccination-related
clinic process changes. Interventions improved influenza vaccine coverage by an average 60%,
but no significant differences between intervention types were detected. Significant bias and
study heterogeneity were also identified, limiting confidence in this effect estimate.
LIMITATIONS: A
high risk of bias and overall low quality of evidence limited our capacity to assess
intervention types and methods.
CONCLUSIONS: Interventions were shown to consistently improve influenza vaccine coverage;
however, no significant differences in coverage between different intervention types were
observed. Future well-designed studies evaluating the effectiveness of different intervention
are required to inform future optimal interventions.

a
Wesfarmers Centre of Vaccines and Infectious Diseases, Telethon Kids Institute, Western Australia, Australia; bSchool of Medicine, University of Western Australia, Western Australia,
Australia; cFaculty of Health Sciences, Curtin University, Western Australia, Australia; dDepartment of General Medicine, The Royal Children’s Hospital, Victoria, Australia; eDepartment of
Pediatrics, University of Melbourne, Victoria, Australia; fVaccine Hesitancy, Murdoch Children’s Research Institute, Victoria, Australia; gSchool of Population Health, University of New South
Wales, New South Wales, Australia; hDepartment of Infectious Diseases, Perth Children’s Hospital, Western Australia, Australia; and iDepartment of Microbiology, PathWest Laboratory
Medicine, Western Australia, Australia

To cite: Norman DA, Barnes R, Pavlos R, et al. Improving Influenza Vaccination in Children With Comorbidities: A Systematic Review. Pediatrics. 2021;147(3):
e20201433

Downloaded from www.aappublications.org/news by guest on August 11, 2021


PEDIATRICS Volume 147, number 3, March 2021:e20201433 REVIEW ARTICLE
Influenza remains a substantial cause medical comorbidities to evaluate through the National Institutes of
of morbidity and mortality in children the overall effectiveness and Health’s clinicaltrials.gov Web site.
despite the widespread availability of effectiveness of different Two authors (D.A.N. and R.B.) were
seasonal vaccines.1 Children with intervention types. responsible for screening of
medical comorbidities, including extracted articles and identification
asthma, immunodeficiency, and of potentially eligible studies.
METHODS
epilepsy, are at increased risk of
severe influenza infections and more The study was designed with the Study Selection
adverse clinical outcomes.2 As Preferred Reporting Items for Randomized control trials (RCTs),
a result, national immunization Systematic Reviews and Meta- cohort, and quasi-experimental
programs3–5 recommend and fund Analyses (PRISMA) guidelines and studies undertaken in community,
annual influenza vaccination for those checklist12 with registration through primary care, and/or hospital settings
with medical comorbidities.3,6 PROSPERO: The International were reviewed if they (1) included
Despite these efforts, influenza Prospective Register of Systematic children (aged 6 months to 21 years
vaccine coverage in children with Reviews (CRD42019090623). We old) who met medical comorbidity
comorbidities remains inadequate.7,8 conducted a narrative review criteria as per national immunization
The reasons for noncompliance with describing studies’ characteristics, guidelines3–5 and (2) evaluated at
recommendations are complex and results, and biases. Where possible, least 1 clinical, behavioral, or
multifactorial,9 yet interventions absolute results of influenza vaccine structural intervention designed to
targeting improvement in influenza coverage were extracted to determine improve influenza vaccine coverage in
coverage in children with medical pooled effect estimates for each children with 1 or more
comorbidities have been shown to be intervention type and study method. comorbidities. Exclusion criteria of
efficacious.10 studies included non–peer reviewed
Search Strategy and Data Sources results, studies from which changes
A previous review of interventions
PubMed, Scopus, Embase, in influenza vaccination could not be
targeting influenza vaccine coverage
Cumulative Index to Nursing and extracted or separated from non-
in children aged 6 months to 19 years
Allied Health Literature, Cochrane influenza vaccination, studies with
with comorbidities, published in
Central Register of Controlled Trials, influenza vaccination results of
2015, concluded that there was
Allied and Complementary Medicine, children with comorbidities which
strong evidence for parental letter-
and Web of Science databases were could not be separated from other
based vaccination appointment
searched for articles published in populations, and other systematic
reminders.11 Pooled estimates of the
English from January 1976 to March reviews of eligible studies
overall and relative impact of
2019. The search strategy was (Supplemental Information). Raw
interventions were not assessed and
"Influenza vaccination or influenza numbers were extracted, where
the numerous biases of the included
immunization or influenza possible. When required, the number
studies were not formally reported.
immunisation) and (reminder or of vaccinated patients were calculated
The review was also limited by the
interventions or best practices or from percentages included in study
search strategy restricted to
strategies) and (children or pediatric reports.
“influenza AND vaccination OR
or paediatric) and (high-risk or
immunization OR children AND Data Extraction
asthma or neurological or
asthma OR malignancy OR high risk
malignancy or cardiac or A data form based on Cochrane’s
AND reminder,” potentially missing
hematological or oncology or “Data Collection Form: Intervention
nonreminder type interventions and
comorbidity or chronic diseases or Review – RCTs and Non-RCTS”13 was
other comorbidities.
medical conditions." This strategy used to ensure standardized
To design and evaluate effective and was designed with free-text search extraction of articles. Data were
sustainable interventions to improve terms encompassing influenza extracted by a primary author
influenza vaccine coverage in vaccination and comorbidities (D.A.N.) and independently confirmed
children with comorbidities requires defined by the Australian,3 US,4 and by supplementary authors (R.P., M.B.,
an understanding of the overall and UK5 national guidelines with and K.A.A.). When discrepancies were
relative effectiveness of these appropriate terms for intervention identified, results were resolved by
interventions and any associated types and methods. Hand searching the senior author (C.C.B.). The
biases. To this end, we conducted of retrieved articles’ bibliographies extraction form included publishing
a systematic review of published was undertaken to identify any journal, study methodology,
interventions targeting influenza additionally relevant publications. intervention type, clinical setting,
vaccine coverage in children with Ongoing trials were searched geographical location, participant

Downloaded from www.aappublications.org/news by guest on August 11, 2021


2 NORMAN et al
comorbidity type(s), participant age education (information for clinicians pooling of vaccination coverage
group, study years, and vaccination about influenza infection risks and changes. Random effect models were
status ascertainment method (ie, vaccination benefits), and (5) clinic used because of the high level of
parental report, clinic vaccination process changes. Clinic process methodologic and clinical diversity
records, and immunization registry changes were defined as between studies and the assumption
records). Absolute vaccination interventions that impacted how of different effects across studies.18
numbers, rates, and relevant patients received influenza Heterogeneity of quantitative results
statistical testing results (ie, P value vaccinations in a clinical was evaluated by using the
and risk ratios) were extracted from environment, the flow of vaccination standardized t 2 and I2 statistics
applicable studies. Studies were resources, vaccination status describing the proportion of
grouped by methodology: (1) RCT recording, and/or reporting within dispersion across studies due to true
(clustered or individually the study’s setting(s). Such heterogeneity.19
randomized), (2) cohort studies interventions included introduction
(prospective and retrospective), or of electronic vaccination records, Risk of Bias Analysis
(3) a quasi-experimental study type interclinic collaboration, and resource Individual studies’ risk of bias was
including quality improvement (QI)14 sharing. Studies in which researchers assessed with Cochrane’s Grading of
or before and after studies.15 QI examined multiple interventions Recommendations Assessment,
studies were classified as such if the trialed in the same group(s) were Development and Evaluation
study’s authors identified them as QI identified as a multicomponent (GRADE) tool.20 One primary
and were approved by a relevant intervention, whereas those using the reviewer (D.A.N.) examined risk of
ethics group or review board as a QI same intervention in single or bias in all studies, and 3 secondary
study. Before and after studies were multiple study groups were defined reviewers (R.P., K.A.A., and M.B.)
defined by their observations of the as single interventions. independently reviewed an equal
study population’s influenza vaccine proportion of the studies. A senior
coverage taken before an Quantitative Data Analysis
reviewer (C.C.B.) acted to resolve any
intervention(s)’ introduction and Quantitative changes in influenza discordant assessments between the
after introduction without identifying vaccination coverage either between primary and the secondary reviewers.
as a QI study. Final observations of allocated intervention and control Studies were assigned to be low risk
vaccine coverage in before and after groups (ie, RCTs) or across influenza if all domains were identified as low
studies were used as the seasons (ie, quasi-experimental and risk, unclear risk if 1 or more
postintervention vaccine coverage cohort studies) were extracted when domains were of unclear risk (with
values for quantitative analysis. applicable. Where applicable, no high-risk scored domains), and
Before and after studies did not use absolute and relative changes in high risk if at least 1 domain was
negative control groups but may have vaccine coverage were directly identified as high risk.
randomly assigned individuals to extracted from publication or back
different interventions. calculated when necessary.
Subanalyses were performed to RESULTS
Qualitative Data Analysis assess different interventions types,
Study characteristics and individual study designs, and single versus Study Search and Selection
results as well as trends across multicomponent interventions. Our initial search identified 961
studies were assessed. There were 5 Studies in which researchers primary articles, with 6 additional
intervention categories: (1) parental evaluated the same intervention(s) in articles identified by searching
reminders (physical or electronic different populations or different references. No ongoing trials or
reminders directed to parents or interventions within same intervention studies meeting our
guardians about their child(s)’ populations across different time inclusion criteria were identified
vaccination status and eligibility), (2) points were treated as separate data through the National Institutes of
parental education (information for sets. Changes in influenza vaccine Health clinicaltrials.gov Web site.
parents about influenza infection coverage in an intervention group(s) Once duplicates were removed, 611
risks and vaccination benefits compared with a control group or unique articles remained. Title and
through counseling by a provider or before and after introduction of an abstract review excluded a further
written material), (3) provider intervention were estimated by using 442 and 108 articles, respectively.
reminders (physical or electronic risk ratios with 95% confidence From the 61 articles remaining for
reminders directed to clinicians intervals (CIs). Random effect full-text review, 35 articles met our
managing children with medical models16 using the Mantel-Haenszel inclusion criteria. Sufficient data were
comorbidities), (4) provider method (M-H)17 were used for present in 26 of these articles for

Downloaded from www.aappublications.org/news by guest on August 11, 2021


PEDIATRICS Volume 147, number 3, March 2021 3
patients,23,26,27 and the fourth
included patients with a range of
comorbidity types.25 Dombkowski et
al24 targeted children with different
comorbidity types with reminders
through a statewide immunization
registry. Changes in vaccination
coverage were recorded sufficiently
for each RCT to be included within
the quantitative analysis. All postal
letter interventions revealed
significant improvements in influenza
vaccine coverage for those receiving
reminders compared with their
respective control groups. Statistically
significant low to moderate absolute
increases in influenza vaccine
coverage of 6.5%, 18%, 23%, and
25% were present for their respective
intervention groups of Dombkowski
et al,24 Daley et al,23 Szilagyi et al,27
and Kemper et al26 compared with
their control groups. Conversely, the
intervention group in Hofstetter et
al25 had a lower but not statistically
significant absolute coverage decline
of 7% compared with their control
group.

Cohort Studies
Four cohort studies met the review’s
inclusion criteria, with 2
prospective10,22 and 2 retrospective
evaluations (Table 2).28,29 All had
sufficient results to be included
FIGURE 1
Article extraction flowchart. within the quantitative analysis and
pooled effect estimate. Moore and
Parker29 evaluated the use of a postal
quantitative analysis. The reasons for QI studies.48–54 One article included letter for an intervention group
exclusion after full article review are both a quasi-experimental study and versus verbal reminders in the
listed in Fig 1. a cohort study.28 control group. Fiks et al28 compared
use of electronic provider reminders
Of the 35 included articles, 33 RCTs with a provider educational session in
examined seasonal influenza All RCTs were singular type an intervention group versus
vaccination exclusively, 1 evaluated intervention of parental influenza a control group who received the
pandemic H1N1/09 influenza vaccination reminders: researchers in educational session alone. Bay and
vaccination21 and 1 examined both 4 studies used postal letter Crawford10 tested electronic
seasonal and pandemic H1N1/09 reminders23,24,26,27 and those in 1 reminders delivered through an
vaccination.22 There were 5 evaluated mobile phone text message online patient portal system with
RCTs23–27 and 4 cohort reminders (Table 1).25 All studies educational material links, compared
studies.10,22,28,29 The remainder, were conducted within the United with a standard of care in a single
defined as quasi-experimental States between 1992 and 2017. Four cohort. Dombkowski et al22 examined
studies, included 20 before and after were conducted at pediatric clinics, of postal letter reminders for a seasonal
intervention studies21,28,30–47 and 6 which 3 only targeted asthmatic and pandemic influenza A/H1N109

Downloaded from www.aappublications.org/news by guest on August 11, 2021


4 NORMAN et al
TABLE 1 Characteristics and Results of RCTs
Authors and Setting, Country, and Study Participants Participant Study Vaccination Status Intervention Absolute Effect Size Relative Effect Sizes Study Summary
Publication Study Years (Population) Ages Methodology Ascertainment Type (% of Vaccine (% of Vaccine
Year (Subtype) Coverage) Coverage)
Daley et al23 Pediatric practices, Pediatric asthmatic Not specified Individualized Immunization Parent Absolute influenza Intervention group: Mailed letter influenza
(2004) United States patients: RCT registry records reminder vaccine coverage 42%; control group: vaccination reminders
(2002–2003) intervention group: n and patient increased by 17% 25% to patients’ families
= 920; control group: billing record significantly improved
n = 931 influenza vaccine
uptake in asthmatic
children
Dombkowski et Michigan Children with 2–5 y Individualized Immunization Parent Absolute influenza Intervention group: Children with
al24 (2012) immunization comorbidities (ACIP RCT registry records reminder vaccine coverage 30.8%; control comorbidities were

PEDIATRICS Volume 147, number 3, March 2021


registry, United guidelinesa): n = (ICD-9 codes) increased by 6.5% group: 24.3%; odds 1.39 times more likely
States 3618 ratio of 1.39 (95% to receive an influenza
(2008–2009) CI: 1.13–1.72) vaccine if they
received a mailed
vaccination letter
reminder compared
with those who did not
Hofstetter et Pediatric clinics, Pediatric patients with 11–17 y Individualized Electronic Parent Absolute difference Educational text Nonsignificantly lower
al25 (2017) United States comorbidities (ACIP RCT vaccination reminder in vaccine message group: influenza vaccination
(2014–2015) guidelinesa): records coverage of 7% 56.8%; plain text coverage was seen in
education reminder: between reminder message group: children assigned an
n = 154, plain groups 63.8% (P = .24) education-embedded
reminder: n = 141 vaccination reminder
compared with a plain
reminder
Kemper et al26 Pediatric clinic, Pediatric asthmatic Average of 4.5 Individualized Clinic vaccination Parent Absolute vaccination Intervention group: Pediatric asthmatic
(1993) United States patients: y (no range RCT records reminder coverage was 25% 46%; control group: patients who received
(1991) intervention group: n given) greater in the 21% mailed letter influenza
= 43; control group: intervention group vaccination reminders
n = 53 were significantly
more likely to receive
the seasonal influenza
vaccination

Downloaded from www.aappublications.org/news by guest on August 11, 2021


Szilagyi et al27 Pediatric clinic, Pediatric asthmatic 1–18 y Individualized Clinic vaccination Parent Absolute increase in Intervention group: Mailed influenza
(1992) United States patients: RCT records reminder influenza vaccine 30%; control group: vaccination reminder
(1990–1991) intervention group: n uptake of 23% 7% letters to families
= 63; control group: considerably improved
n = 53 influenza vaccine
uptake
ACIP, Advisory Committee on Immunization Practices; ICD-9, The International Classification of Diseases, Ninth Revision codes for disease diagnoses.
a ACIP guidelines: guidelines on comorbidities that increase individuals’ risks from influenza infection and recommendations for seasonal influenza vaccination.

5
vaccine compared with standard of studies had nonsignificant changes significantly different (Supplemental
care. in vaccination coverage38,41,45,46 or Table 6).
reported results in which absolute
All cohort studies were conducted Risk of Bias
coverage changes could not be
within the United States and were
ascertained.42,48,49,51 Substantial heterogeneity was
published after 2005. Collectively, observed across studies, with the
cohort studies revealed low to overall and subgroup analyses all
moderate improvements in influenza Pooled Estimates having I2 scores .75% (Fig 2). 55
vaccination coverage. Coverage Overall, a high level of bias was
From 5 RCTs, 4 cohort studies, and
improvements were significant for all observed, with all but 1 study
18 quasi-experimental studies
interventions except that of Fiks et having a high risk of bias in at least
included within the quantitative
al,28 who used a provider electronic 1 of GRADE’s domains (Table 3).
analyses, 33 separate intervention
reminder revealing only RCTs had a lower average number
results had sufficient data for pool
a nonsignificant increase of 3.4% in of high-risk bias domains per study
effect estimates (Fig 2).
coverage for their intervention group of 1.8 compared with quasi-cohort
Researchers in 2 studies examined
versus their control group. The and experimental studies with
3 different telephone-based
greatest improvement was shown by average scores of 3.25 and 4.03,
parental reminders from different
Bay and Crawford,10 with a 20.8% respectively.
types of clinicians (ie, pediatric
increase in coverage for children
oncologist and public health
whose families reported receiving
physicians) using before and after DISCUSSION
a reminder through reminder
intervention designs in separate
messages and education via an online Interventions of vaccination
populations; these were considered
patient portal. reminders and influenza vaccination
as 6 distinct data sets for
education targeting either parents or
quantitative analysis.32,34
Quasi-Experimental Studies providers as well as clinic process
Dombkowski et al 22 evaluated the
Quasi-experimental studies were the changes were all shown to have
impact of the same reminder
most varied, with researchers effectiveness for improving influenza
system for both seasonal and
examining different interventions for vaccine coverage in children with
pandemic influenza vaccinations
comorbidities. Numerous biases and
both respiratory and nonrespiratory programs in 2009. Fiks et al28
comorbidities (Supplemental Table high heterogeneity were observed
conducted both a before and after
4). Multicomponent interventions across all study types because of
study and a prospective cohort
were only evaluated by using quasi- study designs, vaccination status
study examining the introduction of
experimental studies. QI studies ascertainment methods, and
an electronic health record alert.
outcomes reported. These biases
were only conducted post-2006 and Rao et al52 evaluated separate
in the United States, with 60% limited our capacity to determine if
provider reminder and parental
targeting patients of pediatric significant differences existed
education intervention groups to
oncology clinics with between intervention types, and the
a control group within their QI
multicomponent interventions. high level of heterogeneity reduced
study.
Before and after studies took place confidence in the meta-analysis
across a longer time frame, in The effect estimate following results.
Europe, Australia, and North pooling of interventions’ RCTs revealed how simple
America, and examined both singular quantitative results revealed an vaccination reminders targeting
and multicomponent for a range of average increase in influenza vaccine patients’ parents or guardian could
respiratory and nonrespiratory coverage of 60% (risk ratio: 1.60; moderately improve influenza
comorbidities. Appropriate 95% CI: 1.47–1.74) across 368 574 vaccine coverage. Cohort studies
quantitative results were present in participants. Point estimates varied had similarly low to moderate
18 of the included quasi- between intervention types, improvements for influenza
experimental studies for inclusion in singular-component versus vaccination coverage with parental
the pooled effect estimate. Quasi- multicomponent intervention, and reminders. Conversely, researchers
experimental studies had the study methods; however, the relative in quasi-experimental studies
greatest range of influenza risks of specific intervention types examined a variety of intervention
vaccination coverage impacts, with were not significantly different types and moderate-to-high impact
increases from 3.4%28 to 45.5%53 (Supplemental Table 5). Likewise, on increasing influenza vaccine
postintervention. Additionally, the effect estimates of different coverage for a diversity of patients.
a minority of quasi-experimental study methodologies were not Unsurprisingly, RCTs had a lower

Downloaded from www.aappublications.org/news by guest on August 11, 2021


6 NORMAN et al
TABLE 2 Characteristics and Results of Cohort Studies
Authors and Setting, Country, and Study Participants Participant Study Vaccination Status Intervention Absolute Effect Size Relative Effect Sizes (% Study Summary
Publication Study Years (Population) Ages Methodology Ascertainment Type (Vaccine Coverage %) of Vaccine Coverage)
Year
Bay and Pediatric respiratory Pediatric respiratory Not Retrospective Parental reporting Parent Absolute influenza Intervention: 70.8%; no Families of pediatric
Crawford10 clinic, United disease patients: n = specified cohort study reminder vaccination intervention: 50% respiratory clinic
(2017) States (2015) 107 increased by 20.8% patients who
reported receiving
influenza vaccination
reminders had
significantly higher
influenza vaccine
uptake

PEDIATRICS Volume 147, number 3, March 2021


Dombkowski et Michigan Children with 0.5–18 y Retrospective Immunization Parent Pandemic H1N1 Pandemic H1N1 Children with
al22 (2014) immunization comorbidities (ACIP cohort study registry records reminder vaccine: coverage vaccine: intervention comorbidities were
registry, United guidelinesa): n = (ICD-9 codesb) increase of 2.2%; group: 6.5%, control more likely to receive
States 142 383 seasonal influenza group: 4.3%. both pandemic and
(2009–2010) vaccine: coverage Seasonal influenza seasonal influenza
increase of 2.1% vaccine: intervention vaccines if they
group: 4.8%, control received a mailed
group: 2.7% vaccination letter
compared with those
who did not
Fiks et al28 Pediatric outpatient Pediatric asthmatic 5–18 y Prospective Electronic Provider Absolute improve Intervention group: Electronic medical
(2009) clinics, United patients: intervention cohort studyc vaccination reminder vaccination between before: 45.7%, after: record vaccination
States group baseline year: records coverage difference 51.0%; control reminder prompts
(2006–2007) n = 5329; intervention between group: before: for physicians had
group study year: n = intervention and 46.0%, after: 47.9% minimal impact on
6110; control group control groups of influenza vaccine
baseline year: n = 3.4% uptake
5338; control group
study year: n = 5809
Moore and Pediatric clinics, Pediatric asthmatic 0.5–18 y Prospective Electronic Parent Absolute influenza Letters reminders Influenza vaccination
Parker29 United States patients: letters cohort study vaccination reminder vaccination group: 57.9%, verbal reminders for
(2006) (2004–2005) reminders group: n = records coverage difference reminders group: asthmatic pediatric
114; verbal in intervention 43.8% patients by mailed

Downloaded from www.aappublications.org/news by guest on August 11, 2021


reminders group: n = group = 14.1% letter showed
820 superiority over
verbal reminders by
providers for
influenza vaccine
uptake
ACIP, Advisory Committee on Immunization Practices; ICD-9, International Classification of Diseases, Ninth Revision.
a ACIP guidelines: guidelines on comorbidities that increase individuals’ risks from influenza infection and recommendations for seasonal influenza vaccination.
b ICD-9 codes: International Classification of Diseases, Ninth Revision.
c Fiks et al28 conducted both a before and after evaluation and a prospective cohort study within their population for the 2006–2007 northern hemisphere influenza season.

7
concerns of not recommending
influenza vaccination to vulnerable
patients.
The high heterogeneity of studies
made identifying discernible trends
across studies methods and results
through meta-analysis difficult. A
narrative synthesis identified a shift
toward multicomponent
interventions, targeting of children
with nonrespiratory comorbidities,
and greater use of information
technologies (ie, electronic medical
records and e-mail or text message
reminders), particularly with more
recent publications (since 2010). This
was likely due to greater use of
multicomponent interventions across
public health, clinical integration of
information technologies, and
recognition of the severe influenza
infection impacts in children with
nonrespiratory comorbidities.
Using quantitative analysis, we found
an average improvement in coverage
by 60% (RR: 1.60 [95% CI:
1.47–1.75]). The high heterogeneity
of studies and strong risk of bias
limited our confidence in this effect
estimate and further subanalyses of
quantitative results. Furthermore, we
could not establish if any single
intervention type or
a multicomponent intervention
showed greater efficacy. Moreover,
differences in point estimates
between different intervention types
FIGURE 2 should be interpreted with caution
Pooled effect estimates and forest plots. a Dombkowski et al22 evaluated both seasonal and pan-
demic A/H1N109 vaccines for the 2009–2010 northern hemisphere influenza season. b Fiks et al28 given overlapping CIs and biases
conducted both a before and after evaluation and a prospective cohort study within their population observed.
for the 2006–2007 northern hemisphere influenza season. c Cecinati et al32 trialed 3 different
variations of parental reminders in 3 distinct populations of pediatric oncology patients and As reported in a previous systematic
therefore results were treated as 3 different before and after studies. d Esposito et al34 trialed 3 review,11 parental letter-based
different variations of parental reminders in 3 distinct populations of pediatric asthmatic patients reminders improve influenza vaccine
and therefore results were treated as 3 different before and after studies. e Rao et al52 evaluated coverage. We additionally identified
both a provider reminder intervention and parental educational tool in distinct populations; as such,
they were treated as 2 separate data sets. df, degrees of freedom. evidence revealing that provider
reminders, educational interventions,
and clinic process changes can also
average number of high risk of bias for intervention design and improve vaccine coverage. We
domains compared with cohort and evaluation provided by cohort and identified a further 17 articles* not
quasi-experimental studies. Future quasi-experimental designs. captured by the previous review11
intervention designers will need to Moreover, researchers in future and excluded 2 that were previously
balance the low bias risk and intervention evaluations should
rigorous design requirements of an implement standards of control * Refs 10, 21, 22, 24, 25, 30, 31, 33, 36–39, 41, 42, 45,
RCT with the capacity and flexibility groups because of the ethical 51–54.

Downloaded from www.aappublications.org/news by guest on August 11, 2021


8 NORMAN et al
TABLE 3 GRADE Risk of Bias Domain Scores
Study and Year GRADE Risk of Bias Quality Assessment
Random Sequence Allocation Blinding of Blinding of Incomplete Outcome Selective
Generation Concealment Participants Outcome Data Reporting
and Personnel Assessment
Bay and Crawford10 2 2 2 2 2 2
(2016)
Bjornson et al30 (2000) 2 2 2 2 2 2
Britto et al48 (2006) 2 2 2 2 2 2
Britto et al49 (2007) 2 2 2 2 2 2
Camurdan et al31 2 2 2 2 2 2
(2012)
Cecinati et al32 (2010) 1 1 ? 2 1 2
Crawford et al33 (2014) 2 2 2 2 1 1
Daley et al23 (2004) 1 1 2 2 1 1
Dombkowski et al24 1 1 2 2 2 1
(2012)
Dombkowski et al22 2 2 2 2 1 1
(2014)
Esposito et al34 (2009) 1 ? 2 2 2 ?
Fiks et al28 (2009) ? ? 2 1 ? ?
Freedman et al50 (2014) 2 2 2 1 ? ?
Gaglani et al35 (2001) 2 2 2 1 ? ?
Gattis et al36 (2018) 2 2 2 1 ? ?
Gregori et al21 (2012) 2 2 2 2 2 ?
Hofstetter et al25 (2017) 1 1 ? 1 2 ?
Huth et al37 (2015) 2 2 2 ? 2 ?
Kempe et al38 (2014) 1 ? 2 2 1 1
Kemper et al26 (1993) 1 1 2 1 2 2
Lin et al39 (2015) 2 2 2 2 1 1
Martin40 (2008) 2 2 2 2 1 1
McCreary41 (2013) 2 2 2 1 1 1
Merckx et al42 (2016) 2 2 2 2 1 2
Moore and Parker29 2 2 2 1 1 1
(2006)
Olshefski et al51 (2018) 2 2 ? 2 2 1
Patwardhan et al43 2 2 2 ? 1 ?
(2011)
Paul et al44 (2006) 2 2 2 1 1 1
Rao et al52 (2018) 2 2 2 2 1 1
Sobota et al53 (2015) 2 2 2 2 1 1
Szilagyi et al27 (1992) 1 1 1 ? ? 1
Urkin et al45 (2016) 2 2 2 ? 2 2
Walter et al46 (1997) 2 2 ? ? ? ?
Wong et al54 (2017) 2 2 2 2 1 ?
Zimmerman et al47 2 2 2 1 1 2
(2006)
The score of each risk of bias domain for the listed studies by their respective symbol, with low risk (plus sign), unclear risk (question mark), or high risk (dash).

included (a conference abstract56 and clinical trials and evaluations because of the increased severity of
a systematic review of already assessing the relative benefit of influenza infections in these children
included articles57). In the previous different interventions. and potential negative impacts of
review, authors claimed that meta- unnecessary interventions in
analysis was inappropriate because of This is the first attempt to quantify families with high-care needs.
high heterogeneity between studies. the overall impact on interventions Superiority of multicomponent
Although high heterogeneity was designed to improve influenza interventions compared with single
observed, we believe pooled analyses vaccine coverage for children with interventions has been shown in
are important to identify potential comorbidities. Optimizing similar contexts for improving
effect sizes. These pooled estimates interventions to improve influenza vaccine coverage in high-risk
are required to inform development vaccine use in high-risk pediatric adults58 and human papillomavirus
and design appropriately conducted populations is clinically relevant vaccine use,59 but we were not able

Downloaded from www.aappublications.org/news by guest on August 11, 2021


PEDIATRICS Volume 147, number 3, March 2021 9
to demonstrate superiority in this particularly the quasi-experimental ACKNOWLEDGMENTS
context. studies. This project constitutes part of
Further evaluation of interventions’ Daniel Norman’s doctor of
costs, feasibility, and acceptance by philosophy candidature and, as
clinical staff, patients, and families are CONCLUSIONS such, was not directly sponsored or
necessary for future optimal Interventions targeting influenza funded. Mr Norman’s PhD is funded
intervention design. Use of negative vaccination in children with medical by the Commonwealth of Australian’
control groups within such studies, comorbidities through vaccination research training program PhD
particularly populations at high risk reminders, education targeting scholarship and the Wesfarmers
of influenza, needs careful parents or providers, and clinical Centre for Vaccines and Infectious
consideration. Assessing pre- process changes improved coverage. Diseases PhD top-up scholarship.
established “standard of care models” No intervention type was clearly Prof Blyth is supported by
concurrently with additional superior. Multicomponent a fellowship from the National
interventions enables researchers to interventions have been used for Health and Medical Research
assess impacts, maintain high children with respiratory and Council of Australia. Dr Moore is
methodology quality and ensure nonrespiratory comorbidities, supported by a Telethon Kids
appropriate patient care. whereas single component Institute Emerging Research Leader
Our results were primarily limited by interventions have been used Fellowship. Prof Danchin is
predominately to target children Melbourne University’s David
the quality of studies available for
with respiratory comorbidities. Bickart Clinician Scientist
analysis. The relatively high number
However, superiority of single or fellowship recipient.
of quasi-experimental studies
published compared with RCTs and multicomponent interventions for
well-constructed cohort studies is improving influenza vaccination was
reflective of their convenience, not established. High level of ABBREVIATIONS
relatively low cost, and ease of methodologic bias, poor quality of CI: confidence interval
implementation within diverse evidence, and small study size limit GRADE: Grading of Recommenda-
populations and settings. The ability conclusions that can be drawn from tions Assessment, Devel-
to disaggregate and assess the the literature. Future design and opment and Evaluation
relative impact of multicomponent evaluation of interventions to M-H: Mantel-Haenszel method
interventions remains challenging improve influenza vaccine coverage PRISMA: Preferred Reporting
given the diversity of interventions should directly compare Items for Systematic
and study design. Use of the GRADE intervention types using rigorous Reviews and Meta-
risk of bias evaluation tool was study methodologies to optimize Analyses
chosen a priori.20 We were limited in effectiveness and reduce the QI: quality improvement
our capacity to compare the relative influenza disease burden in children RCT: randomized control trial
quality of less rigorous study designs, with medical comorbidities.

Mr Norman conceived and designed the study, led publication review, data extraction, quantitative analysis, qualitative analysis, and risk of bias assessments, and
wrote the manuscript; Prof Blyth oversaw the design of the study, analyses, and manuscript writing; Dr Barnes contributed to the screening of articles, data
extraction, and analysis; Drs Pavlos, Alene, and Bhuiyan contributed to the evaluation of risk of bias for included studies; Dr Moore, Prof Seale, and Prof Danchin
assisted in designing of the review and drafting of the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all
aspects of the work.
This trial has been registered with the National Institute for Health Research (https://www.crd.york.ac.uk/prospero/) (identifier PROSPERO CRD42019090623).
DOI: https://doi.org/10.1542/peds.2020-1433
Accepted for publication Dec 1, 2020
Address correspondence to Daniel A. Norman, MPH, MInfectDis, Telethon Kids Institute, Perth Children’s Hospital, 15 Hospital Ave, Nedlands, WA 6009, Australia.
E-mail: daniel.norman@telethonkids.org.au
PEDIATRICS (ISSN Numbers: Print, 0031-4005; Online, 1098-4275).
Copyright © 2021 by the American Academy of Pediatrics
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

Downloaded from www.aappublications.org/news by guest on August 11, 2021


10 NORMAN et al
FUNDING: No external funding was secured for this study. Prof Blyth is supported by a fellowship from the National Health and Medical Research Council of
Australia. Dr Moore is supported by a Telethon Kids Institute Emerging Research Leader Fellowship. The other authors received no additional funding.
POTENTIAL CONFLICT OF INTEREST: Prof Seale has previously received funding from vaccine manufactures for investigator driven research and for presenting at
workshops. This funding was not associated with this research; the other authors have indicated they have no potential conflicts of interest to disclose.

REFERENCES
1. Ruf BR, Knuf M. The burden of seasonal a retrospective observational cohort random-effects models. In: Cochrane
and pandemic influenza in infants and study. BMJ Open. 2016;6(8):e010625 Handbook for Systematic Reviews of
children. Eur J Pediatr. 2014;173(3): Interventions. Version 5.0. Chichester,
9. Schmid P, Rauber D, Betsch C, Lidolt G,
265–276 UK: Cochrane; 2020
Denker M-L. Barriers of influenza
2. Gill PJ, Ashdown HF, Wang K, et al. vaccination intention and behavior - 19. Higgins JP, Thompson SG. Quantifying
Identification of children at risk of a systematic review of influenza vaccine heterogeneity in a meta-analysis. Stat
influenza-related complications in hesitancy, 2005 - 2016. PLoS One. 2017; Med. 2002;21(11):1539–1558
primary and ambulatory care: 12(1):e0170550
a systematic review and meta-analysis. 20. Atkins D, Best D, Briss PA, et al.; GRADE
10. Bay SL, Crawford DJ. Using technology Working Group. Grading quality of
Lancet Respir Med. 2015;3(2):139–149 to affect influenza vaccine coverage evidence and strength of
3. Australian Technical Advisory Group on among children with chronic recommendations. BMJ. 2004;
Immunisation (ATAGI). The Australian respiratory conditions. J Pediatr Health 328(7454):1490
Immunisation Handbook, 11th ed. Care. 2017;31(2):155–160
Canberra, Australia: Australian 21. Gregori G, Faccini F, Bongiorni E, Maffini
11. Aigbogun NW, Hawker JI, Stewart A. I, Sacchetti R. Immunization against
Government Department of Health; 2018 Interventions to increase influenza A/H1N1 pandemic flu (2009-2010) in
4. Grohskopf LA, Sokolow LZ, Fry AM, vaccination rates in children with high- pediatric patients at risk. What might
Walter EB, Jernigan DB. Update: ACIP risk conditions–a systematic review. be the most effective strategy? The
recommendations for the use of Vaccine. 2015;33(6):759–770 experience of an health district of
quadrivalent live attenuated influenza 12. Moher D, Liberati A, Tetzlaff J, Altman Northern Italy. Ital J Pediatr. 2012;38(1):
vaccine (LAIV4) - United States, 2018-19 DG; PRISMA Group. Preferred Reporting 18
influenza season. MMWR Morb Mortal Items for Systematic Reviews and Meta-
Wkly Rep. 2018;67(22):643–645 22. Dombkowski KJ, Cowan AE, Potter RC,
Analyses: the PRISMA statement. Int J
Dong S, Kolasa M, Clark SJ. Statewide
5. Department of Health; Salisbury D, Surg. 2010;8(5):336–341
pandemic influenza vaccination
Ramsay M, Noakes K, eds. Immunisation 13. Cochrane Collaboration. Data collection reminders for children with chronic
against Infectious Diseases, Influenza: form: Intervention review RCTs and non- conditions. Am J Public Health. 2014;
the Green Book. London, United RCTs. 2014. Available at: https://dplp. 104(1):e39–e44
Kingdom: The Stationery Office; 2013 cochrane.org/data-extraction-forms.
23. Daley MF, Barrow J, Pearson K, et al.
6. Costantino C, Vitale F. Influenza Accessed December 1, 2018
Identification and recall of children
vaccination in high-risk groups: 14. Grol RP, Bosch MC, Hulscher ME, Eccles with chronic medical conditions for
a revision of existing guidelines and MP, Wensing M. Planning and studying influenza vaccination. Pediatrics. 2004;
rationale for an evidence-based improvement in patient care: the use of 113(1, pt 1). Available at: www.
preventive strategy. J Prev Med Hyg. theoretical perspectives. Milbank Q. pediatrics.org/cgi/content/full/113/1/
2016;57(1):E13–E18 2007;85(1):93–138 e26
7. Blyth CC, Macartney KK, McRae J, et al.; 15. Eccles M, Grimshaw J, Campbell M, 24. Dombkowski KJ, Harrington LB, Dong S,
Paediatric Active Enhanced Disease Ramsay C. Research designs for studies Clark SJ. Seasonal influenza vaccination
Surveillance (PAEDS); Influenza evaluating the effectiveness of change reminders for children with high-risk
Complications Alert Network (FluCAN) and improvement strategies. Qual Saf conditions: a registry-based
Collaboration. Influenza epidemiology, Health Care. 2003;12(1):47–52 randomized trial. Am J Prev Med. 2012;
vaccine coverage and vaccine 42(1):71–75
effectiveness in children admitted to 16. Hedges LV, Vevea JL. Fixed-and random-
sentinel Australian hospitals in 2017: effects models in meta-analysis. 25. Hofstetter AM, Barrett A, Camargo S,
results from the PAEDS-FluCAN Psychol Methods. 1998;3(4):486 Rosenthal SL, Stockwell MS. Text
collaboration. Clin Infect Dis. 2019;68(6): 17. Cochrane Collaboration. 9.4.4 Meta- message reminders for vaccination of
940–948 analysis of dichotomous outcomes. In: adolescents with chronic medical
Cochrane Handbook for Systematic conditions: a randomized clinical trial.
8. Rajaram S, Steffey A, Blak B, Hickman
Reviews of Interventions. Version 5.0. Vaccine. 2017;35(35 pt B):4554–4560
M, Christensen H, Caspard H. Uptake of
Chichester, UK: Cochrane; 2020
childhood influenza vaccine from 2012- 26. Kemper KJ, Goldberg H. Do computer-
2013 to 2014-2015 in the UK and the 18. Cochrane Collaboration. 9.5.4 generated reminder letters improve the
implications for high-risk children: Incorporating heterogeneity into rate of influenza immunization in an

Downloaded from www.aappublications.org/news by guest on August 11, 2021


PEDIATRICS Volume 147, number 3, March 2021 11
urban pediatric clinic? Am J Dis Child. pharmacy-initiated interventions on follow-up on two reminder methods.
1993;147(7):717–718 influenza vaccination rates in pediatric Minerva Pediatr. 2016;68(6):404–
27. Szilagyi PG, Rodewald LE, Savageau J, solid organ transplant recipients. J 411
Yoos L, Doane C. Improving influenza Pediatric Infect Dis Soc. 2019;8(6):
46. Walter E, Sung J, Kahn Meine E, Drucker
vaccination rates in children with 525–530
RP, Clements DA. Lack of effectiveness
asthma: a test of a computerized 37. Huth K, Benchimol EI, Aglipay M, Mack of a letter reminder for annual
reminder system and an analysis of DR. Strategies to improve influenza influenza immunization of asthmatic
factors predicting vaccination vaccination in pediatric inflammatory children. Pediatr Infect Dis J. 1997;
compliance. Pediatrics. 1992;90(6): bowel disease through education and 16(12):1187–1188
871–875 access. Inflamm Bowel Dis. 2015;21(8):
47. Zimmerman RK, Hoberman A, Nowalk
28. Fiks AG, Hunter KF, Localio AR, et al. 1761–1768
MP, et al. Improving influenza
Impact of electronic health record- 38. Kempe A, Albright K, O’Leary S, et al. vaccination rates of high-risk inner-city
based alerts on influenza vaccination Effectiveness of primary care-public children over 2 intervention years. Ann
for children with asthma. Pediatrics. health collaborations in the delivery of Fam Med. 2006;4(6):534–540
2009;124(1):159–169 influenza vaccine: a cluster-randomized
48. Britto MT, Pandzik GM, Meeks CS,
29. Moore ML, Parker AL. Influenza vaccine pragmatic trial. Prev Med. 2014;69:
Kotagal UR. Combining evidence and
compliance among pediatric asthma 110–116
diffusion of innovation theory to
patients: what is the better method of 39. Lin CJ, Nowalk MP, Zimmerman RK, et al. enhance influenza immunization. Jt
notification? Pediatr Asthma Allergy Reducing racial disparities in influenza Comm J Qual Patient Saf. 2006;32(8):
Immunol. 2006;19(4):200–204 vaccination among children with 426–432
30. Bjornson G, Scheifele D, Metzger D, asthma. J Pediatr Health Care. 2016;
49. Britto MT, Schoettker PJ, Pandzik GM,
Ferguson A, Wensley D, Whitfield M. 30(3):208–215
Weiland J, Mandel KE. Improving
Promoting the use of influenza vaccine 40. Martin E. Improving influenza influenza immunisation for high-risk
for children at risk of complications. B vaccination rates for pediatric children and adolescents. Qual Saf
C Med J. 2000;42(2):89–90 asthmatics by use of an asthma Health Care. 2007;16(5):363–368
31. Camurdan AD, Camurdan MO, Beyazova educational tool and a patient
50. Freedman JL, Reilly AF, Powell SC, Bailey
U, Dalgic B, Bideci A, Karakus R. The electronic care system. Clin Pediatr
LC. Quality improvement initiative to
effect of intervention on vaccination (Phila). 2008;47(6):588–592
increase influenza vaccination in
rates in children with diabetes: 41. McCreary L. Increasing the rate of pediatric cancer patients. Pediatrics.
a controlled interventional study. Int J influenza vaccination in children with 2015;135(2). Available at: www.
Diabetes Dev Ctries. 2015;35(2):76–83 asthma using a clinic staff and provider pediatrics.org/cgi/content/full/135/2/
32. Cecinati V, Esposito S, Scicchitano B, educational intervention. J Asthma e540
et al. Effectiveness of recall systems for Allergy Educ. 2013;4(6):277–281
51. Olshefski RS, Bibart M, Frost R, et al. A
improving influenza vaccination 42. Merckx J, McCormack D, Quach C. multiyear quality improvement project
coverage in children with Improving influenza vaccination in to increase influenza vaccination in
oncohematological malignancies. Hum chronically ill children using a tertiary- a pediatric oncology population
Vaccin. 2010;6(2):194–197 care based vaccination clinic: is there undergoing active therapy. Pediatr
33. Crawford NW, Barfield C, Hunt RW, a role for the live-attenuated influenza Blood Cancer. 2018;65(9):e27268
Pitcher H, Buttery JP. Improving vaccine (LAIV)? Vaccine. 2016;34(6):
52. Rao S, Fischman V, Kaplan DW, Wilson
preterm infants’ immunisation status: 750–756
KM, Hyman D. Evaluating interventions
a follow-up audit. J Paediatr Child 43. Patwardhan A, Kelleher K, Cunningham to increase influenza vaccination rates
Health. 2014;50(4):314–318 D, Menke J, Spencer C. The use of among pediatric inpatients. Pediatr
34. Esposito S, Pelucchi C, Tel F, et al. a mandatory best practice reminder in Qual Saf. 2018;3(5):e102
Factors conditioning effectiveness of the electronic record improves
53. Sobota AE, Kavanagh PL, Adams WG,
a reminder/recall system to improve influenza vaccination rate in a pediatric
McClure E, Farrell D, Sprinz PG.
influenza vaccination in asthmatic rheumatology clinic. Clin Govern Int J.
Improvement in influenza vaccination
children. Vaccine. 2009;27(5):633–635 2011;16(4):308–319
rates in a pediatric sickle cell disease
35. Gaglani M, Riggs M, Kamenicky C, 44. Paul IM, Eleoff SB, Shaffer ML, Bucher clinic. Pediatr Blood Cancer. 2015;62(4):
Glezen WP. A computerized reminder RM, Moyer KM, Gusic ME. Improving 654–657
strategy is effective for annual influenza vaccination rates for children
54. Wong CI, Billett AL, Weng S, Eng K,
influenza immunization of children with through year-round scheduling. Ambul
Thakrar U, Davies KJ. A quality
asthma or reactive airway disease. Pediatr. 2006;6(4):230–234
improvement initiative to increase and
Pediatr Infect Dis J. 2001;20(12): 45. Urkin J, Skalirsky I, Karbi S, Peled R. sustain influenza vaccination rates in
1155–1160 Parental opinions and level of pediatric oncology and stem cell
36. Gattis S, Yildirim I, Shane AL, Serluco S, knowledge regarding influenza transplant patients. Pediatr Qual Saf.
McCracken C, Liverman R. Impact of immunization for high risk children: 2018;3(1):e052

Downloaded from www.aappublications.org/news by guest on August 11, 2021


12 NORMAN et al
55. Huedo-Medina TB, Sánchez-Meca J, 57. Jones Cooper SN, Walton-Moss B. Using Review. Database of Abstracts of
Marín-Martínez F, Botella J. Assessing reminder/recall systems to improve Reviews of Effects (DARE): Quality-
heterogeneity in meta-analysis: Q influenza immunization rates in Assessed Reviews. York, United
statistic or I2 index? Psychol Methods. children with asthma. J Pediatr Health Kingdom: Centre for Reviews and
2006;11(2):193–206 Care. 2013;27(5):327–333 Dissemination; 2005
56. Martin E. Improving influenza 58. Ndiaye SM, Hopkins DP, Shefer AM, et al. 59. Smulian EA, Mitchell KR, Stokley S.
vaccination rates in a pediatric asthma Interventions to Improve Influenza, Interventions to increase HPV
management program by utilization of Pneumococcal Polysaccharide, and vaccination coverage: a systematic
an electronic medical record. Clin Hepatitis B Vaccination Coverage review. Hum Vaccin Immunother. 2016;
Pediatr (Phila). 2006;45(3):221–227 Among High-Risk Adults: A Systematic 12(6):1566–1588

Downloaded from www.aappublications.org/news by guest on August 11, 2021


PEDIATRICS Volume 147, number 3, March 2021 13
Improving Influenza Vaccination in Children With Comorbidities: A Systematic
Review
Daniel A. Norman, Rosanne Barnes, Rebecca Pavlos, Mejbah Bhuiyan, Kefyalew
Addis Alene, Margie Danchin, Holly Seale, Hannah C. Moore and Christopher C.
Blyth
Pediatrics 2021;147;
DOI: 10.1542/peds.2020-1433 originally published online February 8, 2021;

Updated Information & including high resolution figures, can be found at:
Services http://pediatrics.aappublications.org/content/147/3/e20201433
References This article cites 51 articles, 7 of which you can access for free at:
http://pediatrics.aappublications.org/content/147/3/e20201433#BIBL
Subspecialty Collections This article, along with others on similar topics, appears in the
following collection(s):
Infectious Disease
http://www.aappublications.org/cgi/collection/infectious_diseases_su
b
Influenza
http://www.aappublications.org/cgi/collection/influenza_sub
Vaccine/Immunization
http://www.aappublications.org/cgi/collection/vaccine:immunization
_sub
Permissions & Licensing Information about reproducing this article in parts (figures, tables) or
in its entirety can be found online at:
http://www.aappublications.org/site/misc/Permissions.xhtml
Reprints Information about ordering reprints can be found online:
http://www.aappublications.org/site/misc/reprints.xhtml

Downloaded from www.aappublications.org/news by guest on August 11, 2021


Improving Influenza Vaccination in Children With Comorbidities: A Systematic
Review
Daniel A. Norman, Rosanne Barnes, Rebecca Pavlos, Mejbah Bhuiyan, Kefyalew
Addis Alene, Margie Danchin, Holly Seale, Hannah C. Moore and Christopher C.
Blyth
Pediatrics 2021;147;
DOI: 10.1542/peds.2020-1433 originally published online February 8, 2021;

The online version of this article, along with updated information and services, is
located on the World Wide Web at:
http://pediatrics.aappublications.org/content/147/3/e20201433

Data Supplement at:


http://pediatrics.aappublications.org/content/suppl/2021/02/05/peds.2020-1433.DCSupplemental

Pediatrics is the official journal of the American Academy of Pediatrics. A monthly publication, it
has been published continuously since 1948. Pediatrics is owned, published, and trademarked by
the American Academy of Pediatrics, 345 Park Avenue, Itasca, Illinois, 60143. Copyright © 2021
by the American Academy of Pediatrics. All rights reserved. Print ISSN: 1073-0397.

Downloaded from www.aappublications.org/news by guest on August 11, 2021

You might also like