Professional Documents
Culture Documents
Diagnostic Accuracy of The Clinical Feeding Evaluation in
Diagnostic Accuracy of The Clinical Feeding Evaluation in
1 Department of Clinical Speech and Language Studies, Trinity College, Dublin, Ireland. 2 Department of Neurorehabilitation Sciences, Casa Cura
Policlinico, Milano, Italy.
Correspondence to Irene Calvo at Department of Neurorehabilitation Sciences, Casa Cura Policlinico, Via Giuseppe Dezza 48, 20144 Milano, Italy. E-
mail: calvoi@tcd.ie. This article is commented on by Sellers on page 530 of this issue.
The aim of this systematic review is to determine the diagnostic accuracy of clinical feeding
PUBLICATION DATA been reported across several different paediatric clinical
Accepted for publication 7th December 2015.
conditions.3,4 OPA represents a considerable threat to
Published online 9th February 2016.
respiratory and general health status in children with severe
medical conditions10 and significantly impacts the quality of
ABBREVIATIONS
CFE Clinical feeding examination FEES Fibre-optic endoscopic evalua tion life of children and caregivers.11 The main con sequences of
of swallowing OPA include malnutrition, dehydration, fail ure to thrive,
OPA Oropharyngeal aspiration SLT Speech and language therapist SROC progressive lung disease, bronchiectasis, respiratory failure,
Summary receiver operating characteristic chronic lung disease, recurrent wheez ing, intermittent stridor,
VFSS Videofluoroscopic swallowing study atelectasis, recurrent pneumonia or respiratory infections,
evaluation (CFE) compared to instrumental assessments in detecting aspiration pneumonia, and even tually death. 11,12 Therefore,
oropharyngeal aspira tion (OPA) in children. This is important to support early recognition of OPA is essential in providing prompt and
clinical decision-making and to provide safe, cost-effective, higher quality appropriate management of hydration and nutrition, avoiding
care. All published and unpublished studies in all lan guages assessing the the exacerbation of respiratory consequences, and
diagnostic accuracy of CFE compared to videofluoroscopic swallowing decreasing the morbidity and mortality associated with
study (VFSS) and/or fibre-optic endoscopic examination of swallowing
aspiration.10
(FEES) in detecting OPA in paediatric populations were sought. Databases
were searched from inception to April 2015. Grey literature, citations, and Children with oropharyngeal dysphagia at risk of aspira tion
references were also searched. Two independent review ers extracted and are usually referred for a clinical feeding evaluation (CFE). 13
analysed data. Accuracy estimates were calculated. Research reports were A thorough CFE usually involves recording of medical history,
translated into English as required. Six studies examining the diagnostic an oral motor evaluation of the swallowing structures at rest,
accuracy of CFE using VFSS and/or FEES were eligible for inclusion. and feeding trials.14,15 A CFE is adminis tered by a trained
Sample sizes, populations studied, and CFE characteristics varied widely. therapist, usually a speech and language therapist (SLT) or
The overall methodological quality of the studies, assessed with QUADAS-
an occupational therapist. Clinicians use the occurrences of
2, was considered ‘low’. Results suggested that CFEs trialling liquid
consisten cies might provide better accuracy estimates than CFEs trialling different clinical markers12,13,16–18 and especially the presence
solids exclusively. This sys tematic review highlights the critical lack of of a cough during or after oral tri als as guides to detect OPA.
evidence on the accuracy of CFE in detecting OPA in children. Larger well- Some CFEs may include the use of cervical auscultation 19
designed primary diagnostic test accuracy studies in this area are needed and monitoring by pulse oximetry.20 However, OPA can
to inform dysphagia assessment in paediatrics. sometimes occur without the manifestation of a cough or
other overt sign of aspira tion (change in vocal quality,
breathing patterns, etc.). This condition is defined as silent
aspiration.21–23 Because of the lack of overt signs, silent
Advancements in neonatal care have resulted in an increase
in the incidence of feeding and swallowing disorders in the aspiration may not be recognized during clinical assessment
and thus recommendations for oral feeding may put the child
paediatric population.1–3 Oropharyngeal aspiration (OPA), at risk of developing more severe medical and respiratory
defined as the passage of secretions, food, liquid, or saliva consequences.
below the true vocal cords into the respiratory airways, 4,5 is There is no universally accepted standard CFE. 24 A wide
one of the most harmful consequences of oropharyngeal
range of CFEs are used in clinical practice, and many are
dysphagia. The exact epidemiology of OPA across different
neither validated nor established to be reliable. Therefore, it
medical conditions is unknown;3 its presence is signifi cantly is difficult to know which CFEs are best for detecting OPA. A
associated with medical diagnoses of developmental delay detailed CFE provides direct recommendations for the
and cerebral palsy.6–9 Nonetheless, occurrences of OPA have management of patients and informs about the need
RESULTS
The electronic search identified 8785 records. Five addi tional
records were retrieved through manual searching. In total, 40
potentially eligible studies were assessed for inclu sion.
Thirty-four records were excluded; Appendix SII (published
online) lists the excluded studies and reasons for exclusion.
Six studies met the inclusion criteria for this review. 16,46–50
The process of inclusion is shown in Figure 1.
All the included studies were published in the period
between 2003 and 2014 in peer-reviewed scientific jour nals.
Four were prospective studies,16,46,47,50 one was a ret
rospective study,48 and in one study the method of data
collection was not reported (Table I).49 The sampling method
was consecutive in two studies16, 50 and unclear in the rest of
the studies. All studies were carried out in ter tiary care
settings and university hospitals. Three studies were set in
Brazil,46,48,49 one in Canada,16 one in Ger many,50 and one in
the USA.47 Overall, the sample size of the included studies
was small, ranging from 4 to 93 chil dren.46,48 The population
sample varied within the studies, but all samples comprised
participants with different neu rological disabilities. Definitions
of OPA were provided in all but one study. 48 The CFEs used
in the studies were dif ferent (Table I), and none were
validated or standardized tools. CFEs were administered by
SLTs in three stud ies46,47,50 and by one SLT and
occupational therapists in one study;16 two studies did not
provide clear information about the administrators.48,49 All but
two CFEs49,50 were administered using a standard protocol.
Two CFEs reported the use of cervical auscultation to support
database search
(n=8785)
(n=6730)
(n=211)
Included studies
(n=6)
Figure 1: Flow diagram showing the process of selection of records and studies for the review.
included in the analysis. It also looks at the time interval 544 Developmental Medicine & Child Neurology 2016, 58: 541–553
between carrying out the two examinations. In this review, received swallowing therapy between the clinical and the
considering the episodic nature of OPA events and the instrumental evaluation.
influence that health and clinical conditions have on its Applicability concerns were raised in the patient selec tion
occurrence, a time interval of less than 24 hours was domain for four studies, as their sample population might not
generally judged to be appropriate. In the study by Araujo et be representative of patients in clinical practice or did not
al. 46 the time interval varied between 7 days and 20 days. exactly match the review population. In two studies 16,46 the
This was considered too long, especially because there was sample population represented a rather small age range. In
not enough information on the nature and severity of the one study48 the sample population was relatively small and
clinical conditions of the sample popu lation. Moreover, two included only patients with a rare genetic syndrome that is
patients were excluded from the final analysis without fairly unusual in common clinical practice. In one study 49 all
16
explanation. DeMatteo et al. pre sented a more acceptable participants presented with a diagnosis of severe cerebral
time interval (the VFSS was administered on the same day or palsy, and therefore the sample population already had a
within 48 hours of the CFE); however, not all participants higher risk of OPA. The index test used by Suiter et al. 47 (3oz
50
were included in the analysis. Beer et al. administered the water swallow test) raised applicability concerns because it
FEES from 1 day to 5 days after the CFE, and not all was not believed to be completely adequate for the
participants were included in the analysis; moreover, children population studied. Consecu tive drinking is a skill that may
might have not be completely devel oped by young children and may put
children at higher
s
id
u
ts
n
i
fo
it
ir
tc
a
hC
lba
T
)
90
0
la
)30
0
la
kr
)0
1
la
in
o
)5
00
2
la
Me
)4
1
la
)4
1
la
DI
S
e
it
ps
kn
it
ps
it
ps
it
ps
it
ps
it
ll
D
n
kn
n
kn
kn
it
it
kn
it
P
g
il
s
65
23
n
4=
57
03
39
it
P
n
y8
1–
y2
gA
y1
gA
y1
gA
1
–
gA
de
1–
01
gA
de
gA
it
ir
hc
D S
de
31
3y
8
DS
de
DS
d
de
di
DS
it
t
a
.
de
di
D S
de
de
26
de
di
de
di
hc
:
s
is
id
il
C
:
is
id
il
de
di
de
di
DS
ht
gn
u
is
id
il
ht
la
e
l
il
fi
is
g
a
id
il
is
id
il
is
id
il
dr
id
ir
fo
dr
r
%3
is
id
il
C
l
il
fi
it
li
it
L
.
dr
id
ig
o
ht
gi
h(
id
r
il
it
t
it
t
S
.
SU
:
it
PC
it
ps
li
B:
it
f o
la
v
de
a
a
t
ps
h
y
it
t
li
it
it
t
it
ili
ba
n
.
ps
it
t
i
ps
dr
id
.
ps
da
it
L
e
it
r
it
t
S
h
ti
il
fif
c
.
u
dr
fo
fo
dr
a
fo
dr
fo
dr
fo
dr
fo
I
r
kn
u
o
c
de
di
p
.
ll
dA
ll
d
n
dA
LS
dA
s
di
il
ic
is
kn
u
ll
it
la
v
LS
de
fii
t
dr
b
y
01
ht
iw
ht
b
.
)l
9(
ic
is
it
la
v
fi
dA
ir
ir
px
e
t
LS
dA
,
di
il
dA
la
it
ic
is
C
f o
de
ht
)l
5
.
ba
di
l
.
de
n
i
)l
a
e
)l
)l
.
s
di
l
di
fo
U
o
li
f:
AP
fo
gi
il
di
il
ht
ic
is
it
gi
il
l
n
it
a
,
ht
lp
AP
fo
it
gg
u
fl
02
ht
di
fl
ht
di
fl
AP
fo
le
e
s
t
g
u
di
l
)e
s
e
ht
ir
il
i
o
ik
ir
dli
hC
it
gi
il
C
r
fa
iw
fo
U
.
hg
u
AP
fo
.
it
lp
it
gi
il
C
,
ik
hc
.
)n
AP
fo
it
ps
is
d
s
gi
il
hc
hg
u
.
y
il
hc
:
AP
fo
it
hc
ga
g
,
ih
gu
o
ik
hc
ll
de
y
le
d
,
ir
iv
a
fl
r
n
hc
it
ps
la
ba
yr
ps
e
r
d
la
f
l
dn
u
s
.
it
tl
Review 545
de
it
lb
a
T
) 900
la
30
0
la
kr
01
0
la
in
o
)5
00
2
la
Me
)4
1
la
)4
1
la
DI
S
t
gr
ht
fo
i
t
in
fi
de
fi
AP
ht
fo
in
fi
de
fi
AP
f o
de
fi
AP
de
fi
AP
idn
o
gr
T
.
de
di
dn
o
f o
a
m
dn
o
gr
do
o
di
qil
ht
il
do
o
ht
ir
fo
a
,
SE
EF
dr
fe
hc
do
o
f
.
de
di
le
v
ia
ht
dl
dr
s
.
dr
iw
dr
fe
R
e
ht
fo
ht
le
SE
EF
dr
fe
ht
hc
r
,
LS
dA
ps
f o
SF
dr
it
gn
o
c
e
fo
ir
r
ia
o
hw
ht
ir
lc
dr
dr
fe
fa
o
g
ir
d
.
FC
ht
da
dr
fe
iv
dr
fo
SF
LS
dA
iw
ie
ll
s
:
ic
is
iv
l
a
l,
SF
dA
iv
ig
o
ht
iw
o
di
il
)l
3(
id
du
p
dr
fo
n
a
TL
dA
de
il
ih
g
it
fo
.
)l
3(
ht
la
it
o
.
FC
FV
dr
fe
R
:
dA
in
hc
LS
ic
is
dr
fo
u
.
kn
u
w
o
il
de
il
ig
o
iv
l
:
ic
is
ic
is
FC
fo
tl
ht
s
LS
dA
x
ic
is
de
il
a
s
tn
u
ts
tn
u
m
a
tn
u
ts
FC
fo
tl
ht
t
.
kn
u
dl
i
hC
lc
e
s
ic
is
C
.
do
o
ts
a
.
st
nu
o
ma
de
lc
pi
it
r
ll
pi
it
r
ll
pi
it
r
ll
pi
it
r
ll
N
s
pi
it
r
ll
pi
it
r
ll
it
lF
.
is
yl
ht
ht
de
lc
ht
de
lc
ht
is
yl
ht
de
lc
is
yl
a
n
ht
de
lc
i
de
fr
EF
is
la
is
la
it
r
is
la
)s
ib
it
r
)s
ib
it
r
(
.
SE
EF
fa
de
la
ie
m
iT
ie
iT
)s
ib
ie
iT
la
v
ie
iT
d
te
te
ht
SF
n
e
i
dr
dr
FC
de
ir
dr
ir
dr
s
.
n
w
ts
ts
84
ti
d5
d1
02
d7
te
b
e
gi
dli
hC
g
ll
de
v
r
x
ht
dr
ts
n
e
a
.
st
et
f o
de
fi
fi
fi
e
r
N
s
it
id
f o
la
v
fi
fi
ic
is
fi
is
c
d
a
E
fa
di
fl (
di
(
.
EF
di
qil
(
.
)s
dil
il
s
.
R
e
pe
it
dfi
n
c
n
it
li
fo
il
ht
ba
.
pi
it
r
i
.
AP
fo
ps
s
f o
is
la
pe
R
f o
il
c
.
it
ps
a
;
ll
fl
di
FV
ll
fo
it
la
v
ip
o
it
b fi
SE
EF
it
hp
o
AP
p
a
ht
ga
hc
ps
TL
S
.
it
la
v
de
e
il
EF
0% 25%
75% 100%
Figure 2: Risk of bias and applicability concerns graph. The review authors’ judgements about each domain are presented as percentages of
the included studies.
n ts n n ts
o e e o e e
it it
t t
c m c
c c
x x
it
n n
e e
e e
l l
d
e e
d d
e r e r
n
n n
s s
e a e
I I
dr dr
fe fe
tn tn
R R
e a e a
it w it
dn dn
a a
a a
o
t lF t
P P
g
s s
+ + ???? ++++++
Beer et al. (2014) liquids Beer et al. (2014) purée
––
+++++
? ++
Furkim et al. (2003) ––
? ?
Suiter et al. (2009) –
+
– –++
Figure 3: Risk of bias and applicability concerns summary. The review authors’ judgements about each domain are shown for each included study.
Review 547
yd c . . – . )2 4 e ,
5.
la
5 0–
u e 0( 0
RL
t 3 e
t N
pS 9. r
e
6 0.
s
0( ;
0(
u
2
o
g 7 o
p
8
)4 j it
8.
n 9.
a
1. )0
0– 0
i 1
u 0 r
5
)I
0
C 6. a
w s
do
0(
r 2 o
o
di
(
ll
% 6 h
A u
)7
a
3. . il
5 7
0– q l e
5
w il
9( a
k
s
0.
)01 il
0
s 0( t
)7
c 3.
2( e e
n
i 7 0–
7 .
i v
po e )3
1 la
c i
0.
t n
Sn 7. t
0(
s
0– e is
o
4 o
o
8
i r
r 0. p,
1.
0(
0 n o
o
R
F
u 8 o
LP
lf
r ;
1. )
o
0
o e
y
e
)3
t
8.
F u
di )5
in
0–
v fi l
4
a
4. n
.
o
I–
t 0( v
0
Na
5 N(
d 1 e
6.
–
e y v
0
r t
9
in
)4 fi
a
3. 0
2– .
p n
1
I
0
)8
m 2. 7. (
y 1( 0–
o 4
0
c d
8
0.
0
0(
u 6.
.
n 1
t
3 1
o
it S
)2 3.
a 0
0.
n
1
)8
i
9.
)3
0.
0–
m 3 1
6. 23 –
a
0(
x 3
e
8
8.
0(
8.
)9
g 0
0
s . 2
n
i 9.
dil 7
0
de o
–
e
f – s
)9 4
6.
l 1
)500
0–
2( 1
7
a 7 .
. )0
3. 8.
la
c 0
0( 0–
i te (
0
n 3 o 0.
il 0
0(
c 5.
e
0 0
tt
fo 0
.
a
yc 1 0.
a
0
Me
r
D
)
.
u
0
c Na
)7
N–
9
c 0 )3
9.
.
a 0–
)4 0.
5. 4
. 0
0(
fo 0–
)4 6.
0( 8 –
9.
s 0 0(
0–
2. 2
5 4
e 0.
0(
3
0 0
t 2
8.
0 .
0 8.
a
0
0
4.
(
0
m
it
s )
0
E y
5
t .
:
)3 in
6. fi 0
II
0–
9
n
e
I– )4
)5 2. 9.
lb
5
a
0( 0–
Na
6
T )7
)I
6 9
N( 6.
.
C 0(
4.
0 y 0
4
t
–
% in
8.
fi
2 0
5
n
0
9( I
)9
9. .
0–
RL
0
3
N
(
)2
. 7. 5.
0( 0–
0
)0 0
0
0.
2 1 5 0.
.
0(
9. –
0 0
9 0
)0
0.
1 0.
1
. 0
0(
95
0.
)9
)I 1 9.
C 0–
)0
9 6
s
.
7
di
%5
0 .
9(
u
)0
– 0(
0.
R q
1
9
il
3
LP
–
)500 0
9.
2(
9 . 0
.
.
1 0
la
8
(
.
t
2
e 0(
0
)I
23
C 0 5
o
.
0.
e 1 0
%
t
t
5
a
9(
)9
VP Me 9
N
D .
)6
0
8.
1–
)0 –
5 9.
0– 1
5.
9
0(
0 )
0.
.
)I 0( 30
1
0
C 0
0. (
0 2(
1
5. .
%5
0
9( 0 la
t
5
V . e
0
PP
)0
m
0.
i
. 1
kr
0 –
)I
. )9 u
C 9
6
0( . F
)5 ;
3.
1
3– 0
%5 6 . o
9( 7
it
–
6. 0(
1 2. a
0
e
1 r
0(
9
0
c
0
6 0.
. d
n
– 1
9.
0 o
e 0
9 (
la
v o
0.
1 0
e
h
(
)0 il
r 5
0.
)6 . e
)3
P 1
3.
8 9.
0– 0 k
0–
–
5 7 7 il
6
1 5.
e
0(
1
. v
0 it
4
)I )4 0(
1 a
8.
C
0
0 0 g
2 0.
e
%5
1
9( (
n
and
conversely
estimates
of
specificity
tended to
be higher
with lower
estimates
of
sensitivity.
Sensitivity
it
and
specificity
c
estimates
d
of CFE
compared
e
it
to VFSS
a
are
e
displayed
,
VP
e
in a
u
l coupled
forest plot
a
(Fig. 4) and
e
it
in an
c
SROC plot
d
(Fig. 5).
Two
e
studies47,50
t
is
p,
PP
investigate
d the
;
accuracy of
t
ic
fii
ps
CFE com
pared to
,
FEES. The
e
pS
prevalence
la
v
of OPA in
e
these
n
n
samples
e
d
based on
fin
o
c
FEES
,
IC
;
ranged
y
t
between
23% and
i
33%.
t
is
Estimates
e
of
,
sensitivity
n
and
S
.
specificity
t
c
ranged
from 1.00
l
t
(95% CI
e
l
0.75– 1.00)
bi
s
to 0.33
(95% CI
s
0.04–0.78)
and from
m
i,
Na
0.51 (95%
N
were
higher CI 0.35–
when 0.67) to
estimates 0.14 (95%
of CI 0.02–
specificity 0.43)
were low, respectivel
y. Com was systematic widely reported by values al.48 and When been cohort of in these
plete considered review within the Furkim et more Beer et trialling reported in 300 studies. In
estimates inappropria investigate included al.49 is high consistent al.50 both liquids the children. the study
of te because d the studies. and might with found that
exclusively literature Therefore, by Furkim
accuracy of the diagnostic The be current
the preva
, CFEs that liquids aspiration et al.,49
accuracy prevalence 9 showed are of liquids
are heterogene explained literature. lence rate which
reported in ity of study of CFE in of OPA in by the DeMatteo of OPA consis generally may be included
Table III. designs, detecting this review characteris et al.16 was almost
tently aspirated more both liquids
Sensi tivity participant OPA in varied tics of their found the the same higher more than easily and food of
and children widely from sample sensitivity food of detected smooth pur
s, index difference with liquids
specificity tests, and 18% to population, values thicker by CFE. ee
in OPA and pur
estimates target included 84%, as (range consistenc Bolus consistenc
prevalence ees. 6,7,13,51,54–control is
six studies possibly as dysphagia 1.00– y. y, sensi
are condition comparing a result of to be The food 16,47,48 56
displayed characteris is more consistent consistenc 0.92) This is more diffi tivity
CFE to the prevalent ,50 cult and estimates
in a tics, and VFSS or differences with the y used in sup ported
in children aspiration might have
coupled methodolo FEES. literature the CFE compared by Weir et
in sample with severe 9 may occur been
forest plot gical claiming influenced to CFEs al. who
Sample sizes and cere bral more influenced
(Fig. 6) quality of popula that liquids not only using food found that
clinical pop palsy.53 In readily by the high
and an the are more the of thicker thin liquids
tions, CFE ulations before prevalence
SROC plot included characteris investigate contrast, frequently prevalence consistenci were more swallow
other aspirated rate, but es (range overtly of
(Fig. 7). studies. tics, and d in the ing liquids.
studies 16,46 than
also 0.93– aspiration
Pooling of estimates primary aspirated This might
,47,50 solids. 9,54
measures 0.17). 16,46,4 in their
the studies DISCUSSI of studies. than other explain
of 8–50 sample
in a meta- ON accuracy The value reported However, It has consistenci higher population,
analysis This varied of 84% prevalence Foroni et accuracy. frequently es in a sensitivity as
Figure 4: Coupled forest plot of the estimates of sensitivity and specificity in videofluoroscopic swallowing studies. TP, true positive; FP, false
positive; FN, false negative; TN, true negative.
is
1
3
5
1
0.9
0.8
0.7
2 0.6
0.5
4
0.4
0.3
6
0.2
0.1
0
10
0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1
Specificity
Figure 5: Summary receiver operating characteristic plot of accuracy of clinical feeding examination compared to videofluoroscopic swallowing
study. 1. Furkim et al. (2003). 2. Foroni et al. (2010) pur ee. 3. Foroni et al. (2010) liquids. 4. DeMatteo et al. (2005) solids. 6. Ara ujo et al. (2014).
○, Study estimate.
Table III: Estimates of accuracy of clinical feeding examination compared to fibre-optic endoscopic evaluation of swallowing
Prevalence
Study n Sens (95% CI) Spec (95% CI) (0.19–1.00) 1.16 (0.94–1.44) 0.00 (0.00–NaN) 22 0.33 (0.04–0.78) 0.44 (0.20–
(95% CI) PPV (95% CI) NPV (95% CI) PLR (95% CI) NLR (95% CI)
Beer et al. (2014) 0.70) 0.27 (0.11–0.50) 0.18 (0.03–0.52) 0.63 (0.31–0.87) 0.59 (0.17–1.98) 1.52
liquids
Beer et al. (2014)
puree (0.73–3.14) 56 1.00 (0.75–1.00) 0.51 (0.35–0.67) 0.23 (0.13–0.36) 0.38 (0.22–
Suiter
et al.
(2009) 0.56) 1.00 (0.81–1.00) 2.04 (1.50–2.78) 0.00 (0.00–NaN)
21 1.00 (0.59–1.00) 0.14 (0.02–0.43) 0.33 (0.15–0.56) 0.36 (0.17–0.61) 1.00
Sens, sensitivity; CI, confidence interval; Spec, specificity; PPV, positive predictive value; NPV, negative predictive value; PLR, positive
likelihood ratio; NLR, negative likelihood ratio.
Review 549
Study TP FP FN TN Sensitivity (95% CI) Specificity (95% CI) Sensitivity (95% CI) Specificity (95% CI)
Beer et al. (2014) liquids 7 2 4
12 9
2 1.00 (0.59, 1.00) 0.14 (0.02, 0.43) 0 Beer et al.
13
Suiter et al. (2009)
21 0 0.2 0.4 0.6 0.8 1 0 0.2 0.4 0.6 0.8 1
22 1.00 (0.75, 1.00) 0.51 (0.35, 0.67)
0
Figure 6: Coupled forest plot of sensitivity and specificity estimates in fibre-optic endoscopic evaluation of swallowing studies. TP, true
positive; FP, false positive; FN, false negative; TN, true negative.
is
S
0.9
Suiter et al. (2009) Beer et al.
1
0.8
0.7
0.6
0.5
0.4
0.3
0.2
Beer et al. (2014) purée
0.1
Figure 7: Summary reciever operating characteristic plot of accuracy of clinical feeding examination compared to fibre-optic endoscopic evaluation of
swallowing.
higher disease prevalence and higher disease severity are the included CFEs. However, the influence of disease
associated with higher sensitivity values.57 prevalence on a test’s sensitivity and specificity is difficult to
Conversely, higher levels of specificity occurred in CFEs determine, and there is no specific correlation between
trialling food of solid or pur ee consistency 16,46,48–50 com disease prevalence and accu racy estimates. 58 Beer et al.50
pared to the ones using liquids. Specificity values with food of reported the same prevalence rates for liquid and solid trials
thicker consistency ranged between 0.44 and 0.97. DeMatteo using CFE, and found con
et al.16 explained the poor performance of CFE trialling solids
550 Developmental Medicine & Child Neurology 2016, 58: 541–553
by relating it to the low prevalence of OPA events with solids:
their prevalence rate for OPA with solids was the lowest of all siderably higher sensitivity estimates for liquids and higher
specificity estimates for solids. aspirate,9 further research should focus on the influence of
Even if a test does not produce acceptable values for both silent aspiration in diagnosing OPA during clinical
sensitivity and specificity, it could still be used in clinical examination. Furthermore, there is still a lack of evidence
practice as a guide to rule in or rule out the presence of the concerning the accuracy of cervical auscultation in supporting
disease when either of the two values is very high. The CFE the diagnosis of aspiration.
used by Araujo et al. 46 provided a specificity value of 0.97
and might be considered a good test to rule in OPA events.
Its positive likelihood ratio of 5.58 confirms the moderate REFERENCES
increase in the likelihood of OPA with a positive result in the To conclude, we have a number of recommendations
CFE. Conversely, three CFEs16,47,50 in this review might be based on the findings of this review. Firstly, researchers and
informative in ruling out the occurrence of OPA events. The clinicians must be consistent in the terminology used in
CFEs used by DeMatteo et al.,16 Beer et al.,50 and Suiter et reporting clinical assessments.37 Most of the difficulties in the
al.47 pro vided remarkable sensitivity and negative predictive interpretation of the studies were caused by incon sistency in
value the definitions of OPA, silent aspiration, and laryngeal
estimates with liquid trials; therefore they may be proposed penetration and in the different terms used for solid and liquid
as valid tests in which a negative CFE result can exclude the consistencies.61 Moreover, discrepancies still exist in the
presence of OPA. Nonetheless, it must be remembered that definition of what constitutes ‘screening’ and ‘diagnostic’ tests
predictive values are dependent on the prevalence of the for dysphagia.62 Secondly, CFEs vary widely in clinical
disease in the sample population and change accord ingly in
practice,24 and universally accepted stan dard protocols for
different settings and populations.59,60 Therefore, the ability of VFSS and FEES to be used with chil dren are not yet
a CFE to rule in or rule out OPA cannot be reliably applied to
available.55 Therefore there is a need to establish consistent
every clinical situation.59,60 and reliable standards of practice for carrying out CFEs and
To our knowledge, this is the first systematic review to instrumental evaluations.63 Deter mining the inter- and
investigate the diagnostic accuracy of CFE in detecting OPA intrarater reliability of tests currently utilized in clinical practice
in the paediatric population. It highlights a critical lack of is fundamental for research and clinical practice. Reaching
evidence concerning the accuracy of CFE when diagnosing consensus on the components of the CFE would be a first
OPA, with only six studies included. Because of the foreseen step in the development and test ing of a consistent and
limited research in the area of paediatric dysphagia, wide reliable assessment protocol.
inclusion criteria were set for this review, resulting in low Finally, it is essential that large and well-designed pri mary
overall methodological quality and con siderable diagnostic accuracy studies are conducted in order to
heterogeneity of the included studies.57 As a result, one estimate the accuracy of CFE in detecting OPA. Accurate
acknowledged limitation of this review was the impossibility of methodological rigour is rare in diagnostic accuracy stud ies,
carrying out a meta-analysis. Moreover, the small sample and adherence to STARD guidelines64,65 is paramount,
sizes and heterogeneity of the sample populations pose a because better reporting will translate into easier searches
threat to the applicability of the review findings. and more available evidence.66
The preliminary findings of this review may indicate that
tests using liquids provide better accuracy estimates. How
ACKNOWLEDGEMENTS
ever, larger primary studies are needed to support this finding
The authors have stated that they had no interests that might be
and investigate the diagnostic accuracy of tests using
perceived as posing a conflict or bias.
different consistencies. Moreover, as accuracy changes
according to prevalence rates, studies focusing on specific
paediatric populations or clinical diagnoses might offer SUPPORTING INFORMATION
findings more relevant and directly applicable in clin ical The following additional material may be found online:
practice. In addition, as children are more likely to silently Appendix SI: Electronic databases search strategy.
Appendix SII: List of excluded studies.
1. Lefton-Greif MA, Arvedson JC. Pediatric feeding and dysphagia: the interaction between oropha ryngeal and dysphagia in children. Eur Respir J 2009; 33: 604–11.
swallowing disorders: state of health, population trends, and respiratory impairments. Dysphagia 2002; 17: 192–96. 14. Arvedson JC, Brodsky L. Pediatric swallowing and feed ing:
application of the international classification of functioning, 8. Rogers B, Arvedson JC, Buck G, Smart P, Msall M. assessment and management. 2nd edn. Albany, NY:
disability, and health. Semin Speech Lang 2007; 28: 161–65. Characteristics of dysphagia in children with cerebral palsy. Singular Publishing Group, Thomson Learning Inc., 2002.
2. Miller CK. Updates on pediatric feeding and swallowing Dysphagia 1994; 9: 69–73. 15. Rogers B, Arvedson JC. Assessment of infant oral senso
problems. Curr Opin Otolaryngol Head Neck Surg 2009; 17: 9. Weir KA, McMahon S, Taylor S, Chang AB. Oropha ryngeal rimotor and swallowing function. Ment Retard Dev Dis abil
194–99. aspiration and silent aspiration in children. Chest 2011; 140: Res Rev 2005; 11: 74–82.
3. Miller CK. Aspiration and swallowing dysfunction in pedi atric 589–97. 16. DeMatteo C, Matovich D, Hjartarson A. Comparison of clinical
patients. Infant Child Adolesc Nutr 2011; 3: 336–43. 4. Weir K, 10. de Benedictis FM, Carnielli VP, de Benedictis D. Aspi ration and videofluoroscopic evaluation of children with feeding and
McMahon S, Barry L, Ware R, Masters IB, Chang AB. lung disease. Pediatr Clin North Am 2009; 56: 173–90. swallowing difficulties. Dev Med Child Neu rol 2005; 47: 149–
Oropharyngeal aspiration and pneumonia in children. Pediatr 11. Boesch RP, Daines C, Willging JP, et al. Advances in the 57.
Pulmonol 2007; 42: 1024–31. 5. Rosenbek JC, Robbins JA, diagnosis and management of chronic pulmonary aspiration 17. Tutor JD, Gosa MM. Dysphagia and aspiration in chil dren.
Roecker EB, Coyle JL, Wood JL. A penetration aspiration scale. in children. Eur Respir J 2006; 28: 847–61. Pediatr Pulmonol 2012; 47: 321–37.
Dysphagia 1996; 11: 93–98. 12. Andrew MJ, Parr JR, Sullivan PB. Feeding difficulties in 18. Wallis C, Ryan M. Assessing the role of aspiration in pediatric
6. Arvedson JC, Rogers B, Buck G, Smart P, Msall M. Silent children with cerebral palsy. Arch Dis Child Educ Pract Ed lung disease. Pediatr Allergy Immunol Pulmonol 2012; 25:
aspiration prominent in children with dysphagia. Int J Pediatr 2012; 97: 222–29. 132–42.
Otorhinolaryngol 1994; 28: 173–81. 13. Weir KA, McMahon S, Barry L, Masters IB, Chang AB.
7. Morton R, Minford J, Ellis R, Pinnington L. Aspira tion with Clinical signs and symptoms of oropharyngeal aspiration and
Review 551 39. Wilkinson AH, Burns SL, Witham MD. Aspiration in older astica y atetosica [Clinical and videofluoro- scopic
19. Almeida ST, Ferlin EL, Parente MA, Goldani HA. patients without stroke: a systematic review of bedside evaluation of swallowing in patients with spastic tetraparetic
Assessment of swallowing sounds by digital cervical aus diagnostic tests and predictors of pneumonia. Eur Geriatr cerebral palsy and athetosic cerebral palsy]. Rev Neurol
cultation in children. Ann Otol Rhinol Laryngol 2008; 117: Med 2012; 3: 145–52. 2006; 42: 462–65.
253–58. 40. Martino R, Pron G, Diamant N. Screening for oropha ryngeal 57. Kleijnen J, Westwood M, Whiting P. Anwendbarkeit von
20. Morgan AT, Omahoney R, Francis H. The use of pulse dysphagia in stroke: insufficient evidence for guidelines. Diagnostikstudien – Statistik, Bias und Sch€atzer der
oximetry as a screening assessment for paediatric Dysphagia 2000; 15: 19–30. diagnostischen Genauigkeit [Applicability of diagnostic
neurogenic dysphagia. Dev Neurorehabil 2008; 11: 25– 38. 41. Schepp SK, Tirschwell DL, Miller RM, Longstreth WT. studies: statistics, bias and estimates of diagnostic accu
21. Garon BR, Sierzant T, Ormiston C. Silent aspiration: results Swallowing screens after acute stroke: a systematic review. racy]. Z Evid Fortbild Qual Gesundhwes 2011; 105: 498–
of 2,000 video fluoroscopic evaluations. J Neurosci Nurs Stroke 2012; 43: 869–71. 503.
2009; 41: 178–85. 42. Whiting PF, Rutjes AW, Westwood ME, et al. QUA DAS-2: a 58. Leeflang MM, Bossuyt PM, Irwig L. Diagnostic test accuracy
22. Ramsey D, Smithard D, Kalra L. Silent aspiration: what do revised tool for the quality assessment of diag nostic may vary with prevalence: implications for evi dence-based
we know? Dysphagia 2005; 20: 218–25. accuracy studies. Ann Intern Med 2011; 155: 529– 36. diagnosis. J Clin Epidemiol 2009; 62: 5–12.
23. Smith Hammond C. Cough and aspiration of food and liquids 43. Naaktgeboren CA, de Groot JA, van Smeden M, Moons KG, 59. Linnet K, Bossuyt PM, Moons KG, Reitsma JB. Quanti fying
due to oral pharyngeal dysphagia. Lung 2008; 186 (Suppl 1): Reitsma JB. Evaluating diagnostic accuracy in the face of the accuracy of a diagnostic test or marker. Clin Chem 2012;
S35–40. multiple reference standards. Ann Intern Med 2013; 159: 58: 1292–301.
24. Rommel N. Assessment techniques for babies, infants and 195–202. 60. Leeflang MM, Rutjes AW, Reitsma JB, Hooft L, Bossuyt PM.
children. In: Cichero J, Murdoch B, editors. Dysphagia: 44. Macaskill P, Gastonis C, Deeks JJ, Harbord RM, Tak woingi Variation of a test’s sensitivity and specificity with disease
foundation, theory, and practice. Chichester, UK: John Wiley Y. Analysing and presenting results. In: Deeks JJ, Bossuyt prevalence. CMAJ 2013; 185: e537–44.
& Sons Ltd, 2006: 466–86. PM, Gastonis C, editors. Cochrane handbook for systematic 61. Cichero JY, Steele C, Duivestein J, et al. The need for
25. RCSLT. Disorders of feeding, eating, drinking & swal lowing reviews of diagnostic test accuracy Version 1.0. Oxford, UK: international terminology and definitions for texture modified
(dysphagia). In: Taylor-Goh S, editor. RCSLT Clinical The Cochrane Collaboration, 2010. Available from: foods and thickened liquids used in dysphagia management:
Guidelines. Bicester, UK: Speechmark Publish ing, 2005: http://srdta.cochrane.org/ (accessed 8 July 2015). foundations of a global initiative. Curr Phys Med Rehabil Rep
63–72. 45. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, 2013; 1: 280–91.
26. Arvedson JC. Assessment of pediatric dysphagia and Zwinderman AH. Bivariate analysis of sensitivity and 62. McCullough GH, Rosenbek JC, Wertz RT, McCoy S, Mann
feeding disorders: clinical and instrumental approaches. Dev specificity produces informative summary measures in G, McCullough K. Utility of clinical swallowing examination
Disabil Res Rev 2008; 14: 118–27. diagnostic reviews. J Clin Epidemiol 2005; 58: 982– 90. measures for detecting aspiration post stroke. J Speech
27. Rao N, Brady SL, Chaudhuri G, Donzelli JJ, Wesling MW. 46. Araujo BC, Motta ME, de Castro AG, de Ara ujo CM. Lang Hear Res 2005; 48: 1280–93.
Gold-standard? Analysis of the videofluoroscopic and Avaliac ~ao cl ınica e videofluoroscopia no diagnostico de 63. Martin-Harris B, Jones B. The videofluorographic swal lowing
fiberoptic endoscopic swallow examinations. J Appl Res disfagia na encefalopatia cronica da inf ^ ^ancia [Clinical and study. Phys Med Rehabil Clin N Am 2008; 19: 769–85.
2003; 3: 89–96. videofluoroscopic diagnosis of dysphagia in chronic
28. Lee W-S, Lee S-H, Park YH, et al. Effectiveness of fiberoptic encephalopathy of childhood]. Radiol Bras 2014; 47: 84– 88.
endoscopic evaluation of swallowing (FEES) in patients with 47. Suiter DM, Leder SB, Karas DE. The 3-ounce (90-cc) water
swallowing disorders: a systematic review. Brain swallow challenge: a screening test for children with
Neurorehabil 2013; 6: 9–16. suspected oropharyngeal dysphagia. Otolaryngol Head Neck
29. Leder SB, Karas DE. Fiberoptic endoscopic evaluation of Surg 2009; 140: 187–90.
swallowing in the pediatric population. Laryngoscope 2000; 48. Foroni PM, Beato AM, Valarelli LP, Trawitzki LVV. Disfagia
110: 1132–36. orofar ıngea em crianc as com s ındrome Corn elia de
30. Jang DH, Choi KH, Kim DH, Lim CM, Kim JS. Com parison Lange [Oropharyngeal dysphagia in children with Cornelia
between the radionuclide salivagram and vide ofluoroscopic de Lange syndrome]. Rev CEFAC 2010; 12: 803–10.
swallowing study methods for evaluating patients with 49. Furkim AM, Behlau MS, Weckx LL. Avaliac ~ao cl ınica e
aspiration pneumonia. Ann Nucl Med 2013; 27: 247–52. videofluoroscopica da deglutic ~ao em crianc as com paral
31. Ko MJ, Kang MJ, Ko KJ, Ki YO, Chang HJ, Kwon J-Y. isia cerebral tetrapar etica esp astica [Clinical and vide
Clinical usefulness of schedule for oral-motor assessment ofluoroscopic evaluation of deglutition in children with
(soma) in children with dysphagia. Ann Rehabil Med 2011; tetraparetic spastic cerebral palsy]. Arq Neuropsiquiatr 2003;
32. Lefton-Greif MA, Carroll JL, Loughlin GM. Long-term follow- 50. Beer S, Hartlieb T, Muller A, Granel M, Staudt M. Aspiration
up of oropharyngeal dysphagia in children with out apparent in children and adolescents with neurogenic dysphagia:
risk factors. Pediatr Pulmonol 2006; 41: 1040–48. comparison of clinical judgment and fiberop tic endoscopic
evaluation of swallowing. Neuropediatrics 2014; 45: 402–05.
33. Uhm KE, Yi SH, Chang HJ, Cheon HJ, Kwon JY.
Videofluoroscopic swallowing study findings in full-term and 51. Lefton-Greif MA, Crawford TO, Winkelstein JA, et al.
preterm infants with Dysphagia. Ann Rehabil Med 2013; 37: Oropharyngeal dysphagia and aspiration in patients with
34. Cocks N, Ferreira H. What information do UK speech and 52. Murguia M, Corey DM, Daniels SK. Comparison of sequential
language therapists use when making oral versus nonoral swallowing in patients with acute stroke and healthy adults.
feeding recommendations for adults with oropharyngeal Arch Phys Med Rehabil 2009; 90: 1860– 65.
dysphagia? Dysphagia 2013; 28: 43–57. 53. Benfer KA, Weir KA, Bell KL, Ware RS, Davies PSW, Boyd
35. Bours GJ, Speyer R, Lemmens J, Limburg M, de Wit R. RN. Oropharyngeal dysphagia and gross motor skills in
Bedside screening tests vs. videofluoroscopy or fibre children with cerebral palsy. Pediatrics 2013; 131: e1553–
phagia in patients with neurological disorders: systematic 54. McCullough GH, Wertz RT, Rosenbek JC. Sensitivity and
review. J Adv Nurs 2009; 65: 477–93. specificity of clinical/bedside examination signs for detecting
36. Daniels SK, Anderson JA, Willson PC. Valid items for aspiration in adults subsequent to stroke. J Commun Disord
screening dysphagia risk in patients with stroke: a sys 2001; 34: 55–72.
tematic review. Stroke 2012; 43: 892–97. 55. Engel-Hoek LV, Erasmus CE, Hulst KC, Arvedson JC, Groot
37. Kertscher B, Speyer R, Palmieri M, Plant C. Bedside IJ, Swart BJ. Children with central and peripheral neurologic
screening to detect oropharyngeal dysphagia in patients with disorders have distinguishable patterns of dysphagia on
neurological disorders: an updated systematic review. videofluoroscopic swallow study. J Child Neurol 2014; 29:
38. Perry L, Love CP. Screening for dysphagia and aspira tion in 56. Silva AB, Piovesana AMSG, Barcelos IHK, Capellini SA.
acute stroke: a systematic review. Dysphagia 2001; 16: 7– Evaluacion cl ınica y videofluoroscopica de la deglucion
18. en pacientes con par alisis cerebral tetra par esica esp
552 Developmental Medicine & Child Neurology 2016, 58: 541–553
64. Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete 65. Bossuyt PM, Reitsma JB, Bruns DE, et al. STARD 2015: an 66. Korevaar DA, van Enst WA, Spijker R, Bossuyt PM, Hooft L.
and accurate reporting of studies of diagnostic accuracy: the updated list of essential items for reporting diagnostic Reporting quality of diagnostic accuracy studies: a
STARD initiative. BMJ (Clin Res Ed) 2003; 326: 41–44. accuracy studies. Radiology 2015; 277: 826– 32. systematic review and meta-analysis of investigations on
adherence to STARD. Evid Based Med 2014; 19: 47–54.
Review 553