Professional Documents
Culture Documents
On The Benefits of Speech-Language Therapy For
On The Benefits of Speech-Language Therapy For
On The Benefits of Speech-Language Therapy For
Cleft lip and/or palate (CLP) has an incidence rate of reconstructive surgery, a large number of children have no such
approximately one to two per 1,000 births (Mossey et al., problems and develop in line with peers. However, approxi-
2009; Mossey & Modell, 2012). It can affect a person’s facial mately 50% of children with repaired CLP have persisting
appearance, speech development, hearing, and well-being. speech deviations at 5 years of age (Britton et al., 2014;
Children born with CLP are at an increased risk of demonstrat- Lohmander, Persson, et al., 2017), perhaps influenced by age
ing speech and language problems, including phonological/ at surgery, surgical technique, or learned speech behaviors,
articulation delay or disorder, resonance disorders, and expres- and are often referred to speech-language therapy (SLT;
sive language delay or disorder (Kuehn & Moller, 2000). After Hardin-Jones et al., 2009). Thus, the incidence of speech de-
viations is high among children born with CLP, in compari-
son to peers of the same age. Typically developing children
Correspondence to Anders Sand: Anders.Sand@ki.se. Disclosure: The
show a gradual progress in speech sound production with
authors have declared that no competing financial or nonfinancial interests age, and after 4 years of age, most speech sounds has been
existed at the time of publication. acquired correctly (Stoel-Gammon & Sosa, 2007). However,
Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022 • Copyright © 2022 The Authors 555
This work is licensed under a Creative Commons Attribution 4.0 International License.
Downloaded from: https://pubs.asha.org 118.99.81.255 on 12/02/2023, Terms of Use: https://pubs.asha.org/pubs/rights_and_permissions
sibilant fricatives and the /r/ sound are typically established et al., 2017; Sell, 2005). However, we also believe that the
during a wide time period, and distortions may occur until unclear literature stems from how interventions have been
around 6 years of age. This general description has been veri- evaluated on a fundamental level and that intervention
fied in a study of 684 English-speaking typical children aged outcomes mostly have been evaluated based on statistical
3;0–6;11 (years;months; Dodd et al., 2003) and in 473 significance (e.g., Alighieri et al., 2020; Hardin-Jones &
Swedish typical children aged 3–6 years (Blumenthal & Chapman, 2008; Pamplona et al., 2005, 2014), rather than
Lundeborg Hammarström, 2014). clinical relevance.
In the group of children with repaired CLP, some
persisting speech problems require secondary surgery, such
as problems related to velopharyngeal incompetence, Clinical Versus Statistical Evaluation
where the normal balance between the oral and nasal cavity
is compromised, resulting in passive speech errors such as In many intervention studies on SLT, null hypothe-
hypernasal resonance, audible nasal emission, weak pressure sis significance tests were applied to group aggregated
on consonants. These are the unavoidable consequence of an data (e.g., t tests, analyses of variance, and Wilcoxon
unwanted oral–nasal coupling on speech when no effort is signed-ranks tests), and a statistically significant pre–post
made by the speaker to change it. Active speech errors, difference in the outcome measure was interpreted as sup-
“compensatory errors,” occur when consonants are realized porting that the intervention was beneficial for the individ-
via a change in place and/or manner of articulation in order uals. Although this analytical approach has been wide-
to compensate for the lack of adequate intraoral air pressure spread, a statistically significant pre–post difference is ac-
required for production of stop and fricative consonants tually theoretically and practically unrelated to the re-
(Harding & Grunwell, 1998). Active speech errors are one of search interests many clinical researchers have (Angst
the contributors to reduced intelligibility and should be et al., 2017; Wasserstein & Lazar, 2016). There are two re-
treated with SLT. Problems with expressive language may search issues. The first issue is about which, if any, of the
further compromise intelligibility, and children might de- individuals enrolled in the study benefited from the inter-
velop less positive attitudes to speech and communication vention to a clinically relevant degree. The second issue is
compared to those without a cleft (Havstam & Lohmander, about what proportion of future individuals, based on the
2011; Whitehill et al., 2011). study at hand, are estimated to benefit from similar
Two major SLT approaches have been adopted to interventions.
treat active speech errors: a motor-phonetic–based ap- The first issue is not a statistical query. It requires
proach grounded in the theory that a motor skill is learned us to define what pre–post changes in a particular out-
through repeated actions of that specific skill using a hierar- come measure should be considered clinically relevant.
chical structured therapy (Albery & Enderby, 1984; Ruscello This is a research aspect that has been somewhat oversha-
& Vallino, 2014) and a language (linguistic)–phonological dowed in both SLT research and clinical research at large
approach that focuses on the organization and representa- (Ioannidis, 2016; McShane et al., 2019; Revicki et al.,
tion of the sound system of a particular language (Chapman, 2008). It is a complex issue because what improvement
1993). In 1965, Prins and Bloomer observed that the majority constitutes a clinically relevant benefit must be sensitive
of individuals with CLP who receive SLT do not achieve to, for example, the patient group in question, the particu-
a speech production at the level of their peers. They lar outcome of interest, and the dosage of the interven-
stated, “The burden of proof to demonstrate the effective- tion. In the specific context of individuals born with CLP,
ness of therapy for oral cleft patients is increasing, and a it is also important to consider, for example, the type of
prerequisite for this is the development of meaningful pro- cleft, the surgical technique, and the age at intervention.
cedures for studying changes in speech behavior” (Prins & Interpreting clinical benefit based only on a statistical
Bloomer, 1965, p. 357). Unfortunately, the peer-reviewed analysis does not take these considerations into account
evidence for the benefit of SLT for individuals born with (Wasserstein et al., 2019). Furthermore, the focus of statis-
CLP is still uncertain (Vallino-Napoli, 2011). In 2013, tical analysis on aggregated data often obfuscates the fact
Bessell et al. conducted a systematic review of the pub- of large interindividual variability in treatment outcomes
lished intervention studies, and despite evaluating 17 (see Box 1). Thus, to evaluate SLT, we cannot only statis-
studies, they found little evidence to support the effective- tically evaluate treatment results but also need to evaluate
ness of SLT in children with CLP. Bessell et al. (2013) di- clinical benefit on an individual level. Finally, in SLT con-
agnosed this uncertainty as stemming from very heteroge- texts, we are interested not only in whether a pre–post
neous measuring and analytical procedures and argued change is clinically relevant or not but also in whether the
that more rigorous methodology is needed. We certainly outcome measure (e.g., speech production) is on a level
agree with calls for more rigorous and standardized with peers or not after SLT. This is again a complex issue
methods for studying changes in speech behavior (Allori that requires us to consider prior knowledge of typical
556 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
Search Strategy
Data Collection
To perform our electronic search, we engaged the
Karolinska Institute University Library search consulta- We found 34 eligible studies that are listed in Supplemen-
tion group. Our search targeted Medline, Embase, tal Material S4. Twenty-one of these studies contributed with
Cochrane, Web of Science, PsycInfo, and CINAHL. The IPD. From 19 studies, IPD could be tabulated from the article
specific search strategies for each database can be found and from two studies; IPD was received upon request from the
in Supplemental Material S2, but they generally con- author. These 19 studies contributed with IPD on one or more
sisted of two “blocks”: one describing the population of the outcomes of interest (see Figure 1 and Supplemental
group (e.g., “cleft palate,” “cleft lip,” and “velopharyngeal Material S4). Thirteen studies did not contribute with IPD: In
insufficiency”) and the other one describing the intervention/ seven cases, we contacted the authors but were not able to ob-
outcomes of interest (e.g., “speech therap*” and “language tain IPD, and in six cases, where the studies were published be-
training”). The MeSH terms identified for searching Med- tween 13 and 50 years ago, we did not request IPD because we
line (OVID) were adapted in accordance to corresponding judged it unlikely that we would obtain it.
vocabularies in Embase, PsychInfo, and CINAHL. Each On a study level, we tabulated type of therapy (motor-
search concept was also complemented with relevant free- phonetic vs. phonological/language), the delivery of therapy
text terms, and these were, if appropriate, truncated and/ (directly by a speech-language pathologist or by a speech as-
or combined with proximity operators. We had no restric- sistant or caregiver, and if the therapy was delivered in a
tion regarding year of publishing, language, or type of ar- clinic or some other setting), and the dosage of the interven-
ticle (dissertations, theses, etc.) in our search strategy as tion. Because therapy details were heterogeneous between
including studies reported in all types of publication will studies, we were not able to systematically tabulate more de-
reduce potential bias (Boutron et al., 2021). Our last tailed information on dosage (Allen, 2013) than the total in-
search was on February 19, 2021. This search yielded tervention duration.
4,728 results. On the IPD level, we tabulated demographic data
Our electronic search was supplemented by reviewing regarding age, type of cleft, gender, syndrome, and the out-
the reference lists from included articles and published re- come measures outlined above pre- and post-intervention.
views and by an expert’s insights. To gain access to poten- When there were uncertainties in the reporting, we contacted
tially unpublished data (Boutron et al., 2021), we also authors to verify that we correctly interpreted the information.
contacted several researchers who had described their The main aspect of the IPD-focused analysis was that
studies as “preliminary” or “pilot studies.” We did not, we evaluated on an individual level separately (a) if the
558 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
individual improved to a clinically relevant degree during completely on the same level as peers without a history of
treatment and (b) if the individual’s outcome measure was clefts or other speech deviations. However, one speech pro-
on a level with peers or not after SLT. These evaluations duction error was accepted as being on peer level at all ages
were based on the second and third authors’ (E.H. and A.L.) as one error could be an error of measurement.
clinical expertise, knowledge of the studied therapies and The prior information we used to evaluate the IPD
measures, and knowledge on typical speech and language de- was, in short, that after 4 years of age the phonemic in-
velopment, complemented with reference data for specific ventory is completed in most children, who thereafter
measures where available. In evaluating (a), the IPD infor- gradually reach adultlike precision of consonant sounds
mation we considered was the age of the individual, the indi- (Stoel-Gammon & Sosa, 2007). Although many conso-
vidual’s pre–post change, and the dosage of the intervention nants are similar across languages, there are differences re-
(in relation to the prior information described below). In garding voicing, aspiration, and subtle differences in the
evaluating (b), the IPD information we considered was the place and manner of articulation (Hutters & Henningsson,
age of the individual and the outcome measure after SLT (in 2004). Such differences could not be fully considered in all
relation to the prior information described below), disregard- included studies. Reference values on PCC and consonant
ing the dosage of the intervention and any idiosyncratic errors among typically developed children between 3 and
speech deviations of the patient before intervention. We were 19 years of age (Dodd et al., 2003; Lohmander,
strict in evaluating (b), requiring the outcome to be Lundeborg, & Persson, 2017) were used to interpret the
560 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
Table 1. Study level information on the studies included in the quantitative synthesis.
Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
Age
Therapy Intervention range
Study type Delivery duration N a
(months) Speech measure Intervention description
Alighieri et al. Motor-phonetic SLP (clinic) 3 days 2 137–140 PCC based on 15 sentencesb in Six 1-hr sessions
(2019) the SNAP test SLT in patients’ secondary language
Derakhshandeh Motor-phonetic SLP (clinic) 10 weeks 5 54–108 PCC in 14 oral and two nasal Four sessions of 45-min per week for
et al. (2016) sentencesb (by picture naming) 10 weeks
Dobbelsteyn Motor-phonetic Parent (home) 4 months 7 51–192 PCC in SAF containing 11 oral Parents completed a 4-hr workshop
et al. (2014) phrasesb and then gave daily 10-min sessions
for 4 months.
Hanchanlert Motor-phonetic Speech assistant 9 months 6 47–124 Number of articulation errors on One- to 3-day speech camps with three
et al. (2015) and parent sentencesb on the TUPS to four 45-min sessions daily with SLP
(home) Speech assistants and caregivers gave
weekly or biweekly 30-min sessions for
9 months.
Lindeborg Motor-phonetic SLP and speech 1 week 38 36–216 Number of articulation errors on One week speech camp with daily sessions
et al. (2020) assistant repeated single words of 30–60 min administered by speech
(camp) assistants assisted by SLPs
Luyten et al. Motor-phonetic SLP (clinic) 3 days 5 88–235 PCC based on 15 sentencesb in Six 1-hr sessions over 3–4 days
(2016) the SNAP test SLT in patients’ secondary language
Makarabhirom Motor-phonetic Speech assistant 9 months 16 40–147 Number of articulation errors on Three-day speech camps with three to
et al. (2015) and parent sentencesb on the TUPS four 45-min sessions daily with SLP
(home) Speech assistants and caregivers then
gave weekly 30- to 45-min sessions
for 9 months.
Pamplona & Language/ SLP (clinic) No information 32 43–81 20 min of spontaneous speech Fifteen sessions of 45 min (unclear interval)
Ysunza (2018) phonological rated according to severity of
compensatory articulation
Pamplona et al. Language/ SLP (camp) 4 weeks 90 36–80 20 min of spontaneous speech Summer camp with 4-hr therapy per day,
(2014) phonological rated according to severity 5 days a week for 4 weeks
of compensatory articulation
Pamplona et al. Language/ SLP (camp) 3 weeks 41 36–77 20 min of spontaneous speech Summer camp with 4-hr therapy per day,
(2017) phonological rated according to severity of 5 days a week for 3 weeks
compensatory articulation
Prathanee et al. Motor-phonetic Speech assistant 9 months 16 49–96 Number of articulation errors on Three-day speech camps with SLP
(2014) (home) sentencesb on the TUPS Speech assistants then gave six 1-day
sessions at home over 9 months.
Prathanee et al. Motor-phonetic Speech assistant 1 year 12 43–192 Number of articulation errors on Three-day speech camps with six sessions
(2020) and parent words on the TUPS of 45 min per day with SLP
(home) Speech assistants then gave six 1-day
sessions at home over 9 months.
Three 1-day follow-up speech camps with
SLP
Prathanee (2011) Motor-phonetic Speech assistant 6 months 9 54–150 Number of articulation errors in Four-day speech camps with 18 hr of
and parent an articulation test (by picture treatment with SLP
(home) naming) Caregivers and health providers were
responsible for children’s speech
program for 6 months.
(table continues)
Age
Therapy Intervention range
Study type Delivery duration N a
(months) Speech measure Intervention description
Pumnum et al. Motor-phonetic Speech assistant 9 months 4 68–104 Number of articulation errors on One- to 3-day speech camps with three to
(2015) and parent sentencesb on the TUPS four 45-min sessions daily with SLP
(home) Speech assistants and caregivers then gave
weekly or biweekly 30-min sessions for
9 months.
Roxburgh et al. Motor-phonetic SLP (clinic) 2 weeks 2 74–110 PCC on 36 untrained words selected Eight sessions of 60 min over 2 weeks
(2016) specifically for the patient’s
articulation errors
Scherer et al. Motor-phonetic Parent (home) 3 months 10 18–35 PCC-R measured from 30 min of Parents completed two to four training
(2008) recorded language sample from sessions and implemented this for
parent–child interaction 3 months.
Sritacha et al. Motor-phonetic Speech assistant 9 months 6 49–72 Number of articulation errors on One- to 3-day speech camps with three
(2016) and parent sentencesb on the TUPS to four 45-min sessions daily with SLP
(home) Speech assistants and caregivers then
gave weekly or biweekly 30-min sessions
Sand et al.: On the Benefits of Speech-Language Therapy
for 9 months.
Sweeney et al. Motor-phonetic SLP (clinic) vs. 3 months 29 35–85 PCC calculated for sentencesb in One group (n = 12a) received six therapy
(2020) parent (home) CAPS-A sessions over 12 weeks.
In the other group (n = 17a), parents attended
2 days of training and then carried out the
intervention for 12 weeks.
Van Demark & Motor-phonetic SLP (camp) 6 weeks 13 80–144 PCC articulation on ICPAT Summer camp with 4-hr therapy per day for
Hardin (1986) sentences. 6 weeks
Note. SLP = speech-language pathologist; PCC = percentage of consonants correct; PCC-R = percentage of consonants correct–revised; SNAP = simplified nasometric assessment proce-
dures; SLT = speech-language therapy; SAF = speech assessment form; TUPS = Thai universal parameters of speech outcomes for people with cleft palate; CAPS-A = Cleft Audit Protocol for
Speech–Augmented; ICPAT = Iowa Cleft Palate Articulation Test.
a
Number of individuals included in our synthesis; we excluded individuals because of syndromes, because pretherapy speech production was already on a level with peers (accord-
ing to the presented information), because of missing values, or because of patient overlap between studies. See Supplemental Material S5 for more information. bWhen both were
available, we selected speech production on sentence rather than word level, because we believe this to have more ecological validity.
563
Bias in
Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
measurement
Judgment
Bias due to confounding of outcomes
across
Study Maturation Familiarity Judgment Blind Judgment domains Note
Alighieri et al. N Y Serious Y Low Serious Possible familiarity from using same speech material at pre and
(2019) post. The short revision before assessment might enhance this.
(Contacted authors; no reply.)
Derakhshandeh N N Low N Serious Serious
et al. (2016)
Dobbelsteyn Y N Moderate N Serious Serious Possible maturation over the 4 months of intervention, especially for
et al. (2014) the younger children.
Hanchanlert Y N Serious N Serious Serious Possible maturation over the 9 months of intervention, especially for
et al. (2015) the younger children.
Lindeborg et al. N N Low Y Low Low
(2020)
Luyten et al. N Y Serious N Serious Serious Possible familiarity from using the same speech material at pre and
(2016) post. One of three assessors was blinded.
Makarabhirom Y N Serious N Serious Serious Possible maturation over the 9 months of intervention, especially for
et al. (2015) the younger children.
Pamplona & No information N No information N Serious Serious Unclear interval of treatment, so we cannot judge risk of maturation
Ysunza effects.
(2018) Unclear if and how assessors were blinded.
Pamplona et al. N N Low N Serious Serious Unclear if and how assessors were blinded.
(2014)
Pamplona et al. N N Low N Serious Serious Unclear if and how assessors were blinded.
(2017)
Prathanee et al. Y N Serious N Serious Serious Possible maturation over the 6 months of intervention, especially for
(2014) the younger children.
Prathanee et al. Y N Serious N Serious Serious Possible maturation over the 9 months of intervention, especially for
(2020) the younger children.
Prathanee Y N Serious N Serious Serious Possible maturation over the 1 year of intervention, especially for
(2011) the younger children.
Pumnum et al. Y N Serious N Serious Serious Possible maturation over the 9 months of intervention, especially for
(2015) the younger children.
Roxburgh et al. N N Low N Moderate Moderate Two of three assessors were blinded.
(2016)
Scherer et al. Y N Serious Y Low Serious Possible maturation over the 3 months of intervention, especially for
(2008) the younger children.
Sritacha et al. Y N Serious N Serious Serious Possible maturation over the 9 months of intervention, especially for
(2016) the younger children.
Sweeney et al. N N Low Y Low Low
(2020)
Van Demark & N N Low N Serious Serious
Hardin (1986)
Language aspects Hanchanlert et al. (2015) 1 0 0.00 [0.00, 0.98] 0 0.00 [0.00, 0.98]
Pamplona & Ysunza (2000) 41 28 0.68 [0.52, 0.82] 7c 0.17 [0.07, 0.32]
Prathanee et al. (2020) 7 3 0.43 [0.10, 0.82] 3 0.43 [0.10, 0.82]
Pumnum et al. (2015) 1 1 1.00 [0.03, 1.00] 1 1.00 [0.03, 1.00]
Sritacha et al. (2016) 3 2 0.67 [0.09, 0.99] 2 0.67 [0.09, 0.99]
Intelligibility Alighieri et al. (2019) 2 0 0.00 [0.00, 0.84] 0 0.00 [0.00, 0.84]
Hanchanlert et al. (2015) 0 — —
Luyten et al. (2016) 5 2 0.40 [0.05, 0.85] 2 0.40 [0.05, 0.85]
Prathanee et al. (2020) 8 3 0.38 [0.09, 0.76] 3 0.38 [0.09, 0.76]
Prins & Bloomer (1965) 10 5 0.50 [0.19, 0.81] 0 0.00 [0.00, 0.31]
Pumnum et al. (2015) 2 0 0.00 [0.00, 0.84] 0 0.00 [0.00, 0.84]
Sritacha et al. (2016) 1 1 1.00 [0.03, 1.00] 1 1.00 [0.03, 1.00]
Sweeney et al. (2020) 24 10 0.42 [0.22, 0.63] 8 0.33 [0.16, 0.55]
PROs Sweeney et al. (2020) 15 10 0.67 [0.38, 0.88] 8 0.53 [0.27, 0.79]
Note. Em dashes signify that no participant was included from Hanchanlert et al. (2015), as all participants either were included in other
studies or had outcome measures before SLT already on reference level.
a
We excluded participants whose outcome measures before SLT already were on reference level. See Supplemental Material S5 for more in-
formation. bClopper–Pearson “exact intervals.” cA conservative estimate because of lack of information on the individual children’s age.
CLP, and cleft palate, and we used unilateral CLP as refer- log odds. This model was based on 303 individuals from 18
ence and included studies as random intercepts. In summary, studies; Lindeborg et al. (2020) did not include information
the model suggests that individuals with a bilateral CLP on type of cleft and could thus not be included in this analy-
were slightly less likely to improve during therapy; however, sis. The intercept in this model (in log odds) was 1.35 (95% CI
note that there is considerable uncertainty in how strong this [0.63, 2.16]), and the regression coefficients (in log odds) were
effect is; the 95% CI around the coefficient of having a bilat- −0.61 (95% CI [−1.67, 0.44]) and −0.19 (95% CI [−1.19, 0.86])
eral CLP, compared to unilateral CLP, was [−1.67, 0.44] in for bilateral CLP or cleft palate, as compared to unilateral
Figure 2. Overview of the meta-analysis on proportion of individuals who improved to a clinically relevant degree during intervention (number
of improved participants divided by sample size). In the forest plot, the point estimate of each study is illustrated as gray boxes, and the
lines illustrate 95% confidence intervals (CIs; Clopper–Pearson “exact method”). The sizes of the gray boxes are relative to the (random-
effects) weights of the studies (their relative “precision” or inverse variance, compared to full data set). The studies are roughly grouped and
delimited by horizontal lines based on study design and intervention implementation. On the bottom, the meta-analytical CI is illustrated as a
diamond, and the prediction interval is illustrated as a thick line.
Table 4. Probability to improve during therapy and to have speech production on a level with peers after
speech-language therapy as a function of type of cleft.
566 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
568 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
570 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022
572 Journal of Speech, Language, and Hearing Research • Vol. 65 • 555–573 • February 2022