Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

AJSLP

Research Article

Children’s Responses to Telegraphic


and Grammatically Complete
Prompts to Imitate
Shelley L. Bredin-Ojaa and Marc E. Feya

Purpose: The purpose of this study was to determine Results: No differences between conditions were found for
whether children in the early stage of combining words are the number of responses that contained a semantic relation.
more likely to respond to imitation prompts that are telegraphic In contrast, 3 of the 5 children produced significantly more
than to prompts that are grammatically complete and whether grammatical morphemes when presented with grammatically
they produce obligatory grammatical morphemes more reliably complete imitation prompts. Two children did not include a
in response to grammatically complete imitation prompts than function word in either condition.
to telegraphic prompts. Conclusion: Providing a telegraphic prompt to imitate does
Method: Five children between 30 and 51 months of age not offer any advantage as an intervention technique. Children
with language delay participated in a single-case alternating are just as likely to respond to a grammatically complete
treatment design with 14 sessions split between a grammatical imitation prompt. Further, including function words encourages
and a telegraphic condition. Alternating orders of the 14 sessions children who are developmentally ready to imitate them.
were randomly assigned to each child. Children were given
15 prompts to imitate a semantic relation that was either Key Words: children, early intervention, language disorders,
grammatically complete or telegraphic. morphology, syntax

M
any speech-language pathologists (SLPs) working To many, the use of telegraphic models in language
with families of young children with language intervention is intuitively sensible. Adults use telegraphic
delay shorten their utterances and encourage models based on the belief that the reduced input will lighten
parents and other professionals to shorten their utterances so the child’s comprehension burden by removing potentially
that they more closely match the child’s expressive language competing elements that perform principally formal gram-
level. When such shortening involves stripping grammatical matical functions, such as articles, auxiliaries, and bound
morphemes from otherwise acceptable phrases or sentences, morphemes. Such short utterances without grammatical detail
the result is reduced or telegraphic models. The following are presumed to make the meaning of the adult utterance
examples contrast a telegraphic utterance (a) followed by a more accessible, thus rendering them easier to imitate and,
corresponding grammatically complete utterance (b). ultimately, to produce spontaneously and creatively. On the
1a. boy in house basis of this logic, many language intervention approaches
have recommended the use of telegraphic input with children
1b. the boy is in the house with language impairments (e.g., Hancock & Kaiser, 2006;
2a. girl walk MacDonald & Blott, 1974). For these models of intervention,
2b. the girl is walking adult prompts for verbal imitation represent a key ingredient
and are assumed to be central to program success. Therefore,
3a. baby like milk a crucial assumption in these approaches that recommend the
3b. the baby likes milk use of telegraphic imitative stimuli is that utterances contain-
ing language intervention targets are more reliably imitated
when they are shortened by stripping them of grammatical
a
University of Kansas Medical Center, Kansas City
functors (i.e., function words) than they would be if they were
presented with all grammatical details intact. In this study,
Correspondence to Shelley L. Bredin-Oja: sbredin-oja@kumc.edu
we put this assumption directly to test. The purpose of this
Editor: Carol Scheffner Hammer
study, therefore, is not to test the impact of an intervention
Received December 7, 2012
Revision received May 7, 2013
Accepted June 15, 2013 Disclosure: The authors have declared that no competing interests existed at the
DOI: 10.1044/1058-0360(2013/12-0155) time of publication.

American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014 • A American Speech-Language-Hearing Association 15
over time but, rather, to test the immediate response of a child were presented as recasts in interrogative form (e.g., Child:
when presented with a prompt to imitate. “Baby eat.” Adult: “Will the baby eat?”). The results indi-
cated that not only did the use of auxiliary-fronted questions
fail to facilitate auxiliary development but also the children in
Reasons to Question the Use of Telegraphic Models the experimental group used (numerically, but not statisti-
There are many reasons to believe that the use of tele- cally) fewer auxiliaries than did the children in the play group.
graphic speech may not be beneficial to young language On the basis of these results, the researchers reasoned that if
learners and that, in fact, telegraphic input may complicate children early in development do not fully process the aux-
learning processes. First, there is substantial evidence that iliary immediately before the sentence subject, frequent
children do not comprehend adult utterances more readily adult use of subject–auxiliary reversals may wrongly convey
when grammatical functors are removed (see Fey, 2008, and to the child that unmarked strings such as “the baby eat”
van Kleeck et al., 2010, for a review). With few exceptions are acceptable in main clauses. Theakston and colleagues
(e.g., Smith, 1973), these studies either indicate no signifi- (Theakston & Lieven, 2008; Theakston, Lieven, & Tomasello,
cant difference in comprehension between grammatical and 2003) provided experimental support for the hypothesis that
telegraphic sentences or favor the grammatical models unmarked strings found in auxiliary-fronted questions neg-
(van Kleeck et al., 2010). atively impact typically developing children’s use of finite
Second, it is well documented that children have the markers. Other researchers (e.g., Hadley, Rispoli, Fitzgerald,
most difficulty learning grammatical forms that are sparsely & Bahnsen, 2011; Leonard & Deevy, 2011) who considered
represented and/or optional in the language (cf. Leonard other forms in adult language have also concluded that input
et al., 2003; Leonard, Eyer, Bedore, & Grela, 1997; Rice & devoid of overt tense and agreement marking leads children
Wexler, 1996). For example, in English, use of tense and to consider forms that incorrectly lack tense and agreement
agreement inflections on verb forms has been shown to be as acceptable. If strings of words not fully processed within
difficult for English-speaking children with typical develop- grammatical input can lead the child to an incorrect hypoth-
ment and exceedingly difficult for children with specific esis about the obligatory nature of morphological markers,
language impairment (SLI; Leonard, Camarata, Brown, & what impact does telegraphic input have, especially in the case
Camarata, 2004; Leonard, Camarata, Pawłowska, Brown, & of imitative prompts in which the child is explicitly instructed
Camarata, 2006; Rispoli, Hadley, & Holt, 2012). One factor to produce an ungrammatical utterance? Finally, there
responsible for this delay appears to be that verbs are not is a great deal of evidence that children are aware of gram-
marked consistently for tense and agreement in English. For matical morphemes and recognize some of these morphemes’
example, past tense is unmarked on some forms (e.g., hit, put), grammatical functions well before they produce them (Eyer
lexically marked in others (e.g., went, hid), and inflected et al., 2002; Höhle & Weissenborn, 2003; Höhle, Weissenborn,
with a phonologically conditioned suffix in others (e.g., walked, Kiefer, Schulz, & Schmitz; 2004; Olguin & Tomasello, 1993;
posed). The third person singular –s is another obvious case Shi, Marquis, & Gauthier; 2006; Tomasello & Olguin, 1993).
in point; the marking of present tense and number is limited As one example, Fernald and Hurtado (2006) directly com-
to the third person. In contrast, despite the richness and pared 18-month-old toddlers’ recognition of words in contexts
complexity of verb morphology in many languages, such as with grammatical detail (e.g., look at the baby) to contexts
Italian and Hebrew, children with SLI who are learning these with all grammatical detail omitted (Look. baby.). The results
languages do not show a profile of special difficulty with in- showed that the children were significantly faster to respond
flected verb forms (Bedore & Leonard, 2001; Dromi, Leonard, accurately to target words when those words are presented
& Shteiman, 1993; Leonard & Bortolini, 1998). Use of tele- in a short grammatical sentence. Thus, it appears that com-
graphic models has the effect of making the overall use of plete phrases and sentences with preserved prosodic contours
grammatical forms less consistent. Rather than simplifying and predictable co-occurrences of forms, such as determiners
language learning, use of telegraphic adult input may provide with nouns, offer an advantage rather than a disadvantage
positive evidence to children that grammatical details are to young children learning language.
optional rather than obligatory, thus making them more
difficult to learn.
Is Telegraphic Speech Necessary for Improving
Third, there is evidence that even certain types of
grammatically correct input can have negative consequences Expressive Language?
if they are not fully processed by young language learners. Given the evidence that telegraphic input to young
In their study of the role that yes–no questions have on the children may be contraindicated and may even slow down the
acquisition of auxiliaries, Fey and Loeb (2002) hypothesized rate of language development in some cases, then what are the
that exposing children to sentence-initial auxiliaries would effects of regularly omitting them in language intervention?
increase the saliency and, therefore, lead to greater auxiliary There is no question that language interventions that require
development. The researchers exposed 3-year-old children children with language impairment to repeat telegraphic
with SLI and 2-year-old typically developing children who stimuli can be efficacious. For example, enhanced milieu
were not yet producing auxiliaries to either play sessions in teaching (Hancock & Kaiser, 2006), which advocates the use
which the adult produced frequent auxiliaries in declarative of telegraphic prompts for imitation and explicitly teaches
sentences or an experimental protocol in which auxiliaries parents to use these forms, has been widely studied and shown

16 American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014


to be an efficacious language intervention approach. Thus, From an evidence-based perspective, this hardly seems suf-
the real question is not whether intervention packages that use ficient to support the technique when there is reason to believe
requests to imitate telegraphic input can be effective; they that it may negatively impact grammatical development
clearly can be, especially when the goals are early develop- among children with cognitive and language impairment.
mental achievements. The real question is, does the imita- This experiment was designed to address the following
tion of telegraphic models optimize the efficacy of these two questions. First, do children in the early stage of com-
approaches? bining words imitate simple constructions containing early
The only published study that directly compares tele- semantic relations more consistently when presented with
graphic models with grammatically complete models is a elicited imitation prompts that are telegraphic than with
small clinical experiment conducted by Willer (1974). This elicited imitation prompts that are grammatically complete?
study investigated the hypothesis that telegraphic models We expected that there would be no clear differences between
increase the expressive language skills of children with children’s imitative responses to telegraphic and grammatical
intellectual disabilities primarily because telegraphic models prompts to imitate. Second, do children in the early stages
are easier to imitate. The participants were 10 children, ages of multiword combinations produce obligatory grammatical
5;6 (years;months) to 13;6, with moderate intellectual dis- morphemes more reliably in response to grammatically com-
abilities who were using only single words. The children were plete imitative prompts than to telegraphic prompts? Because
arranged into matched pairs and randomly assigned to either grammatical morphemes were present only in the gram-
a grammatical stimulus group or a telegraphic stimulus matical prompts, we predicted that any differences in imitative
group. responses would favor the fully grammatical stimuli. Given
Each child received a 15-min intervention session once the potential for harm suggested by the relevant extant lit-
a day, five times a week, for 5 weeks. The lessons were iden- erature, if both of our predictions were correct, it would be
tical for each group, with one exception: Children in the extremely difficult to defend any intervention approach that
telegraphic stimulus group received only prompts that were requires clinicians or other intervention agents to elicit imi-
devoid of all determiners, auxiliary verbs, and copula BE tations using telegraphic prompts.
forms (e.g., ball; boy running; ball on table). Children in the
grammatical group received complete phrases (e.g., the ball;
the boy is running; the ball is on the table). Responses to the Method
imitative trials were judged as correct if the equivalent of the Participants
telegraphic model was produced by the child, regardless of Five children with expressive language delay between
the type of imitative prompt presented. That is, the children the ages of 30 and 51 months served as participants in this
were not expected to imitate functors properly to receive single-case experiment. Three children (P2, P3, and P4) were
credit for imitation. receiving speech-language services at the time of their study
Results of the daily performance showed that children enrollment. According to parent report, therapy goals did not
in the telegraphic group performed significantly better on specifically address morphosyntax. One child (P1) was en-
imitative trials and responsive language trials (i.e., responding rolled in therapy at the end of his participation in the study;
appropriately to questions about each of the vocabulary the other child (P5) attended an early Head Start program and
items) by the end of each lesson—that is, by the last class of was being monitored by the Center for Child Health and
each section (class numbers 5, 10, 15, 20, and 25). Posttesting Development at The University of Kansas Medical Center
was conducted to compare the two groups’ imitative language (KUMC).
performance when presented with both types of models—
that is, with telegraphic models as well as with grammatically
complete models. The results of these tests revealed that chil- Eligibility Criteria
dren in the telegraphic group performed significantly better Children were seen on two separate occasions in their
when presented with telegraphic models. The telegraphic home to determine eligibility. During the first qualifying
group also did better when presented with grammatically session, the parents were asked to complete the MacArthur–
complete models, but this difference was not statistically Bates Communicative Development Inventories: Words
significant. and Sentences (CDI:WS; Fenson et al., 2007), and a 60-min
Willer (1974) concluded that sentences containing language sample was collected using a standard set of toys.
function words were more difficult to imitate and subsequently This sample was digitally recorded and transcribed by the first
master by children with cognitive and language impairments. author using the Systematic Analysis of Language Transcripts
He cautioned, however, that although his study revealed (SALT) program (Miller & Iglesias, 2006) to determine the
that language targets were achieved more quickly using child’s mean length of utterance in morphemes (MLUm) and
telegraphic prompts to imitate, there was evidence that these to document use of semantic relations. To document the
attainments were somewhat stereotypical and were not highly child’s willingness to imitate, we asked the child to imitate
productive language forms. 10 words that were reported on the CDI:WS. In addition, the
The results of Willer’s (1974) small study offer the only motor imitation portion of the Screening Tool for Autism
support for the use of telegraphic prompts as an intervention in Two-Year-Olds (STAT; Stone, Conrod, Turner, & Pozdol,
technique to increase children’s productive language skills. 2004) was administered. This measure includes four tasks:

Bredin-Oja & Fey: Children’s Responses to Prompts 17


(a) rattle: the examiner shakes a rattle, then encourages the assigned an alternating order of the grammatical and tele-
child to do the same; (b) car: the examiner rolls a small car graphic conditions as they entered the study. Pre-experimental
back and forth across the table, then encourages the child to child characteristics are presented in Table 1.
do the same; (c) drum hands: the examiner alternately drums
her hands on the table, then encourages the child to do the
same; and (d) hop dog: the examiner hops a small dog across Experimental Design
the table, then encourages the child to do the same. During We used a single-case alternating treatments design
the second session, which occurred a few days later, the child (ATD) to determine whether telegraphic prompts to imi-
was given the Leiter International Performance Scale—Revised tate or grammatically complete prompts to imitate result in
(Leiter–R) Brief IQ test (Roid & Miller, 1997), a hearing more reliable imitations by children who are just beginning
screening using a portable audiometer and play audiometry, to produce semantic relations. The ATD is one of the most
and a language elicitation task designed to measure the powerful and practical designs in all of time-series methodol-
child’s productive use of semantic relations that were identi- ogy (Hayes, Barlow & Nelson-Gray, 1999). An ATD is a
fied from the spontaneous language sample. To be considered strong, clinically useful strategy that does not require a baseline
productive, the child needed to use a semantic relation at or a withdrawal phase as other single-subject designs such
least two times during the play-based language sample, but as do the multiple-baseline or variations of the A-B-A design.
it had to be spontaneously produced in no more than three out A baseline phase is not necessary because the purpose is to
of five opportunities during the language elicitation task. compare the effect of two conditions rather than to document
The language elicitation task was modeled after Scherer and improvement over time (Barlow & Hersen, 1984). Further-
Olswang’s (1989) elicitation task. The examiner manipulated more, in their proposal of design standards to be implemented
objects known to be familiar to the child and prompted for by the What Works Clearinghouse (WWC), Kratochwill
a verbal response by asking a wh-question. For example, et al. (2010) stated that one way for an ATD to Meet Evidence
to elicit the semantic relation, agent–action, the examiner Standards (without reservation) is to have “two alternating
showed the child a figure of a man kicking a ball and asked, treatments compared with each other” ( p. 15).
“What’s happening?”; to elicit the semantic relation action– The ATD directly compares two distinct conditions
object, the examiner made a boy puppet eat a cookie and while avoiding the problem of intersubject variability. Osten-
asked, “What’s the boy doing?” Selection of targets then were sibly, extraneous factors that may affect the performance of
based on the child’s spontaneous use of the semantic relations a participant will have an equal effect on both conditions.
during the language sample and limited use during the elic- A further benefit of the ATD is its superior control over other
itation task. Qualifying children met the following criteria: threats to internal validity, such as history and maturation.
This does not imply that the ATD is ideally suited for all
1. Passed a hearing screening of 25 dB HL at 500, 1000,
single-subject research. For example, the ATD may suffer
2000, and 4000 Hz
from interference of multiple interventions—that is, the effects
2. Reported to produce at least 100 words as determined of one experimental intervention may interfere with the effects
by the CDI:WS (Fenson et al., 2007) of the other (Barlow, Nock, & Hersen, 2009). Specifically,
3. Obtained a standard score within the average range order effects and carryover effects are a concern.
on the Leiter–R Brief IQ test (Roid & Miller, 1997) Order effects refer to the fact that Treatment B might
be different if it always follows Treatment A. Randomizing
4. Produced at least two examples of two different
the order of conditions alleviates this problem.
semantic relations, excluding functional relations,
Carryover effects refer to the influence of one treatment
such as recurrence and existence, during a 60-min
on an adjacent treatment, regardless of the overall order.
language sample
Providing only one condition per session and separating
5. Produced the two semantic relations from the language sessions by at least 1 day are recommended practices to
sample in no more than three out of five opportunities minimize carryover effects (Barlow et al., 2009). To enhance
during the language elicitation task (errors on this task external validity—that is, the generalizability of findings to
included one-word responses not containing the target other similar participants—the experiment was conducted five
relation rather than no responses) times with four additional participants at a similar stage of
6. Produced a MLUm between 1.2 and 2.1 based on a development. Although it is typical for single-subject studies
100-utterance sample collected during play with the to demonstrate effects with at least three different participants
examiner (Horner et al., 2005), five participants were enrolled in this
study to increase generalizability of the findings. Replication
7. Responded correctly with the target word on six out
across five different cases exceeds the Meet Evidence Standards
of 10 elicited imitation prompts of single words known
criteria put forth by the WWC (Kratochwill et al., 2010).
to be used by the child
Each child participated in seven sessions involving
8. Complied with all four motor imitation tasks from the grammatically complete elicited prompts alternating with
STAT seven sessions involving telegraphic elicited prompts for
Twelve children were evaluated in this manner; five a total of 14 sessions. This also exceeds the Meet Evidence
children met the eligibility criteria and were randomly Standards criteria put forth by the WWC (Kratochwill et al.,

18 American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014


Table 1. Preexperimental participant characteristics.

Participant ID Sex Race/Ethnicity Age (in mos) MLUm/100 utterances Brown’s stage Leiter–R Brief IQ CDI:WS

P1 Male Black 35 1.80 Late I 97 106


P2 Male More than 1 race 51 2.10 II 97 540
P3 Female Hispanic White 33 1.44 Early I 115 335
P4 Male Black 33 1.77 Late I 103 117
P5 Male White 30 1.85 Late I 103 319

Note. mos = months; MLU/m = mean length of utterance in morphemes; CDI:WS = MacArthur–Bates Communicative Development Inventories:
Words and Sentences; vocabulary checklist, total words used.

2010). For an ATD with two levels, the number of ways The grammatically complete version of this example (i.e.,
in which a unique random order occurs is calculated by the Say, the duck is walking) was never used in the grammatical
following formula: condition. Similarly, a child who received the stimulus,
Say, the boy is jumping, in the grammatical condition would
Number of ways ¼ N!=n1 !n2 !; never encounter the model, Say, boy jumping, in the tele-
graphic condidition. To facilitate this separation of tokens
where N = total number of sessions, n1 is the number of of the child’s target across conditions, different sets of toys
sessions for Treatment A, and n2 is the number of sessions were used for each condition.
for Treatment B. The children were seen in their homes or at their day-
Fourteen sessions of two equal numbers of prompt care either two or three times per week, with at least 1 day
conditions results in 3,432 possible random orders [14!/7!7! = between consecutive sessions, for a total of 14 sessions. Only
3,432]. Not all of these orders are desirable, however. For one condition was given during a session, and each condition
example, one order involves seven Condition A sessions occurred seven times. As described earlier, the conditions
followed by seven Condition B sessions. This would essen- were alternated in a semirandomized fashion with the stipu-
tially result in an AB design, and possible order effects could lation that no condition was presented during more than
make the results difficult to interpret. To ensure greater three consecutive sessions. Randomizing the conditions
alternation of conditions, we restricted the design so that controlled for order effects; providing each condition on a
randomization of conditions resulted in no more than three different day with at least 1 day between sessions should have
consecutive sessions of the same condition. This restriction reduced carryover effects (Barlow et al., 2009).
resulted in 1,972 possible random orders of seven sessions Fifteen elicited prompts were presented during the
per condition. context of a 20- to 30-min play session. Other intervention
studies used (a) a range of 10–20 prompts to imitate, (b) adult
models, or (c) expansions of child comments (cf. Loeb &
Experimental Procedure Armstrong, 2001; Scherer & Olswang, 1989; Willer, 1974).
Assigning a different semantic relation to each condi- A study by Fey, Yoder, Warren, and Bredin-Oja (2013) had a
tion would require that the two semantic relations be at the targeted rate of 60 prompts in 60 min; however, the prompts
same developmental level and be matched perfectly for degree used in their study ranged from a nonintrusive time delay to
of difficulty; however, it is difficult to ascertain that the dif- a more intrusive prompt to imitate. Because the only prompt
ficulty between any two semantic relations is equivalent for a used in this study was the intrusive elicited imitation prompt,
given child. Therefore, after identifying two target relations a maximum of 15 trials per session was imposed to prevent
that were produced but not mastered, one randomly selected child fatigue and to enhance compliance. Results from a pilot
relation served as a target in both the grammatical and tele- study indicated that 15 prompts in a 20- to 30-min session
graphic conditions until the child demonstrated mastery-level yielded sufficient responses from the child without causing
performance of the semantic relation. Mastery level was aversion to the prompts.
defined as 13 out of 15 multiword responses to prompts The sessions adhered to the basic principles of enhanced
to imitate in two consecutive sessions. If a child produced milieu teaching; specifically, each testing episode was made
13 utterances containing the target semantic relation in re- relevant by arranging the play context to increase the likeli-
sponse to the prompt during two consecutive sessions, a hood that the child would need to produce utterances contain-
second semantic relation was introduced as the target in both ing the target relation and by following the child’s attentional
conditions. This graduation to a second goal was necessary lead (Hancock & Kaiser, 2006). For example, the target se-
for only one child, identified as P5. mantic relation action + object may have consisted of specific
To minimize carryover effects, specific examples of prompts to imitate push (the) button, open (the) box, kick (the)
the target semantic relation were kept different for the two ball, and so on. Each specific prompt contained lexical items that
conditions. For example, the specific imitative prompt of Say, were known by the child as evidenced by the language sam-
duck walking occurred only in the telegraphic condition. ple, CDI:WS, and observations during previous experimental

Bredin-Oja & Fey: Children’s Responses to Prompts 19


sessions. Results of a pilot study showed that children pro- examined to determine whether there was overlap or com-
duced consistent two-word responses to most if not all of the plete separation of the lines. In interpretation of this visual
15 prompts after the fifth session in both conditions. To guard inspection, both conditions are found to be similarly effective
against these ceiling effects, each specific type (e.g., Say, when the data lines overlap. When there is clear divergence
the duck is walking) was presented in no more than three between the data lines, differential effectiveness of conditions
tokens during a single session. Further, if a specific semantic is indicated (Barlow et al., 2009).
relation type was spontaneously produced by the child dur- Fisch (2001) suggested that experiments that use single-
ing two consecutive sessions, then that specific type was subject designs and rely only on visual inspection to eval-
replaced with another example of the same semantic relation. uate the efficacy of interventions often miss treatment effects.
Once the child was prompted to imitate and was given Therefore, to augment visual inspection of the data, the com-
an opportunity to respond, the examiner provided natural puter program Single-Case Randomization Tests (SCRT),
consequences such as responding appropriately to the child’s developed by Onghena and Van Damme (1993; Edgington &
request or comment and by continuing the interaction. A Onghena, 2007), was used to conduct a randomization test
recast of the child’s verbal response to the prompt was not for restricted ATD to test the null hypothesis. The null hypoth-
provided as the last step in a request for imitation sequence, as esis can be stated as follows: For each of the experimental
is recommended for enhanced milieu teaching (Hancock & sessions, the responses are independent of the prompt con-
Kaiser, 2006). This deviation from the enhanced milieu dition given at that time. That is, the observed responses
teaching technique was planned because although we wanted would have occurred regardless of the type of prompt given.
to encourage compliance to imitative prompts, we did not wish
to hasten the child’s mastery of a new relation beyond the
facilitation provided by child’s imitation. Randomization Tests
The third child enrolled in the study (P3) frequently Randomization tests are a subclass of statistical tests
responded to the imitative prompts with only a single word, called permutation tests (Edgington & Onghena, 2007)—tests
regardless of the condition. To ensure that this did not occur in which the p value is the proportion of data permutations
with future participants, we implemented the enhanced milieu or configurations providing a test statistic as large as the
teaching technique of providing corrective prompts for the value for the observed results. Any test statistic that is
fourth and fifth participants (Hancock & Kaiser, 2006). A sensitive to the predicted effect can be used with random-
corrective prompt is an immediate and identical second prompt ization tests (Bulté & Onghena, 2008). In this investigation,
if the child fails to produce a target response. For example, any differences in the level of child responses to prompts
Adult: Say duck walking. Child: walking. Adult: Say duck for verbal imitation were of primary interest; therefore, the
walking. The interventionist ended the sequence by providing test statistic used was the difference between the mean scores
a natural consequence regardless of the child’s response to of Condition A and Condition B sessions. Randomization
this corrective prompt. Examples of specific prompts and tests provide valid alternatives to nonparametric tests and
adult responses during a grammatical and telegraphic have even greater sensitivity because they do not discard
session are available (see online supplemental materials). information in the data by reducing them to ranks (Todman
Each session was digitally audio recorded for data & Dugard, 2001). The permutation method gives an unbiased
collection purposes; the number of prompts administered and estimate of the p value without relying on the assumption of
the number of responses given by the child were tallied for normally distributed errors (Hayes, 1996). The only assump-
each session. A response was credited as imitated if the child’s tion required for a randomization test is the assumption of
production was equivalent to the telegraphic version of the exchangeability. This assumption establishes that all possi-
prompt, regardless of the condition of the session. An exact ble data permutations must be equally likely under the
imitation of a grammatically complete phrase was not required null hypothesis. The most effective way to ensure exchange-
during a session using grammatical prompts. For example, ability is to randomly assign an order of conditions prior to
a response of “roll ball” was judged to be correct in either data collection (Hayes, 1996). When the exchangeability
a telegraphic session or a grammatical session. Similarly, a assumption is met, the randomization test can be a valid and
response of “duck walking” or “duck walk” was credited highly accurate method of computing statistical significance
regardless of the prompt used. Child responses that included (Hayes, 1996).
function words (e.g. “roll the ball”; “the duck is walking”) A conservative two-tailed or nondirectional randomi-
were tallied separately and analyzed independently. Addi- zation test was used to determine the p value of the observed
tionally, to determine whether children were more reluctant test statistic. To achieve a p value (two-tailed) of at least .05,
to respond to the longer, grammatically complete prompts, the observed test statistic—that is, the absolute difference
all “no” responses to the prompts for each session were tallied between the mean of Condition A and the mean of Condition
and analyzed separately. B—had to be equal to or greater than the test statistic for 49 of
the possible 1,972 restricted random orders. Fourteen sessions
were deemed adequate to find a statistically significant dif-
Data Analysis ference between the two conditions. Note that the highest
The data were analyzed two ways. First, data from each level of significance that can be obtained in a two-tailed test
session was plotted, and the two data lines were visually with 1,972 permutations is .001.

20 American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014


Fidelity of Conditions Figure 1. Number of responses containing a target semantic relation
and number of responses also containing a function word. Fcn Wd
For each participant, four sessions or 28.6% of the Gram = functional word in grammatical condition; Fcn Wd Tele =
total, two from each condition, were chosen at random by a functional word in telegraphic condition.
graduate student in speech-language pathology for a check
of fidelity to the experimental procedure. The graduate
student was not informed of the research question or of the
total number of prompts per session that was required. Ses-
sions were relabeled so that the temporal order of the sessions
could not be determined by the student. The student listened
to all four sessions and reported the number of prompts for
imitation that were given. She also judged whether all prompts
adhered to the same condition during a session, that no more
than three specific examples of a prompt were used in the
same session, and that a specific prompt from one condition
did not occur in the other condition. Any deviation from these
procedures was considered a violation. Fidelity of the exper-
imental procedure was 98%. During one session in the tele-
graphic condition, the examiner gave one extra prompt for
one of the children. For this session, the child’s response
to the 16th prompt was excluded from the analyses.
and a mean of 7 (range = 5–10, SD = 1.85) responses for the
telegraphic condition. Given that the average difference be-
Interrater Reliability tween P1’s imitations in the telegraphic and grammatical
The graduate student transcribed the same four sessions conditions was 0, the proportion of random data permutations
chosen for the fidelity check and independently scored them yielding a between-conditions difference at least this large
for reliability. Interrater reliability agreement was based on a was 1.00 ( p = 1.0, two-tailed). There was also no statistically
point-by-point agreement for the child responses. Interrater significant difference in the number of times P1 provided
agreement was calculated by using the percentage of agree- no response to an imitative prompt between conditions
ment index (Suen & Ary, 1989): the number of agreements (Mgrammatical = 7.0, Mtelegraphic = 6.43; |A–B| = 0.57; p = .612).
divided by the sum of the number of agreements and the In contrast, as also shown in Figure 1, there was a
number of disagreements, multiplied by 100. Interrater reli- remarkable difference for the number of times the child in-
ability was 93%, 95%, 98%, 93%, and 95% for participants cluded a grammatical function word as well as the target se-
P1–P5, respectively. mantic relation in his imitative response. At Session 7, the line
representing the grammatical condition goes up and remains
distinctly higher than that for the telegraphic condition,
Results which remains virtually at 0 across all of the sessions. P1 pro-
Data for P1 duced a mean of 3.43 function words (range = 0–7, SD = 2.23)
in the grammatical condition and a mean of 0.14 function
The target semantic relation throughout the experi- words (range = 0–1, SD = 0.35) in the telegraphic condition,
mental protocol for this child was agent (patient) + action. resulting in a test statistic of 3.29 with a statistically significant
Examples of prompts are Say: The frog is jumping and Say: p of .002.
Dog driving for the grammatical and telegraphic conditions,
respectively. Figure 1 displays his pattern of responses for
the target semantic relation as well as the number of responses Data for P2
that contained a function word. The lines representing each The target semantic relation for all 14 sessions for P2
of the experimental conditions cross and do not diverge sub- was also agent (patient) + action. Examples of prompts used
stantially, indicating clearly that there was no effect of con- for this child are Say: The bug is flying and Say: Duck walking
dition. Further, it is important to note that there is no upward for the grammatical and telegraphic conditions, respectively.
trend in the data for either condition. This suggests that P1 The data are presented in Figure 2. In Figure 2, we illus-
did not learn the semantic relation and utilize this learning to trate unambiguously that there was no difference in P2’s level
support a generally strong performance across conditions. of responding across conditions. As for P1, the pattern of
In other words, the similarity across conditions does not the lines, which trends downward over later sessions, does not
appear to be the result of carryover. suggest that early differences led to learning in one condi-
The analysis of the visually displayed data is supported tion, which carried over to influence responding in the other
by the statistical analysis. The mean difference between P1’s condition.
numbers of imitations across conditions was 0. He had a P2 had a mean of 7.29 (range = 4–12, SD = 3.25)
mean of 7 (range = 5–8, SD = 1.07) responses that contained responses for the grammatical condition and a mean of 8.86
the target semantic relation for the grammatical condition (range = 6–11; SD = 2.12) responses for the telegraphic

Bredin-Oja & Fey: Children’s Responses to Prompts 21


Figure 2. Participant P2’s number of responses containing a target Figure 3. Participants P3’s number of responses containing a target
semantic relation and number of responses also containing a function semantic relation and number of responses also containing a function
word. word.

condition. This resulted in a nonsignificant test statistic of not occur with future participants, we saw this child for an
1.57, which has a p value of .35. There was also no statistically additional six sessions to pilot the use of corrective prompts.
significant difference in the number of times P2 provided no Recall that a corrective prompt is an immediate and identical
response to a prompt between conditions (Mgrammatical = 4.0, second prompt to be used only if the child fails to produce
Mtelegraphic = 4.29; |A–B| = 0.29; p = .89). a target response to the first prompt—in this case, a two-word
Figure 2 also illustrates P2’s use of grammatical func- semantic relation. The two conditions were alternated, with
tors in his imitation of semantic relations. Visual inspection each condition occurring three times. The only change in pro-
shows clearly that P2 imitated at least a small number of these cedure was the use of corrective prompts, which were included
forms, but these productions occurred only in the grammat- in each of the total 15 prompts given per session.
ical condition. P2 produced a mean of 1.86 responses that Figure 4 displays the pattern of responses that con-
contained a function word (range = 0–5, SD = 1.95) in the tained at least a target semantic relation for these six sessions.
grammatical condition and a mean of 0 responses that con- The mean number of responses is identical for both conditions
tained a function word (range = 0, SD = 0) in the telegraphic (M = 8.67), and the ranges of scores are similar (i.e., gram-
condition, resulting in a significant test statistic of 1.86, which matical range = 5–12, telegraphic range = 6–12). There is no
has a p of .025. clear divergence of the lines, indicating that both conditions
were similarly effective. A randomization test could not be
Data for P3 completed on these data because the order of sessions was not
randomly assigned. Regardless, the procedure of corrective
P3 rarely responded to the prompts for her target of prompts was judged to be effective in eliciting multiword
agent (patient) + action by producing a semantic relation. responses and, therefore, was used with the final two partic-
Examples of imitative prompts for P3 are Say: The dog is ipants when necessary.
sleeping and Say: Bear driving. Instead, she frequently re-
sponded with just a single word regardless of the condition. Figure 4. Participant P3’s number of responses to corrective prompts
The numbers of responses containing a semantic relation are that contained a target semantic relation.
displayed in Figure 3. Despite the infrequent production of
her target semantic relation, the lines clearly overlap, indi-
cating no difference in her level of responding for either
condition. P3 had a mean of 0.29 responses that contained
a semantic relation (range = 0–1, SD = 0.49) in the gram-
matical condition and a mean of 0.57 responses (range = 0–1,
SD = 0.53) in the telegraphic condition. The resulting non-
significant test statistic is 0.29 ( p = .54). There was also no
statistically significant difference in the number of times
P3 provided no response to a prompt between conditions
(Mgrammatical = 5.43, Mtelegraphic = 5.86; |A–B| = 0.43; p = .75).
As Figure 3 also shows, P3 did not produce any function
words in response to the prompts in either condition.
As noted above, P3 frequently produced a single word
in response to the prompts to imitate. To ensure that this did

22 American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014


Data for P4 Figure 6. Participant P5’s number of responses containing a target
semantic relation and number of responses also containing a function
The target semantic relation for P4 was action + object. word. The bar indicates when a second target semantic relation
Examples of imitative prompts for this child are Say: Pull the was introduced.
tube and Say: Roll ball for the grammatical and telegraphic
conditions, respectively. Figure 5 displays P4’s pattern of
responses. As with the first three participants, P4 responded
similarly in both conditions, as can be discerned from the
overlapping lines. Here, too, the lack of upward trend in either
line suggests that carryover from one condition to the other
is not a concern. P4 had a mean of 2.71 responses (range = 1–5,
SD = 1.38) in the grammatical condition and a mean of 2.29
responses (range = 1–4, SD = 1.11) in the telegraphic con-
dition. The resulting test statistic of 0.43 ( p = .69) was not
significant. Likewise, there was no significant difference be-
tween conditions in the number of times P4 failed to respond
to a prompt (Mgrammatical = 0.57, Mtelegraphic = 1.28; |A–B| =
0.71; p = .40). P4 did not produce any function words in
response to the prompts for imitation in either condition, as
also shown in Figure 5.

Data for P5 introduced. The pattern resembles the previous four cases.
There is no clear divergence of lines, demonstrating that P5’s
P5 began the experimental protocol with the semantic
level of responding did not differ across conditions. In addi-
relation of action + object as his target. During the fourth
tion, both lines trend downward for the final two sessions,
and fifth sessions, he imitated 13 out of 15 prompts, meeting
indicating that carryover does not appear to account for
the ceiling criterion for a target. Therefore, his second target
the similarity of responses. P5 had a mean of 6.0 responses
semantic relation, agent (patient) + action, was used for all
(range = 2–13, SD = 3.61) in the grammatical condition and a
remaining sessions. Examples of imitative prompts for this
mean of 6.14 responses (range = 2–13, SD = 4.78) in the
child are Say: Throw the ball [action + object] or Say: The fish
telegraphic condition. This resulted in a nonsignificant test
is swimming [agent (patient) + action] and Say: Blow fan [action
statistic of 0.14 with a p of 1.0. As with the previous four
+ object] or Say: Bug crawling [agent (patient) + action] for
participants, there was no statistically significant difference in
the grammatical and telegraphic conditions, respectively.
the number of times P5 provided no response to a prompt
After changing goals, P5’s level of correct responding im-
between conditions (Mgrammatical = 5.43, Mtelegraphic = 7.43;
mediately dropped far below the ceiling, indicating that
|A–B| = 2.0; p = .25).
agent (patient) + action was a more appropriate target.
P5 had a significant difference for the number of re-
Despite this change of targets, P5 responded similarly in both
sponses that contained a function word as well as the target
conditions. Figure 6 displays his pattern of responses; the
semantic relation. These results are also displayed in Figure 6.
vertical line at Session 6 indicates when the second target was
When action + object was the target semantic relation, P5
frequently imitated the function word, but only in the gram-
matical condition. After the ceiling criterion was met and
Figure 5. Participant P4’s number of responses containing a target the second target was introduced, P5 imitated fewer func-
semantic relation and number of responses also containing a function
word. tion words, but, again, these productions occurred only
in the grammatical condition. P5 produced a mean of 4.43
responses that contained a function word (range = 0–12,
SD = 3.95) in the grammatical condition and a mean of 0
responses that contained a function word (range = 0, SD = 0)
in the telegraphic condition, resulting in a significant test
statistic of 4.43, with a p of .008.

Discussion
This investigation sought to determine whether chil-
dren with language impairment who are just beginning to
combine words to express semantic relations produce utter-
ances containing target semantic relations more reliably in
response to prompts to imitate that are telegraphic than to
prompts that are grammatically complete. Our single-case

Bredin-Oja & Fey: Children’s Responses to Prompts 23


experimental design with four replications provides an un- the use of corrective prompts occurred in both telegraphic and
equivocal answer: The children in this study responded just as grammatical conditions for P4 and P5. Therefore, any effects
reliably to grammatical as to telegraphic prompts to imitate. on child performance should have been distributed equally
For all five children, using either visual or statistical criteria, across each condition; and (b) the results for P4 and P5 mirror
the level of target responses did not differ across the two those for P1–P3; significant numbers of sentences containing
conditions. In addition, because the number of no responses grammatical morphology occurred only in the grammati-
was not significantly different for the two conditions, we can cal condition.
conclude that the children did not find the grammatically Third, this study focused on one aspect of a broader
complete prompts to be functionally more complex or in any intervention technique—namely, a prompt to imitate, the
way aversive. most supportive prompt in a hierarchy of prompts in
On the other hand, children’s use of grammatical enhanced milieu teaching and many other language inter-
morphology along with the target semantic relation occurred vention approaches. The dependent variable was children’s
almost exclusively in the grammatical condition. This effect frequency of imitative responses to these prompts and not
was visually discernible and statistically significant for three evidence of learning grammatical morphology. Prompts to
of the five children. imitate are judged to be an important if not the central
It may be that the other two children, P3 and P4, were ingredient in enhanced milieu teaching and other related
not at the developmental level necessary to fully respond language interventions that have demonstrated efficacy
to the grammatically complete prompts, as appeared to be (Hancock & Kaiser, 2006). Therefore, because full grammat-
the case for the 3-year-old children with SLI studied by Fey ical prompts resulted in as many or more complete imitative
and Loeb (2002). In their study on children’s readiness to responses, interventions that provide grammatical prompts
move from single words to two-word semantic relations, Bain should have learning effects as broad as or broader than those
and Olswang (1995) determined that children’s potential for that provide telegraphic models. Nevertheless, we acknowl-
immediate change can best be described by observing their edge that to directly compare the effects of telegraphic and
responsiveness to adult prompts. Children who are ready for grammatically complete input on children’s grammatical
immediate change will respond to less supportive prompts, development, children’s spontaneous use of treatment targets
whereas those who are less ready will need more support. A must be observed following interventions that are alike in all
prompt for a verbal imitation is highly supportive, and yet respects except for the contrastive use of telegraphic and
these two children were unable to imitate a function word. grammatical models.
Under Bain and Olswang’s (1995) model of dynamic as-
sessment, the production of function words was outside of
these children’s zone of proximal development (Olswang, Clinical Implications
Bain, & Johnson, 1992; Vygotsky, 1978). There is no question that verbal input to young children
For the three children who imitated some function must be simplified in terms of its relational and referential
words, the pattern is clear. Including function words in the content, its vocabulary, and its grammatical structure to ac-
prompt to imitate encouraged these children to produce them commodate the child’s likely comprehension weaknesses (cf.
along with the target semantic relation, demonstrating a level Leonard, 2009) and to maximize communication potential.
of language processing and, perhaps, ability that was not yet These simplifications often will result in incomplete phrases
observable from their spontaneous language. Excluding and even one-word utterances that may be viewed as prag-
function words in the prompts stripped the models of gram- matically appropriate, given the physical and discourse con-
matical features and virtually eliminated any probability that text (e.g., CookieMonster! a big one; (you) kicked it again;
the children would use a function word in their response to my spoon, not yours). When considered along with the evi-
the stimulus. dence presented in our introduction, however, our results
provide compelling evidence that these simplifications should
not compromise the boundaries of grammatical acceptability.
Study Limitations More specifically, simplifications of adult input to young
There are limitations of the study that must be con- children should not involve removal of obligatory grammatical
sidered when interpreting the outcomes and considering their functors from target utterances. It appears that such modifi-
implications. First, the first author (SLB) also served as the cations are not likely to make adult messages more compre-
examiner who delivered the prompts and may have shown hensible or repeatable, and they may complicate processing.
bias in her response to the participants. Reliability checks More directly, our results show that removal of grammatical
were undertaken involving a listener who was blind to the morphology from adult models robs the child of opportuni-
study questions and hypotheses; however, using a trained ties to detect, process, and learn to use free and bound gram-
clinician who was unaware of the study’s hypotheses would matical morphemes, some of which provide children with
have strengthened the design and reduced or eliminated bias. their greatest language learning challenges (Hadley et al.,
Second, it is possible that the addition of corrective 2011; Leonard et al., 2004, 2006; Rice & Wexler, 1996).
prompts for P4 and P5 resulted in a different pattern of Therefore, it now seems legitimate to hold fully gram-
responses from the first three participants. This possibility matical prompts as the default evidence-based option in child
seems unlikely, however, for two reasons: (a) the change to language interventions that call for the use of prompts for

24 American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014


verbal imitation. Special justification should be required for recommend that SLPs avoid—and teach parents to avoid—
the use of imitative prompts that are telegraphic in form. For the use of ungrammatical or telegraphic speech when talking
example, an evidence-based clinician could have internal to young children at any stage of development.
evidence that a particular child responds better to telegraphic
than to grammatical models. In such situations, continued use
Acknowledgments
of telegraphic models could be justifiable and appropriate.
This raises questions about how to teach parents to This study was supported by National Institute of Child
Health and Human Development Center Grant P030 NICHD HD
simplify their language to young children in ways that will 002528. We gratefully acknowledge Erin Schmitt for her contribu-
maintain grammaticality and facilitate development without tions, and we thank the families who participated. This article is
potentially producing negative side effects. We have three based on the doctoral dissertation of the first author. Data were pre-
related suggestions. viously presented in a poster session at the June 2013 Symposium
on Research in Child Language Disorders, Madison, WI.
1. Talk about the toys your child is interested in and what
the toys are doing. Toy talk (Walsh, 2010) is about
things that are interesting to the child. It naturally tends References
to be simple but grammatical. Toy talk is also good Bain, B. A., & Olswang, L. B. (1995). Examining readiness for
because it naturally increases the numbers of sentences, learning two-word utterances by children with specific expressive
in English, that contain subject–verb structure and sen- language impairment: Dynamic assessment validation. American
tences in the third-person singular, present tense (e.g., Journal of Speech-Language Pathology, 4, 81–91.
The farmer is driving the truck. He likes to drive. He goes Barlow, D., & Hersen, M. (1984). Single-case experimental designs:
everywhere.; Hadley et al., 2011). In typical parent–child Strategies for studying behavior for change (2nd ed.). New York,
NY: Pergamon Press.
play interactions, these types of sentences do not occur
Barlow, D., Nock, M., & Hersen, M. (2009). Single case experimental
very often. designs: Strategies for studying behavior for change (3rd ed.).
Boston, MA: Pearson.
2. Be grammatical. If you attempt to simplify your Bedore, L. M., & Leonard, L. B. (2001). Grammatical morphology
message, ask whether your words would sound okay to deficits in Spanish-speaking children with specific language
other adults in very informal situations. If the answer impairment. Journal of Speech, Language, and Hearing Research,
is no and your message sounds like something that would 44, 905–924.
be unacceptable for adults in a relaxed context, you Bulté, I., & Onghena, P. (2008). An R package for single-case
may have crossed the line between what is simple but randomization tests. Behavior Research Methods, 40, 467–478.
grammatical and what is ungrammatical. Dromi, E., Leonard, L. B., & Shteiman, M. (1993). The grammatical
morphology of Hebrew-speaking children with specific language
3. Avoid simple formulas for making speech to your impairment: Some competing hypotheses. Journal of Speech and
child more complex or simpler. For example, some Hearing Research, 36, 760–771.
programs coach parents to increase or decrease Edgington, E. S., & Onghena, P. (2007). Randomization tests
(4th ed.). Boca Raton, FL: Taylor & Francis Group.
the complexity of utterances to their children by
Eyer, J. A., Leonard, L. B., Bedore, L. M., McGregor, K. K.,
adding or taking away “one word.” This is a nice, Anderson, B., & Viescas, R. (2002). Fast mapping of verbs by
simple rule, but it invites ungrammatical models. For children with specific language impairment. Clinical Linguistics
example, using the one-word rule, the request, get a & Phonetics, 16, 59–77.
cookie, could be simplified to get one or a cookie; both Fenson, L., Marchman, V., Thal, D., Dale, P., Reznick, J., &
of which are acceptable. Unfortunately, it could also Bates, E. (2007). MacArthur–Bates Communicative Development
be shortened to get cookie, which no adult or language Inventories: User’s guide and technical manual (2nd ed.). Baltimore,
competent child or youth would say in any likely MD: Brookes.
setting. Fernald, A., & Hurtado, N. (2006). Names in frames: Infants inter-
pret words in sentence frames faster than words in isolation.
In this study, we considered the transitional develop- Developmental Science, 9, F33–F40.
mental period from producing mostly single words to pro- Fey, M. E. (2008). The (mis-)use of telegraphic input in child lan-
ducing semantic relations. Our results indicated that reducing guage intervention. Revista de Logopedia, Foniatria y Audiologia,
28, 218–230.
adult sentences to the point of being ungrammatical offered Fey, M. E., & Loeb, D. F. (2002). An evaluation of the facilitative
no benefit to any of the children, whereas prompting with effects of inverted yes-no question on the acquisition of auxiliary
longer, grammatically complete sentences led to more com- verbs. Journal of Speech, Language, and Hearing Research,
plete processing of grammatical functors for three of the 45, 160–174.
children. Given these findings, it seems unlikely that the use Fey, M. E., Yoder, P. J., Warren, S. F., & Bredin-Oja, S. L. (2013).
of telegraphic input would lead to better outcomes for children Is more better? Milieu communication teaching in toddlers
at higher levels of language development who are actively with intellectual disabilities. Journal of Speech, Language, and
Hearing Research, 56, 679–693. doi:10.1044/1092-4388(2012/
engaged in the acquisition of English grammatical morpho- 12-0061)
syntax. Previous research has shown that very young chil- Fisch, G. S. (2001). Evaluating data from behavioral analysis:
dren rely on information found in grammatically complete Visual inspection or statistical models? Behavioural Processes,
sentences long before they produce them. Therefore, we 54, 137–154.

Bredin-Oja & Fey: Children’s Responses to Prompts 25


Hadley, P. A., Rispoli, M., Fitzgerald, C., & Bahnsen, A. (2011). Miller, J., & Iglesias, A. (2006). SALT: Systematic Analysis of
Predictors of morphosyntactic growth in typically developing Language Transcripts (Version 9) [Computer software]. Madison,
toddlers: Contributions of parent input and child sex. Journal of WI: University of Wisconsin-Madison, Waisman Center,
Speech, Language, and Hearing Research, 54, 549–566. Language Analysis Laboratory.
Hancock, T. B., & Kaiser, A. P. (2006). Enhanced milieu teaching. Olguin, R., & Tomasello, M. (1993). Twenty-five-month-old chil-
In R. McCauley & M. Fey (Eds.), Treatment of language dren do not have a grammatical category of verb. Cognitive
disorders in children: Communication and language intervention Development, 8, 245–272.
series (pp. 203–236). Baltimore, MD: Brookes. Olswang, B. A., Bain, B. A., & Johnson, G. A. (1992). Using dynamic
Hayes, A. F. (1996). Permutation test is not distribution-free: assessment with children with language disorders. In S. F. Warren
Testing H0: r = 0. Psychological Methods, 1, 184–198. & J. Reichle (Eds.), Causes and effects in communication and
Hayes, S. C., Barlow, D. H., & Nelson-Gray, R. O. (1999). The language intervention (pp. 187–215). Baltimore, MD: Brookes.
scientist practitioner: Research and accountability in the age of Onghena, P., & Van Damme, G. (1993). Single-case randomization
managed care (2nd ed.). Boston, MA: Allyn & Bacon. tests ( Version 1.1) [Computer software]. Boca Raton, FL:
Höhle, B., & Weissenborn, J. (2003). German-learning infants’ Taylor & Francis Group.
ability to detect unstressed closed-class elements in continuous Rice, M. L., & Wexler, K. (1996). Toward tense as a clinical marker
speech. Developmental Science, 6, 122–127. of specific language impairment in English-speaking children.
Höhle, B., Weissenborn, J., Kiefer, D., Schulz, A., & Schmitz, M. Journal of Speech and Hearing Research, 39, 239–257.
(2004). Functional elements in infants’ speech processing: The Rispoli, M., Hadley, P. A., & Holt, J. K. (2012). Sequence and
role of determiners in the syntactic categorization of lexical system in the acquisition of tense and agreement. Journal of
elements. Infancy, 5, 341–353. Speech, Language, and Hearing Research, 55, 1007–1021.
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Roid, G. H., & Miller, L. J. (1997). Leiter International Performance
Wolery, M. (2005). The use of single-subject research to identify Scale—Revised. Wood Dale, IL: Stoelting.
evidence-based practice in special education. Exceptional Children, Scherer, N. J., & Olswang, L. B. (1989). Using structured discourse
71, 165–179. as a language intervention technique with autistic children.
Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Journal of Speech and Hearing Disorders, 54, 383–394.
Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Shi, R., Marquis, A., & Gauthier, B. (2006). Segmentation and rep-
Single-case design technical documentation. Version 1.0 (Pilot). resentation of function words in preverbal French-learning infants.
Retrieved from http://ies.ed.gov/ncee/wwc/pdf/reference_resources/ In D. Bamman, T. Magnitskaia, & C. Zaller (Eds.), Proceedings
wwc_scd.pdf of the 30th Annual Boston University Conference on Language
Leonard, L. B. (2009). Is expressive language disorder an accurate Development (Vol. 2, pp. 549–560). Somerville, MA: Cascadilla.
diagnostic category? American Journal of Speech-Language Smith, L. L. (1973). Comprehension performance of oral deaf and normal
Pathology, 18, 115–123. hearing children at three stages of language development (Unpublished
Leonard, L. B., & Bortolini, U. (1998). Grammatical morphology doctoral dissertation). University of Wisconsin–Madison.
and the role of weak syllables in the speech of Italian-speaking Stone, W., Conrod, E., Turner, L., & Pozdol, S. (2004). Psycho-
children with specific language impairment. Journal of Speech, metric properties of the STAT for early autism screening.
Language, and Hearing Research, 41, 1363–1374. Journal of Autism and Developmental Disorders, 34, 691–701.
Leonard, L. B., Camarata, S., Brown, B., & Camarata, M. (2004). Suen, H. K., & Ary, D. (1989). Analyzing quantitative behavioral
Tense and agreement in the speech of children with specific observation data. Mahwah, NJ: Erlbaum.
language impairment: Patterns of generalization through inter- Theakston, A. L., & Lieven, E. V. M. (2008). The influence of dis-
vention. Journal of Speech, Language, and Hearing Research, course context on children’s provision of auxiliary BE. Journal
47, 1363–1379. of Child Language, 35, 129–158.
Leonard, L. B., Camarata, S., Pawłowska, M., Brown, B., & Theakston, A. L., Lieven, E. V. M., & Tomasello, M. (2003). The
Camarata, M. (2006). Tense and agreement morphemes in the role of the input in the acquisition of third person singular verbs
speech of children with specific language impairment during in English. Journal of Speech, Language, and Hearing Research,
intervention: Phase 2. Journal of Speech, Language, and Hearing 46, 863–877.
Research, 49, 749–770. Todman, J. B., & Dugard, P. (2001). Single-case and small-n
Leonard, L. B., & Deevy, P. (2011). Input distribution influences experimental designs: A practical guide to randomization tests.
degree of auxiliary use by children with specific language im- Mahwah, NJ: Erlbaum.
pairment. Cognitive Linguistics, 22, 247–273. Tomasello, M., & Olguin, R. (1993). Twenty-three-month-old chil-
Leonard, L. B., Deevy, P., Miller, C. A., Rauf, L., Charest, M., & dren have a grammatical category of noun. Cognitive Develop-
Kurtz, R. (2003). Surface forms and grammatical functions: Past ment, 8, 451–464.
tense and passive participle use by children with specific van Kleeck, A., Schwarz, A. L., Fey, M. E., Kaiser, A. P., Miller, J.,
language impairment. Journal of Speech, Language, and Hearing & Weitzman, E. (2010). Should we use telegraphic or grammatical
Research, 46, 43–55. input in the early stages of language development with children
Leonard, L. B., Eyer, J. A., Bedore, L. M., & Grela, B. G. (1997). who have language impairments? A meta-analysis of the research
Three accounts of the grammatical morpheme difficulties of and expert opinion. American Journal of Speech-Language
English-speaking children with specific language impairment. Pathology, 19, 3–21. doi:10.1044/1058-0360(2009/08-0075)
Journal of Speech, Language, and Hearing Research, 40, 741–753. Vygotsky, L. (1978). Mind in society: The development of psycho-
Loeb, D. F., & Armstrong, N. (2001). Case studies on the efficacy logical processes. Cambridge, MA: Harvard University Press.
of expansions and subject-verb-object models in early language Walsh, K. (2010). Toy talk: A simple strategy to promote richer
intervention. Child Language and Teaching Therapy, 17, 35–53. grammatical input (Master’s thesis). University of Illinois, Urbana-
MacDonald, J. D., & Blott, J. P. (1974). Environmental language Champaign. Retrieved from http://hdl/handle.net/2142/16862
intervention: The rationale for a diagnostic and training strategy Willer, B. (1974). Reduced versus nonreduced models in language
through rules, context, and generalization. Journal of Speech training of MR children. Journal of Communication Disorders,
and Hearing Disorders, 39, 244–256. 7, 343–355.

26 American Journal of Speech-Language Pathology • Vol. 23 • 15–26 • February 2014


Copyright of American Journal of Speech-Language Pathology is the property of American
Speech-Language-Hearing Association and its content may not be copied or emailed to
multiple sites or posted to a listserv without the copyright holder's express written permission.
However, users may print, download, or email articles for individual use.

You might also like