Training Peers To Teach Reading Comprehension To Students

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 17

Education and Training in Autism and Developmental Disabilities, 2022, 57(4), 430–445

© Division on Autism and Developmental Disabilities

Training Peers to Teach Reading Comprehension to Students


with Extensive Support Needs
Robert C. Pennington, Shawnee Wakeman, Alicia F. Saunders, and
Brett M. Cerrato
University of North Carolina at Charlotte

Abstract : In the current study, we taught three middle school peers without disabilities to implement a commer-
cially available literacy program with students with extensive support needs (ESN). Our teaching package
included behavior skills training, ongoing feedback, and visual supports. We employed a multiple probe across
participants design to evaluate the efficacy of the training package. Data indicated it was effective in improv-
ing the peers’ performance. Further, the majority of participants reported favorable perceptions of the peer imple-
mented package.

The expectations for high quality educational delivery of programs by educators in typical
programs for students with extensive supports school settings.
needs (ESN) have been steadily increasing Unfortunately, the research literature indi-
over the last several decades (Spooner & cates that teachers may struggle with the
Browder, 2015). Students with ESN receive implementation of high-quality academic
special education services under the eligibility instruction for students with ESN. Data indi-
categories of intellectual disability, autism, cate these students are provided few opportu-
and multiple disabilities and, due to their per- nities to respond and often are passively
vasive and significant support needs, are often engaged during academic instruction (Kurth
eligible to take their state’s alternate assessment et al., 2016; Pennington & Courtade, 2015).
(Taub et al., 2017). Legislative mandates and One potential barrier to effective instruc-
legal actions have repeatedly nudged the pro- tional delivery may be challenges associated
verbial bar higher for teachers of students with with teacher to student ratios. The majority of
ESN, first calling for increased access to and the research literature on teaching academic
ultimately, requiring that all students make pro- content to students with ESN reflects instruc-
gress within the general education curriculum tion delivered in 1:1 or small group instruc-
(Endrew F. v. Douglas County School District, 2017; tional arrangements (e.g., Spooner et al.,
Every Student Succeeds Act, 2015). Further, a 2019). These arrangements are often neces-
flourishing body of research has emerged dem- sary for the delivery of frequent opportunities
onstrating the efficacy of systematic interven- to respond, response prompts, and feedback,
tion techniques in teaching students with ESN but may be difficult to implement when
to acquire increasingly complex academic skills instructional staff resources are low. As teach-
(e.g., Knight et al., 2013; Spooner et al., 2012: ers deliver 1:1 or small group academic
Walker et al., 2020). This extension of educa- instruction, other students may be required
tional expectations reflects a potentially power- to work independently. This shuffling of
ful turning point in the lives of students with teaching staff and students may result in peri-
ESN, if it can be realized within the actual ods of weaker instructional opportunities,
especially when students have fewer inde-
pendent working skills or exhibit problem
Robert Pennington, Cato College of Education,
behavior.
Department of Special Education and Child Deve- One potential solution involves recruiting
lopment, University of North Carolina at Charlotte, peers to support students with ESN during
9201 University City Blvd., Charlotte, NC. 28223-0001. instruction (Jimenez et al., 2012). Researchers
E-mail: Robert.pennington@uncc.edu have suggested that when receiving instruction

430 / Education and Training in Autism and Developmental Disabilities


alongside peers without disabilities, students Further, peers have been used to support in-
with ESN may be more likely to have richer aca- struction in both special education and general
demic experiences (Carter et al., 2005; Ruppar education environments (Fetko et al., 2013;
et al., 2018). In a recent review of 11 studies, McCurdy & Cole, 2014).
Brock and Huber (2017) focused on the use of To date, a large portion of the research lit-
peer support arrangements and found promis- erature on peer delivered academic instruc-
ing evidence that these arrangements may facil- tion for students with ESN primarily has
itate academic engagement. Further, they involved training peers to deliver simple
determined peer support arrangements to be prompting and feedback procedures (e.g.,
an evidence-based practice for promoting inter- instructive feedback and simultaneous prompt-
actions between students with and without ing [Fetko et al., 2013], system of least prompts
ESN in general education settings. Overall, [Collins et al., 2001; Hudson et al., 2014]).
they reported peer supports facilitated in- These evidence-based procedures are powerful
creases in social interaction across 82 middle but require a small number of steps for imple-
and high school students with ESN. mentation (i.e., notice or present a target stimu-
Researchers have employed behavior skills lus, wait during a response interval, deliver a
training (BST; Parsons & Reed, 1995) to train prompt and/or feedback; Collins et al., 2018).
peers to provide instruction and supports to The limited number of teaching behaviors
students with ESN. BST procedures include required during response prompting and the
providing directions, modeling, and opportu- repeated practice of these behaviors during ev-
nities for rehearsal and feedback. It has been ery instructional trial may facilitate high levels
used to teach peers to implement abduction of procedural fidelity.
prevention training (Tarasenko et al., 2010), Over the last few decades, researchers have
teach soccer skills (Chambers & Radley, embedded response prompting strategies into
2020), and engage in interactive play (Covey more complex, scripted curricula designed to
et al., 2021). Further, researchers have used teach grade-aligned skills to students with ESN
it to train peers to provide academic supports resulting in increased student outcomes. For
to students with ESN (e.g., Kamps et al., example, Browder and colleagues (2008) de-
1989). signed and demonstrated the effectiveness of
The use of peer-supported academic in- an instructional package for teaching early lit-
struction for students with ESN is not new. eracy skills to students with ESN. The package
Researchers have taught peers to support consisted of scripted lessons, adapted literacy
academic instruction for students with ESN materials, and response prompting strategies
across a range of academic skills. For exam- to teach phonemic awareness, phonological
ple, Collins et al. (2001) taught peers to use awareness, comprehension, and writing. Since
the system of least prompts to support three then, numerous instructional packages have
students with ESN in writing letters in a sec- emerged across content areas including sec-
ondary composition class. All three students ondary literacy (e.g., Browder et al., 2015),
increased their use of letter components follow- early numeracy skills (e.g., Jimenez et al.,
ing the peer-supported intervention. Similarly, 2013), and science (e.g., Knight et al., 2013).
Fetko and colleagues (2013) taught peers to These instructional packages afford students
teach science facts to three middle school stu- with ESN new opportunities to access grade-
dents with ESN by delivering nontargeted infor- aligned academic curricula, while providing
mation during instruction on a leisure skill. All teachers with prepared adapted materials and
three students improved performance on the scripted guidance for supporting their stu-
leisure skill and two acquired grade-level sci- dents. The effectiveness of these instructional
ence concepts. Researchers have demonstrated packages may be enhanced by delivery in 1:1 or
the efficacy of peer supports in improving out- small group arrangements in which teachers
comes in other academic areas including read- may be able to provide more opportunities for
ing comprehension (Hudson & Browder, 2014; individual students to practice skills and receive
Hudson et al., 2014), spelling (McDonnell et feedback.
al., 2000), science vocabulary (Jimenez et al., In the current study, we used a comprehensive
2012) and mathematics (Heinrich et al., 2016). grade-aligned curriculum, Teaching to Standards

Training Peers / 431


ELA, which was previously evaluated with 15 mid- strategy (e.g., constant time delay for vocabulary
dle school students with moderate to severe instruction, direction instruction for teaching
disabilities across five teachers in self-contained story elements, and the system of least prompts
settings (Mims et al., 2012). The curriculum for listening comprehension), with students
used systematic instruction, specifically the with ESN. This study served to pilot our peer
response prompting strategies of constant time training methods, which would serve as a part
delay and a modified system of least prompts, of a federally funded multi-year model demon-
and direct instruction to teach acquisition of lit- stration project. We addressed the following
eracy skills, including: (a) vocabulary and their research question: Is there a functional relation
definitions; (b) comprehension of narrative, between the use of a peer training package (i.e.,
informational texts, and poetry; (c) writing skills; behavior skill training, ongoing feedback, visual
and (d) research skills. Other student materials supports) and the percent of accurate instruc-
included vocabulary cards, graphic organizers tional steps implemented by peers without
(e.g., story map and T-chart), individualized disabilities? Though not a primary research
response options, a writing journal, and adapted question, we also collected data on students’
grade level content with visual supports. Teach- with ESN responding to comprehension
ers were provided with a thematic unit on questions before and following the introduc-
“change” with eight scripted lessons (five related tion of peer training.
to fiction, one related to an informational text,
one related to a poem or play, and one related
to research). Using a one-group, nonrandom- Method
ized, pre-posttest design, results showed signifi-
cant gains in vocabulary and comprehension of Participants
familiar texts.
Unfortunately, the feasibility of these small Three 8th grade female students without dis-
group or 1:1 instructional arrangements is again abilities (Maggie, Diane, Casey), referred to
impacted by high student to teacher ratios. In as peers, delivered reading instruction to stu-
light of this potential obstacle and a body of dents with ESN. All three peers had applied
peer support research focusing on a limited and competed to participate in the school’s
number of strategies for supporting students peer buddy program and received a course
with ESN, there is a need to evaluate whether grade for their participation. The peers had
peers can effectively implement scripted aca- worked with the students with ESN since the
demic curricula including multiple evidence- school year started, either implementing 1:1
based instructional components (e.g., constant instruction in the self-contained classroom or
time delay; system of least prompts). Two studies supporting them in inclusive electives (e.g.,
have evaluated the effects of peer-delivered sys- art, chorus, physical education). As a part of
tem of least prompts and adapted grade-level the program, peers were provided with gen-
read alouds (Hudson & Browder, 2014; Hudson eral information on disabilities (e.g., defining
et al., 2014). In both studies, students with mod- a disability, general supports) and given tasks
erate intellectual disability made gains in listen- to work on with their peer mentees, but they
ing comprehension outcomes. Although not a did not receive formalized training on effec-
primary dependent variable, procedural fidelity tive teaching strategies. Peers spent the 90
was measured and peers delivered the system of min block with a student with ESN in one or
least prompts for answering comprehension both settings depending on the daily schedule
questions with 95% fidelity or more. Both stud- (i.e., A day/B day rotation).
ies noted the extensive amount of time it took Three middle school students, ages 14 and
to develop the materials, which were researcher- with ESN also participated in the study. All
created, as a limitation and recommended using three students were identified as students who
novels that had already been adapted. In the had reading comprehension goals on their
current investigation, we used BST to train peers IEPs. Charlie was a White male, in the sixth
to implement a comprehensive ELA scripted grade and met educational eligibility for intel-
curriculum (Teaching to Standards ELA; Mims lectual disability. Charlie was a non-reader
et al., 2013), using more than one teaching and used picture supported text for all sight

432 / Education and Training in Autism and Developmental Disabilities-December 2022


words and key words within the adapted text. scripted lesson from the teacher’s guide was
He used speech as his primary mode of com- adapted with visual supports (e.g., a stop sign)
munication. Charlie’s peer was Diane. Fay was to signal to the peer when to embed the ques-
a White female, in the seventh grade and also tion within reading the chapter. Each chapter
met educational eligibility for intellectual dis- consisted of eight questions: two literal recall,
ability. Fay’s peer was Casey. Micki was a White one inferential, one story element (i.e., charac-
female, in the Eighth grade and also met edu- ter, setting, problem, or solution), one predic-
cational eligibility for intellectual disability. tion, one sequencing, and two vocabulary
Micki’s peer was Maggie. Both Fay and Micki questions. Cards for the story elements and
were emergent readers who could recognize sequencing were placed on graphic organizers
sight words and read simple sentences. They (i.e., a T-chart, a story map) by students during
both also used speech as their primary mode of each lesson. In addition to the commercially
communication. All three students participated available materials, we created three visual
in the state’s alternate assessment. prompt cards with steps for teaching vocabu-
lary and literal and inferential comprehension
(See Figure 1) as supports for use during
Setting
instruction if needed. A procedural fidelity
We conducted the study in a middle school in checklist was used to collect implementation
a suburban school district in the southeastern data (see Figure 2).
United States. The school comprised nearly
1,500 students of which 12% were enrolled
Dependent Variables and Data Collection
in free or reduced lunch programs. All peer
training sessions were conducted in a school During baseline and peer training conditions,
library or a self-contained classroom in a one- we collected data on the percent of correct
one arrangement. We trained peers over two steps implemented by peers using a procedural
consecutive days in 45 min sessions. Peer fidelity checklist (see Figure 2). A member of
mediated instruction sessions were conducted the research team collected data during obser-
in either the special education classroom or vations in vivo or via a video recording. During
in the school library at a small table (due to each session, we scored the accurate implemen-
noise or disruptive behaviors), and in a 1:1 tation of (a) vocabulary instruction using
arrangement with the peer sitting directly across constant time delay (CTD; 16 steps); (b) pre-
from the student with ESN. Sessions lasted sentation of attentional cues, questions, and
approximately 20 to 30 min and occurred three feedback in the correct sequence as indicated
to four times a week. by the script questions (9 steps); (c) pointing
to the text or promoting the peer to point to
Materials the text (9 steps); and (d) the system of least
prompts (SLP) following comprehension ques-
We taught peers to implement an adaptation tions (1-6 steps per question). The total num-
of a scripted instructional package (i.e., Teach- ber of steps varied contingent on the student’s
ing to the Standards: ELA; Mims et al., 2013). responding. For example, if a student emitted
The commercial materials included a teacher’s multiple errors in response to a comprehen-
guide, a student response book, and a reader sion question, the peer would have more
that included the adapted novel (The Outsiders), opportunities to emit prompts. A step was
graphic organizers (T-chart, story map), vocab- considered correct if it was implemented accu-
ulary cards, and teaching activity cards. Each rately and in the correct sequence. We deter-
lesson began with the presentation of vocabu- mined percent correct by dividing the number
lary words and definitions which were taught of instructional steps implemented correctly,
using constant time delay. Scripted lessons with including prompting, by the total number of
the curriculum included a read aloud of the steps possible, and then multiplied by 100.
chapter with a repeated story line and specified Though not a focus of the investigation, we
questions from the text with three picture and also collected data on students’ with ESN cor-
text response options provided if needed. The rect responses to comprehension questions

Training Peers / 433


Figure 1. Sample CTD and SLP Cards for Peer Instructors.

during the reading instruction. Following each agreement (IOA) using a total count method,
lesson, the participants were asked to complete dividing the smaller number of peer behaviors
an eight-question comprehension assessment by the larger and then multiplying by 100. For
presented on a printed worksheet. Each ques- Maggie who was paired with Micki, we collected
tion was presented along with three response IOA data for 40% of baseline and 50% of inter-
options. A correct response was defined as ventions sessions. Mean IOA for baseline and
marking the correct response option on the intervention sessions was 93% (86-100%) and
worksheet. 95% (90-98%), respectively. For Diane who was
A second observer collected dependent vari- paired with Charlie, we collected IOA data for
able reliability data across baseline and train- 40% of baseline and 60% of interventions ses-
ing conditions. We calculated interobserver sions. Mean IOA for baseline and intervention

434 / Education and Training in Autism and Developmental Disabilities-December 2022


Figure 2. Fidelity Checklist for Peer-Implemented Vocabulary and Comprehension Instruction.

sessions was 91% (88–93%) and 89% (86– Experimental Design


93%), respectively. For Casey who was paired
with Fay, we collected IOA data for 60% of base- We used a concurrent multiple probe across
line and 50% of interventions sessions. IOA for participants (Horner & Baer, 1978) to evalu-
baseline and intervention sessions was 89% ate the efficacy of our training package. Prior
(77–100%) and 92% (91–93%), respectively. to introducing training to the first peer, we

Training Peers / 435


conducted at least three baseline probes and specific feedback related to observed
across all three peers. Subsequently, we intro- errors. Once the peer instructors implemented
duced training to each peer, one at a time, steps with 90% accuracy or higher, they deliv-
following increased accuracy by the previous ered instruction to students with ESN. Peer
peer. We set a criterion of at least a 20% training was completed in two 45 min sessions.
increase in participant responding over base-
line levels prior to introducing intervention Post Training with Feedback. After each instru-
to the next participant. Further, since we ctional session, a researcher met to provide
implemented the intervention pilot study at feedback to the peer regarding implementa-
the end of the school year, we had a limited tion of the lesson as well as an opportunity to
number of days to complete the investigation. answer any questions the peer had. Initial
As a result, we permitted participants to enter feedback provided to peers was often related
intervention after only one or two sessions of to the organization of materials and the
the previous participant meeting the 20% results of the fidelity with corrective feedback
increase criterion. (with modeling and rehearsal if needed).
Feedback evolved over time to include how to
Procedure increase student engagement and provide
specific positive feedback to the student.
Baseline Sessions. Prior to the first baseline
session, we provided peers with a copy of the Description of Peer-mediated Instruction. During
modified script to review prior to implemen- peer-mediated instruction, peers implemented
tation and provided them with an opportunity a complete Teaching to the Standards lesson.
to ask questions. During baseline sessions, we Peers used CTD to pre-teach lesson vocabulary
provided peers with materials and a directive and then delivered a read aloud of an adapted
to follow the scripted lesson. The peers deliv- chapter. During the read aloud, they pre-
ered instruction without interruption or feed- sented embedded comprehension questions
back from the researcher. At the completion and used the SLP procedure to facilitate stu-
of the session, the researcher provided gen- dent responding.
eral praise to the peer (e.g., “Nice job”). During the pre-teaching of vocabulary, the
peer presented vocabulary in a single round in
which they showed the student the word paired
Peer Training (BST). Following baseline ses- with the picture and immediately read the word
sions, we trained peers to implement the and its definition. The peer then presented an
scripted lessons. On the first day, we intro- opportunity for the student to identify vocabulary
duced the materials, trained peers on using words from a field of three words. The peer first
the SLP to teach comprehension, modeled presented 0 s delay trials, in which immediately
how to implement the scripted lesson, and pro- following the request to identify the word, they
vided time for the peer to practice with feed- pointed to the correct picture and provided feed-
back. On the second day, we trained peers to back following the students’ prompted response.
implement CTD to teach vocabulary, practiced The peer directed the student to touch a target
again with feedback, and then conducted a fi- vocabulary word and waited 4 s for the student to
delity check. During these initial training days, respond. If the student responded correctly
we used behavioral skills training (BST; Par- before the prompt, the peer delivered behavior
sons & Reed, 1995) which involved a member specific praise and read the definition (e.g., “Yes,
of the research team providing a rationale and that is ____! ___ means ____.”). If the student did
directions for using the scripted curriculum, not respond or made an error, the peer pointed
modeling the use of the lesson materials, pro- to the target word, stated the word and its defini-
viding an opportunity for peer instructors to tion, and praised the student’s prompted
rehearse each component, and providing feed- response. Between each trial, the peer rotated
back. In addition, at the completion of each the position of the words. Finally, students were
session, a researcher provided at least one presented opportunities to identify vocabulary in
praise statement related to the peer’s teaching response to a spoken definition. Again, the peer

436 / Education and Training in Autism and Developmental Disabilities-December 2022


presented the target antecedent (i.e., definition) back to a page in the story, (b) read the sen-
and waited 4 s for the student to respond. If the tence containing the answer, (c) model the
student responded correctly before the prompt, correct response by reading the sentence
the peer delivered behavior specific praise. If the and pointing to the correct column, and (d)
student did not respond or made an error, the prompting the student to place the picture
peer pointed to the target word, stated the word, in the correct column. Finally, peers pre-
and praised the student’s prompted response. sented a story map and three event cards and
After vocabulary instruction, peers deliv- asked students to sequence the events. For
ered the read aloud of the chapter using the this activity, the prompt levels were the same as
modified teacher script, pausing at a visual for the T-Chart activity. Again, if the student
stop sign prompt to ask one comprehension responded correctly following any prompt, the
question. Initially, the peer presented a ques- peer provided positive feedback.
tion to the student and waited for a response.
If the student did not respond within 4 s, the
peer presented a response board with three pic- Social Validity
tured options. If the student responded by stat- We collected social validity data from the
ing or touching the correct response, the peer peers and students with ESN. For the peers,
provided behavior specific praise, and when we administered a survey with six items to
possible, pointed to the text from where the which they could respond with a yes, no, or
response came. If the student made an error or maybe. The items were (a) I learned new ways
did not respond, the peer presented the next
to teach students with learning differences,
prompt in a prompt hierarchy. The prompt
(b) I can now do a better job supporting stu-
levels for literal comprehension questions were
dents with learning differences, (c) I like the
as follows (a) present a response board; (b)
new strategies I learned, (d) I like to work
direct student to look back at the section of text
with _______, (e) I hope to continue teaching
containing the answer; (c) read a 1-3 sentence
students with learning differences next year,
excerpt of text containing the answer; (d) point
and (f) I think I could use these new strat-
to the answer in the text; (e) physically prompt
egies with other students in special education
student to point to the answer in the text; and
class. For the students with ESN, the class-
(f) physically prompt student to touch the an-
room teacher read to them five yes/no ques-
swer on the response board. For inferential
tions presented on a questionnaire: (a) Do
questions, the prompt levels were as follows:
you like working with (peer instructor), (b)
(a) present response board; (b) direct stu-
dent to look back at the section of text con- Does (peer instructor) help you with your
taining a clue; (c) reread an area(s) of text work, (c) Do you help (peer instructor) with
that contains clues for responding; (d) emit a her work, (e) Do you want to keep working
think aloud statement connecting the text with (peer instructor), and (f) Do you like
and the response option; (e) model the think learning in (classroom teacher’s) class? The
aloud of the answer; and (f) physically students responded by pointing to word “yes”
prompt students to touch the answer on the or “no” under each question or by vocally stat-
response board. If the student responded cor- ing the answer.
rectly following any prompt, the peer pro-
vided behavior specific praise and moved on Data Analytic Procedures
to the next question.
Comprehension instruction related to iden- We relied on visual analysis to determine if a
tifying a character/setting/problem and solu- functional relation existed and the magnitude
tion, peers presented a T-chart and asked of the effect, using six criteria: (a) level, (b)
students to place picture cards in the appro- trend, (c) variability, (d) immediacy of effect,
priate column. For example, a peer would (e) overlap, and (f) consistency (Kratochwill
present a character depicted on a card and et al., 2010). To corroborate the visual analy-
ask a student to place the card in the “charac- sis findings, we used a single-case effect size
ter” or “not a character” column. For this activ- index, the between-case standardized effect
ity, the prompt levels were (a) refer the student size (BC-SMD; Pustejovsky et al., 2014) to

Training Peers / 437


calculate a between-subjects effect size esti- Diane
mate. We selected the BC-SMD analysis
because it is comparable to group design met- During baseline sessions, Diane implemented
instructional procedures with between 37.9
rics (e.g., Cohen’s d) and accounts for magni-
and 49.1% accuracy. Data indicated a relatively
tude of change from baseline to intervention;
stable and flat trend across the condition.
whereas, other single case nonoverlap techni-
Following training, there was an immediate
ques do not (e.g., percent of non-overlapping
increase in her accuracy (immediacy of effect)
data, Tau-U; Valentine et al., 2016). We used
which was sustained across the first four ses-
the BC-SMD calculator, which uses restricted
sions (75–95.5%). During the last session (dur-
maximum likelihood (REML) estimation (Pus-
ing the last week of school) there was a sharp
tejovsky et al., 2021). Our visual analysis find- decrease in accuracy to 61.8%. Finally, her ac-
ings led our decisions. For baseline, we curacy increased the most in the area of text
specified fixed effect and random effect for pointing (84%).
baseline level because this allows baseline
phases to be different from zero and to vary
across cases, respectively. For intervention, we Casey
specified fixed effect and random effect for During baseline sessions, Casey implemented
treatment level because there was a level instructional procedures with between 19.7
change from baseline to intervention, and this and 41.7% accuracy. Data indicated a relatively
was different across cases (Valentine et al., stable and flat trend across the condition.
2016). Following training, there was an immediate
increase in her accuracy (immediacy of
effect) which was sustained across three ses-
Results sions (82.8–100%). Again, there was a
decrease during the final session conducted
The data were illustrated two ways. Figure 3 during the last week of school (73.5%).
shows the percent accuracy for fidelity of imple- Finally, her accuracy increased the most in
mentation across peer instructors. Because the the area of vocabulary instruction, again
number of steps varied each session depending involving CTD (70%).
on student responding, the data also were
graphed to show a side-by-side comparison
between the number of steps performed cor- Between-case Standardized Effect Size Analysis
rectly to the total number of steps possible Using the Pustejovsky et al. (2021) online BC-
across sessions (see Figure 4). SMD calculator, the estimated effect size was
3.62 (95% CI [1.1, 6.2]). This can be inter-
preted as a medium effect (Gierut et al.,
Maggie 2015), providing evidence the behavior skills
training with ongoing coaching produced a
During baseline sessions, Maggie implemented meaningful change in peer instructors’ imple-
instructional procedures with between 34.7 mentation of the curriculum.
and 63.4% accuracy. Data indicated a stable
and gradually increasing trend across the con-
Student Outcomes
dition. Following training, there was an imme-
diate increase in her accuracy (immediacy of During baseline sessions, Micki answered com-
effect) which was sustained across the post- prehension questions with an average of 80.2%
training condition (87.2–100%). Finally, data accuracy (63 -100%). Following peer training,
related to the instructional components within she answered questions with an average of
the overall package (See Table 1) indicated 93.5% accuracy (75–100%). During baseline
that her accuracy increased the most in the sessions for Charlie, data indicated he answered
area of using CTD for vocabulary instruction comprehension questions with an average
(77%). of 45% accuracy (13–75%). Following peer

438 / Education and Training in Autism and Developmental Disabilities-December 2022


Figure 3. Peer Instructors’ Percentage of Accurate Implementation.

training, he answered questions with an average accuracy (88–100%). Following peer training,
of 72% accuracy (50–88%). During baseline ses- she answered questions with an average of 94%
sions for Fay, data indicated she answered com- accuracy (88–100%). This was a difference of
prehension questions with an average of 98% one question.

Training Peers / 439


Figure 4. Peer Instructors’ Number of Steps Performed Correctly Compared to the Total Number of Oppor-
tunities per Session.

Social Validity Discussion


All peers responded “Yes” to most items. In the current study, we investigated the effects
One responded “maybe” to the item I hope to of training peer instructors to implement a
continue teaching students with learning differ- commercially available ELA instructional pro-
ences next year. Micki responded “Yes” to ev- gram with students with ESN. These scripted
ery item. Fay responded “Yes” to every item packages are increasingly available and may
with one exception. She responded “no” to help educators as they can reduce time in ma-
Do you help (peer instructor) with her work? Charlie terial preparation, and when carefully de-
responded “Yes” to all items with two excep- signed, may support the implementation of
tions. He responded “no’ to the items: Does (peer effective practices by offering scripts for instruc-
instructor) help you with your work and Do you like tional delivery for students with diverse learn-
learning in (classroom teacher’s) class? ing needs. Further, their prescriptive format

440 / Education and Training in Autism and Developmental Disabilities-December 2022


TABLE 1
Mean Accuracy During Pre-and Post-Training Conditions Across Instructional Components

Vocabulary Following Script Text Pointing System of Least


Instruction Prompts

Pre- Post- Pre- Post- Pre- Post- Pre- Post-

Maggie 17 94 29 98 100 100 67 86


Diane 21 91 24 86 67 95 31 77
Casey 68 77 76 82 11 95 43 73

may facilitate implementation by a range of strategy, such as the system of least prompts
instructional change agents including peers (e.g., Hudson & Browder, 2014; Hudson et
without disabilities. al., 2014), and peers implemented with 95%
Overall, our findings suggest that BST with or higher fidelity. This study expanded those
the ongoing delivery of performance feedback findings by using peers to deliver an entire
was effective in improving the three peers’ per- commercially available scripted curriculum
formance. Prior to BST and coaching, peers which encompassed multiple instructional
implemented procedures with low to moderate strategies (i.e., CTD, system of least prompts,
levels of accuracy. Following the introduction of and direct instruction). The overall average
training and coaching, all three immediately level of fidelity was not as high as prior stud-
increased their accuracy of implementation. ies. There are two contributing factors to
In addition to visual analysis, the BC-SMD was cal- this. First, the fidelity checklist was far more
culated and a medium effect size was found (Pus- complex than in the prior studies using peers
tejovsky et al., 2021; Valentine et al., 2016). (see Figure 2), and coders were more strin-
Further, it was noted that baseline performance gent. Second, the intervention was more
across participants did not change following the complex, requiring the delivery of multiple
introduction of the package to other participants, instructional strategies. Peers did receive ongoing
thus, a functional relation was demonstrated. coaching on their implementation and improved
Prior to training, the peers’ implementation of across all instructional strategies from baseline to
the script varied across package components. For intervention. It is important to note that peers
example, Maggie and Diane scored lowest when had the scripts to use during baseline, and the
asked to use CTD to teach vocabulary, but Casey change from baseline to intervention shows the
implemented CTD with 63.3% accuracy. Simi- importance of needing training to implement
larly, Maggie implemented the SLP with 50% ac- these intervention programs effectively.
curacy, whereas Casey and Diane implemented All three peers indicated they enjoyed
the SLP with 35.5% and 34.5% accuracy, respec- working with their peers with ESN and using
tively. These differences may reflect the peers’ the package to teach reading. This may have
unique previous experiences in working with the contributed to the ease of the package imple-
students in other contexts or a lack of attendance mentation as students with ESN appeared
to or comprehension of the instructional pro- generally attentive and did not engage behav-
gram directions or script. Regardless, this finding iors that would be disruptive to instruction.
highlights the importance of training peers and These findings are consistent with previous
other instructional change agents on all essential investigations involving the use of peers to
elements of new instructional packages and pro- support academic instruction for students
viding ongoing coaching and support. with ESN (Hudson et al., 2014; Jimenez et al.,
These findings are consistent with those of 2012). Further, these peers volunteered to
previous investigations in that peers can be participate in the study suggesting a proclivity
trained to implement effective instructional to engage in activities to support those in
strategies with students with ESN. Prior stud- their school community with ESN. In addi-
ies have targeted one type of instructional tion, students with ESN reported they enjoyed

Training Peers / 441


working with their peers, but one participant study, we entered Maggie into our intervention
reported that they did not prefer their learn- condition despite having an increasing trend
ing environment and did not perceive their in baseline. Though we observed an immediate
peer to help them. It is possible that students’ change in level, it is possible that Maggie might
responses were influenced by a range of varia- have increased her fidelity over time with the
bles (e.g., understanding the question asked, script alone. Both Diane’s and Casey’s fidelity
researcher or peer status) that may have decreased during the last session, as they were
impacted the accuracy of their responses. focused on going to an eighth-grade celebra-
Researchers have established potentially more tion, but there were no additional days of
effective methods for assessing intervention school left to see if their fidelity would improve.
preferences that involve providing individuals We also only provided one peer with four
with choices between intervention compo- instructional sessions which is less than the
nents throughout the study (Hanley et al., recommended five per condition (Kratochwill
1997; Hardy et al., 2020). In the current study, et al., 2010), weakening our demonstration of
we might have provided students with inter- sustained impact. Due to students with ESN
mittent opportunities to choose whether to overall limited time in intervention condi-
work with a peer or their teacher. Unfortu- tions, it is difficult to determine the extent to
nately, we had a limited number of sessions and mechanisms by which comprehension
and could not provide these “choice” sessions, skills improved. Additionally, we were unable
but we recommend their application in future
to collect maintenance data to determine the
investigations.
extent to which peer’s would sustain perform-
Interestingly, we also collected data on the
ance after the package was terminated.
accuracy of students with ESN responses to
Finally, as mentioned above, the number of
comprehension questions. Two of the stu-
opportunities for peers to implement proce-
dents demonstrated overall improved per-
dural steps varied in response to student
formance following peer training, and one, a
responding. Therefore, graphed percentages
minor decrease in accuracy (98%-94% accu-
reflect varied numbers of opportunities. To
racy). The latter student experienced a ceil-
ing effect in baseline, performing at high increase transparency, we also reported data
levels of accuracy. Though these findings on the number of correct responses in rela-
should be viewed with caution and in the con- tion to opportunities (see Figure 4).
text of a limited number of instructional ses-
sions, they may reflect peers’ increased use of Implications for Practice and Future Research
critical instruction components during each
lesson (e.g., vocabulary instruction, SLP to The findings of this pilot investigation have sev-
teach comprehension, feedback). eral implications for practice. First, we demon-
strated that middle school students could
accurately implement a scripted instructional
Limitations package focused on teaching reading compre-
Despite our generally positive findings, several hension to students with ESN. We suggest that
limitations should be noted. Our research teachers capitalize on peer supports during
design was constrained by several variables that literacy instruction to maximize positive out-
were a result of the implementation of the comes for students with and without ESN,
study immediately prior to the end of the especially, in light of our findings suggesting
school year. Our attempt was to pilot proce- students with ESN enjoyed engaging in read-
dures prior to their use at the beginning of the ing instruction with their peers. Second, our
subsequent school year. As a result, there is findings suggest that some students may bene-
only one overlapping data point between the fit from scripted literacy instruction provided
second participant’s training condition and the by peers. In the current study, some students
third participant’s baseline condition, resulting appeared to benefit from training their peer
in a weakened capacity to detect covariation. As instructors. We suggest that if teachers
a result of our limited time to complete the employ peers to provide similar instruction,

442 / Education and Training in Autism and Developmental Disabilities-December 2022


they carefully monitor its effectiveness via peer-mediated behavioral skills training. Behav-
through continuous data collection. ior Analysis in Practice, 13(2), 454–461. https://doi.
Our findings also have implications for future org/10.1007/s40617-019-00381-2
research. We implemented procedures in a Collins, B. C., Branson, T. A., Hall, M., & Rankin,
controlled special education setting. We suggest S. W. (2001). Teaching secondary students with
moderate disabilities in an inclusive academic class-
that the package or at least essential features of
room setting. Journal of Developmental and Physical
the package (e.g., text pointing, SLP for answer-
Disabilities, 13(1), 41–59. https://doi.org/10.1023/
ing comprehension questions) can be imple-
A:1026557316417
mented in the general education settings. This Collins, B. C., Lo, Y. Y., Park, G., & Haughney, K.
holds promise in general education settings (2018). Response prompting as an ABA-based
where peers may have more opportunities to instructional approach for teaching students with
embed instruction than the general or special disabilities. Teaching Exceptional Children, 50(6), 343–
education teacher (Carter et al., 2016; Jimenez 355. https://doi.org/10.1177/0040059918774920
et al., 2012). Covey, A., Li, T., & Alber-Morgan, S. R. (2021). Using
behavioral skills training to teach peer models:
Effects on interactive play for students with moder-
Conclusion ate to severe disabilities. Education and Treatment of
Children, 44(1), 19–30. https://doi.org/10.1007/
In conclusion, teachers of students with ESN s43494-020-00034-y
may require additional instructional change Endrew F. v. Douglas County School District, 137 S.
agents to facilitate high quality educational pro- Ct. 988 (2017).
gramming for their students. This may involve Every Student Succeeds Act, Pub.L. No. 114-95, §
the enlistment of peers with and without dis- 1177 Stat . (2015).
abilities in supporting a range of instructional Fetko, E. E., Collins, B. C., Hager, K. D., & Spriggs,
activities. In this investigation, we demonstrated A. D. (2013). Embedding science facts in leisure
that peers can implement complex instruc- skill instruction conducted by peer tutors. Educa-
tional packages requiring the application of tion and Training in Autism and Developmental Dis-
multiple teaching practices. Further, our find- abilities, 48(3), 400–411. https://www.jstor.org/
ings suggest that our peer training may have stable/23880996
Gierut, J. A., Morrisette, M. L., & Dickinson, S. L.
produced improved outcomes for students
(2015). Effect size for single-subject design in
with ESN.
phonological treatment. Journal of Speech, Lan-
guage, and Hearing Research, 58(5), 1464–1481.
References https://doi.org/10.1044/2015_JSLHR-S-14-0299
Hanley, G. P., Piazza, C. C., Fisher, W. W., Contrucci,
Brock, M. E., & Carter, E. W. (2017). A meta-analy-
S. A., & Maglieri, K. A. (1997). Evaluation of client
sis of educator training to improve implementa-
preference for function-based treatment packages.
tion of interventions for students with disabilities.
Remedial and Special Education, 38(3), 131–144. Journal of Applied Behavior Analysis, 30(3), 459–473.
https://doi.org/10.1177/0014402917698008 https://doi.org/10.1901/jaba.1997.30-459
Browder, D. M., Ahlgrim-Delzell, L., & Wood, L. Hardy, J. K., Pennington, R. C., Jacobi-Vessels, J., &
(2015). Early reading skills builder. Attainment Griffin, R. (2020). Comparing the effects of cul-
Company. tural variables on preschoolers’ engagement in
Browder, D. M., Mims, P. J., Spooner, F., Ahlgrim- book reading. Early Childhood Education Journal,
Delzell, L., & Lee, A. (2008). Teaching elementary 48(6), 781–791. https://doi.org/10.1007/s10643-
students with multiple disabilities to participate in 020-01043-7
shared stories. Research and Practice for Persons with Heinrich, S., Collins, B. C., Knight, V., & Spriggs,
Severe Disabilities, 33(1-2), 3–12. https://doi.org/10 A. D. (2016). Embedded simultaneous prompting
.2511/rpsd.33.1-2.3 procedure to teach STEM content to high school
Carter, E. W., Cushing, L. S., Clark, N. M., & students with moderate disabilities in an inclusive
Kennedy, C. H. (2005). Effects of peer support setting. Education and Training in Autism and Devel-
interventions on students’ access to the general opmental Disabilities, 51(1), 41–54. https://www.
curriculum and social interactions. Research and jstor.org/stable/26420363
Practice for Persons with Severe Disabilities, 30(1), 15– Horner, R. D., & Baer, D. M. (1978). Multiple-
25. https://doi:10.2511/rpsd.30.1.15 probe technique: A variation of the multiple base-
Chambers, C., & Radley, K. C. (2020). Training soccer line. Journal of Applied Behavior Analysis, 11(1), 189–
skills to adolescents with autism spectrum disorder 196. https://doi.org/10.1901/jaba.1978.11-189

Training Peers / 443


Hudson, M. E., & Browder, D.M. (2014). Improving Mims, P. J., Lee, A., Zakas, T. L., & Browder, D. M.
listening comprehension responses for students (2013). Teaching to Standards: ELA. Attainment
with moderate intellectual disability during literacy Company.
class. Research and Practice for Persons with Severe McDonnell, J., Thorson, N., Allen, C., & Mathot-
Disabilities, 39(1), 11–29. https://doi.org/10.1177/ Buckner, C. (2000). The effects of partner learning
1540796914534634 during spelling for students with severe disabilities
Hudson, M. E., Browder, D. M., & Jimenez, B. A. and their peers. Journal of Behavioral Education, 10(2),
(2014). Effects of a peer-delivered system of least 107–121. https://doi.org/10.1023/A:1016684029389
prompts intervention with adapted science read- Parsons, M. B., & Reid, D. H. (1995). Training resi-
alouds on listening comprehension for students with dential supervisors to provide feedback for main-
moderate intellectual disability. Education and Train- taining staff teaching skills with people who have
ing in Autism and Developmental Disabilities, 49(1), 60– severe disabilities. Journal of Applied Behavior Anal-
77. https://www.jstor.org/stable/23880655 ysis, 28(3), 317–322. https://doi.org/10.1901/
Jimenez, B., Browder, D. M., & Saunders, A. (2013). jaba.1995.28-317
Early numeracy. Attainment Company. Pennington, R. C., & Courtade, G. R. (2015). An ex-
Jimenez, B., Browder, D. M., Spooner, F., & DiBiase, amination of teacher and student behaviors in
W. (2012). Inclusive inquiry science using peer- classrooms for students with moderate and severe
mediated embedded instruction for students intellectual disability. Preventing School Failure: Alter-
with moderate intellectual disability. Exceptional native Education for Children and Youth, 59(1), 40–47.
Children, 78(3), 301–317. https://doi.org/10.1177/ https://doi.org/10.1080/1045988X.2014.919141
001440291207800303 Pustejovsky, J. E, Chen, M., & Swan, D. M. (2021).
Kamps, D., Locke, P., Delquadri, J., & Hall, R. V. Single-case effect size calculator (Version 0.5.2) [Web
(1989). Increasing academic skills of students
application]. Retrieved from https://jepusto.
with autism using fifth grade peers as tutors. Edu-
shinyapps.io/SCD-effect-sizes/
cation and Treatment of Children, 12(1), 38–51.
Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R.
https://www.jstor.org/stable/42899092
(2014). Design-comparable effect sizes in multiple
Knight, V. F., Spooner, F., Browder, D. M., Smith,
baseline designs: A general modeling framework. Jour-
B. R., & Wood, C. L. (2013). Using systematic
nal of Educational and Behavioral Statistics, 39(5), 368–
instruction and graphic organizers to teach science
393. https://doi.org/10.3102/1076998614547577
concepts to students with autism spectrum disor-
Ruppar, A., Fisher, K. W., Olson, A. J., & Orlando,
ders and intellectual disability. Focus on Autism and
A. M. (2018). Exposure to literacy for students eligi-
Other Developmental Disabilities, 28(2), 115–126.
ble for the alternate assessment. Education and Train-
https://doi.org/10.1177/1088357612475301
ing in Autism and Developmental Disabilities, 53(2),
Kratochwill, T. R., Hitchcock, J., Horner, R. H.,
192–208. https://www.jstor.org/stable/26495269
Levin, J. R., Odom, S. L., Rindskopf, D. M., &
Spooner, F., & Browder, D. M. (2015). Raising the
Shadish, W. R. (2010). Single-case designs technical
documentation. What Works Clearinghouse web- bar: Significant advances and future needs for
site: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd. promoting learning for students with severe dis-
pdf abilities. Remedial and Special Education, 36(1), 28–
Kurth, J. A., Born, K., & Love, H. (2016). Ecobeha- 32. https://doi.org/10.1177/0741932514555022
vioral characteristics of self-contained high Spooner, F., Knight, V. F., Browder, D. M., & Smith,
school classrooms for students with severe cogni- B. R. (2012). Evidence-based practice for teach-
tive disability. Research and Practice for Persons with ing academics to students with severe develop-
Severe Disabilities, 41(4), 227–243. https://doi: mental disabilities. Remedial and Special Education,
10.1177/1540796916661492 33(6), 374–387. https://doi.org/10.1177/07419
McCurdy, E. E., & Cole, C. L. (2014). Use of a peer 32511421634
support intervention for promoting academic Spooner, F., Root, J. R., Browder, D. M., & Saunders,
engagement of students with autism in general A. F. (2019). An updated evidence-based practice
education settings. Journal of Autism and Develop- review on teaching mathematics to students with
mental Disorders, 44(4), 883–893. https://doi: 10 moderate and severe disabilities. Remedial and Spe-
.1007/s10803-013-1941-5. cial Education, 40(3), 150–165. https://doi.org/
Mims, P. J., Lee, A., Browder, D. M., Zakas, T. L., & 10/1177/07419325177551055
Flynn, S. (2012). Effects of a treatment package Taub, D. A., McCord, J. A., & Ryndak, D. L. (2017).
to facilitate English/language arts learning for Opportunities to learn for students with extensive
middle school students with moderate to severe support needs: A context of research-supported
disabilities. Education and Training in Autism and De- practices for all in general education classes. The
velopmental Disabilities, 47(4), 414–425. https:// Journal of Special Education, 51(3), 127–137.
www.jstor.org/stable/23879635 https://doi.org/10.1177/0022466917696263

444 / Education and Training in Autism and Developmental Disabilities-December 2022


Tarasenko, M. A., Miltenberger, R. G., Brower- Walker, V. L., Douglas, S. N., Douglas, K. H., &
Breitwieser, C., & Bosch, A. (2010). Evaluation of D'Agostino, S. R. (2020). Paraprofessional-imple-
peer training for teaching abduction prevention mented systematic instruction for students
skills. Child & Family Behavior Therapy, 32(3), 219–230. with disabilities: A systematic literature review.
https://doi.org/10.1080/07317107.2010.500518 Education and Training in Autism and Developmental
Valentine, J. C., Tanner-Smith, E. E., & Pustejovsky, Disabilities, 55(3), 303–317. https://eric.ed.gov/?
J. E. (2016). Between-case standardized mean differ- id=EJ1264298
ence effect sizes for single-case designs: A primer and
tutorial using the scdhlm web application. The Camp- Received: 11 October 2021
bell Collaboration. https://doi.org/10.4073/ Initial Acceptance: 9 December 2021
cmdp.2016.1 Final Acceptance: 14 January 2022

Training Peers / 445


Reproduced with permission of copyright owner. Further
reproduction prohibited without permission.

You might also like