Professional Documents
Culture Documents
Progress Monitoring of Mathematics Among Students With Learning Disabilities
Progress Monitoring of Mathematics Among Students With Learning Disabilities
Progress Monitoring of Mathematics Among Students With Learning Disabilities
Learning Disabilities
Edward S. Shapiro and Lana Edwards
Lehigh University
Naomi Zigmond
University of Pittsburgh
This article describes a statewide project in which weekly progress monitoring of mathematics was imple-
mented with 120 special education students. Curriculum-based measurement probes for computation and
concepts/applications skills were administered weekly over seven months. Students were assessed at lev-
els identified as instructional by their teachers, and goals for performance were set based on recommen-
dations from the research literature. Improvements of 0.38 digits per week (in computation) and 0.38
points per week (in concepts/applications) were found across students. A total of 66% of students
achieved the expected goals in computation and 37% in concepts/applications. These levels of improve-
ment were comparable to those reported in the literature for general education students. Perceived bene-
Many students with learning disabilities interventions for individual students (Deno,
experience persistent difficulties leaming and 1992; Deno, Espin, & Fuchs, 2002).
applying mathematics (Maccini & Hughes, Essentially, the purpose of CBM is to improve
2000; Owen & Fuchs, 2002). student performance. An example and a type
Characteristically, students with leaming dis- of general outcomes measurement approach,
abilities at the end of elementary school per- CBM has been used as an evaluative measure
form basic addition facts only as well as third- in education for over two decades (Fuchs &
grade students without disabilities, most Deno, 1991; Shinn, 1989). More specifically,
demonstrate growth patterns in mathematics of it involves evaluating student progress toward
no better than one year for every two or more the acquisition of basic skills that are globally
years of school, and by the end of high school reflective of instruction within a curriculum
they demonstrate proficiency levels equivalent (Deno et al., 2002; Shinn, Shinn, Hamilton,
to only fifth or sixth grade (Calhoon & Fuchs, & Clarke, 2002; Stecker & Fuchs, 2000).
2003). Considering the challenges students CBM is a standardized procedure conducted
with leaming disabilities typically encounter in repeatedly over time that provides informa-
mathematics, as well as their seemingly labori- tion relevant to making decisions about stu-
ously slow rate of progress, it is critical to iden- dent achievement (Deno et al., 2002; Fuchs
tify an assessment system that would help & Deno, 1991; Fuchs & Fuchs, 1999; Fuchs,
teachers monitor student math performance Fuchs, Hosp, & Jenkins, 2001; Shinn et al.,
and improve mathematics learning outcomes. since the material used in assess-
2002). Also,
Curriculum-based measurement (CBM) is mentis taken directly from the curriculum,
a validated assessment system that teachers CBM is considered to be an &dquo;authentic&dquo; way
can use to set goals, monitor student perfor- to assessstudent performance (Deno et al.,
mance over time, and design instructional 2002; Shepard, 2000). Finally, CBM proce-
15
16
dures can be used in several academic areas problem type. This level of scoring analysis
including reading, writing, and mathematics. reveals whether there are any &dquo;bugs&dquo; or mis-
In math, each CBM is an index of student conceptions in a student’s calculations (Fuchs
performance on the skills targeted for instruc- et al., 1991).
tion across an entire school year. Thus, for Fuchs et al. (1991) explored the use of spe-
each CBM assessment, the teacher specifies cific skill analysis in conjunction with goal
problem types that reflect the math curricu- setting and instructional decision making
lum and creates multiple alternate assess- associated with CBM. The authors randomly
ments that each contain all the problem types assigned 30 special education teachers who
covered in the curriculum (Fuchs, Fuchs, taught self-contained or resource classes in
Hamlett, & Stecker, 1991). CBM math grades 1 through 9 to three different inter-
probes are typically scored according to the vention groups. The first group of teachers
student’s total number of digits correct used CBM performance indicators with skills
(Shapiro, 1996). These CBM scores, or &dquo;per- analysis, the second group used CBM perfor-
formance indicators,&dquo; represent overall profi- mance indicators without skills analysis, and
ciency within the yearly curriculum. Ideally, the third group used neither CBM nor skills
teachers graph these performance indicators analysis. Results supported the use of specific
and use the graphs to (a) monitor student skills analysis within CBM. That is, teachers
goals, (b) judge the adequacy of student who received graphed CBM performance
progress for determining instructional deci- indicators along with a specific skills analysis
sions, and (c) assess the impact of different report planned more specific instructional
instructional interventions (Fuchs et al., interventions for their students and observed
1991 ). more significant gains in student math
Although CBM focuses on a student’s achievement than teachers who just received
progress over time general
on skills within the graphed CBM data. According to Fuchs et al.,
curriculum, a teacher can analyze student’s
a the achievement effect size associated with
responses on a given CBM assessment to CBM skills analysis was large. Compared to
ascertain a comprehensive description of the control teachers, the effect size for the com-
student’s mastered and emerging skills. In bined CBM and skills analysis approach was
math, each skill is assessed during an individ- .67; the effect size for CBM teachers who did
ual CBM assessment probe. Skills analyses not receive skills analysis was .55. Overall, the
can be created by aggregating a student’s per- Fuchs et al. findings appear to suggest the
formance across recent assessments for each potential contribution of skills analysis to
individual skill (Fuchs et al., 1991). In other CBM procedures.
words, a teacher is able to determine specific In addition to investigating the use of spe-
skill areas that students have mastered, as well cific skill analysis in the context of CBM per-
as specific skill areas that require further formance indicators, research on the techni-
remediation and future instruction. For exam- cal adequacy of mathematics CBM systems
ple, an analysis across recent probes might has also been conducted. Math CBM typical-
indicate that a student has mastered two-digit ly focuses on computation skills with a grade-
addition problems without regrouping, but level representative sample of math facts
requires further instruction on two-digit addi- and/or math operations ( i.e., adding, subtract-
tion problems with regrouping as well as a ing, multiplying, and dividing whole num-
review of subtraction. Further, using a digits bers, fractions, and decimals) from a specific
correct scoring procedure provides the curriculum (Fuchs et al., 1991). Research sup-
teacher with an error analysis and informs ports the reliability and validity of using com-
him/her of how students solve a particular putation as a global indicator of math
17
Although computation has been a focus with computation and a general mathematics
within math CBM, a singular focus on com- battery ranged from .68 to .81. Perhaps most
putation assessment has limitations. First, important when considering the use of the
computation is only one component of a com- concepts and applications probes for progress
prehensive mathematics curriculum (Fuchs et monitoring are findings related to slope.
al., 1994; Thurber, Shinn, & Smolkowski, Fuchs et al. reported that slopes ranged from
2002). Second, many instructional programs .40 at grade 2 to .69 at grade 4. When dis-
focus on highly procedural computation cussing their findings Fuchs et al. recognized
instruction that typically requires students to that the slopes derived from their study pro-
independently negotiate conceptual concepts vide tentative estimates for designing appro-
(Woodward & Montague, 2000). Students priate weekly goals for progress monitoring.
with learning disabilities, therefore, often For example, they note that given the average
struggle in their understanding of core princi- slope of approximately .60 points correct on
ples, concepts, and skill applications the concepts and applications probes at grade
(Jitendra, DiPipi, & Perron-Jones, 2002). In 3, with a standard deviation of .30, one could
response to the documented mathematics target a gain of .60 to .90 points per week
deficits of students with learning disabilities, when setting weekly goals for a third-grade
along with the dominant focus on computa- student. It is important to note, however, that
tion within typical mathematics instruction, these preliminary estimates for rate of growth
Fuchs and colleagues (1994) expanded the are based primarily on the performance of
problem solving. In other words, they created Finally, research on the use of CBM to
an additional set of CBM concepts and appli- monitor student performance in math sug-
cation probes to reflect broader skills from the gests that students learn more when teachers
mathematics curriculum. make individual adjustments in instruction
To document the technical adequacy of the through the use of CBM procedures (Stecker
18
& Fuchs, 2000). The impact of CBM on math one half the rate of typical students, especial-
achievement is particularly evident when ly in the earlier grades. Based on their find-
teachers more intensively monitor the ings, Deno et al. make specific recommenda-
progress of a few individual students (Fuchs, tions for CBM growth rates in reading that
Fuchs, Hamlett, & Stecker, 1991). For exam- exceed normative levels for students with
ple, Fuchs et al. (1991) observed that teachers learning disabilities.
who used CBM to monitor student math per- Another unanswered question involves the
formance adjusted their students’ instruction- impact of reading demands on the perfor-
al programs approximately 2.5 times over the mance of students with leaming disabilities
course of 20 weeks. This finding was in con- on the concepts/applications probes. Fuchs et
trast to the average .27 times of instructional al. ( 1994), for example, noted that one expla-
adjustments made by teachers who did not nation for differentially higher rates of growth
employ CBM during the same period. for second-grade students on math con-
Overall, when considering the challenges stu- cepts/applications could be the emerging
dents with leaming disabilities face when reading skills of second-grade students early in
leaming mathematics, empirical support for the academic year. In other words, as second-
the importance of collecting progress moni- grade students made improvements in reading
toring data, designing interventions, and across the year, their ability to solve con-
emphasized both reading and math outcomes port ( i.e., self-contained more than 50% of
of students with leaming disabilities, we will their day), 61.1 % (n =
69) receiving part-
emphasize only the findings in math. In the time or resource room support (i.e., special
results and discussion, we specifically address education services between 25-50% of the
critical issues related to progress monitoring day), and 11.5 % (n 13) receiving itinerant
=
such as goal setting and student rate of growth support (fully included, receiving special edu-
on both computation and concepts/applica- cation services for less than 25% of the day).
tions measures. Of the 7 students receiving emotional sup-
port, 4 received part-time support and 3
Method received itinerant support. A total of 16 stu-
Participants dents (all in two districts) were in middle
A total of 15 school districts in the
schools; the remaining 104 students in ele-
Commonwealth of Pennsylvania volunteered mentary school buildings.
to participate in the project 5 from the Materials and Dependent Measures
-
dents were monitored in math computation tions and multidigit multiplication as well as
and 109 in math concepts/applications simple division introduced in grade 4 probes.
(teachers in two districts elected not to assess Decimals, complex fractions, and multidigit
concepts/applications) Within each district, division with remainders were introduced in
2-15 students were assessed (mean number of grade 5 and 6 probes. Each computation prob-
students assessed per district 9 in computa-
= lem was scored by counting the number of
tion, 8 in concepts/applications). digits correct in the final answer. The total
Students ranged in grade from 1 to 6 (mean number of digits correct was used as the
= 3.3 grade). Of the 120 students for whom dependent measure to reflect student perfor-
mance on math computation.
progress-monitoring data were collected in
computation, 5.8 % (7) were in programs for Math concepts/applications. The blackline
students needing emotional/behavioral sup- masters from Monitoring Basic Skills Progress
measurement, charts and graphs, money, frac- monitoring problems. Probes are set up such
tions, applied computation, and word prob- that students are not expected to complete all
lems. Problems began at grade 2, and contin- problems presented. For computation, stu-
ued to increase in difficulty through grade 6. dents were given 2 minutes for grades 1 and 2
Problems required between one and three probes, 3 minutes for grades 3 and 4 probes,
responses, and varied in type (fill in blanks, and 5 minutes for grade 5 probes. For con-
multiple choice). Each part of a problem cepts/applications, students were given 8 min-
answered correctly was awarded a point and utes for grade 2 probes, 6 minutes for grades 3
the total number of points across the probe and 4 probes, and 7 minutes for grades 5
was used as the dependent measure to reflect probes.
student performance on math concepts/appli- Teachers graphed all data. Teachers were
cation. first instructed to set year-end goals for stu-
dent performance. Data are limited on the
Progress Monitoring Procedures expected levels of performance of typical stu-
dents in progress monitoring of mathematics.
Teachers began by determining the level at
In thisstudy, data reported by Fuchs, Fuchs,
which each student would be monitored.
Hamlett, Walz, and Germann (1993) and by
Looking over the probes to be used for Fuchs et al., (1999) were used to make rec-
progress monitoring, teachers made a &dquo;best
ommendations to teachers for setting weekly
guess&dquo; regarding student instructional levels.
goals for expected performance. Based on
Teachers were asked to collect baseline data these studies and earlier pilot testing by the
and to determine if their estimate of student
investigators, it was recommended that teach-
instructional level was accurate. If their stu- ers set a goal of 0.5 digits per week gain in
dents scored at or near zero level of perfor- math computation and 0.5 points per week
mance in baseline, teachers moved their esti-
gain in math concepts/applications. These
mate of student instructional levels downward
levels of improvement were somewhat arbi-
and again collected baseline data.
trary (approximately 2 digits or 2 points per
Each student was assessed once each week. month), but were viewed as challenging and
Assessments of computation and consistent with performance levels found in
concepts/application were alternated, so that previous research.
students were assessed once every two weeks Teachers were trained to use a decision rule
in computation and concepts/applications. when examining their data. Specifically, they
Students were assessed at a time designated by were instructed to examine their data after 4
each teacher. Instructions recommended by points were collected and every few data
Fuchs et al. (1998, 1999) were used in admin- points thereafter. They were to compare the
istering the probes. Specifically, students were student’s performance against the expected
told that they were to look at each problem, level of performance (i.e., the student’s aim-
first attempt to complete the problems they line). Based on their analysis of the data,
believed that they could do, and then return teachers were instructed to (a) continue cur-
to those they were unsure about. This proce- rent instructional procedures if the trend in
dure ensured that students would demonstrate the student’s performance matched expected
success on the problems that they had level of performance; (b) increase a student’s
learned, maximizing their performance on goal if the student consistently exceeded the
each assessment measure. aimline; or (3) make a teaching change if the
21
student’sperformance was substantially below were made to each of the participating teach-
expected level of performance. Teachers were ers. At these visits, the data for each student
also given the option to continue existing were reviewed, concerns about the data col-
instructional practices even if the student was lection and/or graphing process were
below the aimline if they felt that the student addressed, and teachers were asked to demon-
needed more time to respond to the instruc- strate the data collection process with one
tional practices. Likewise, if students were student. Feedback was provided to correct any
making increasing progress, albeit not quite at errors in the data collection and graphing
the level set as the expected level of perfor- process, and teachers were asked to bring their
mance, teachers were encouraged to continue data to the next training session to be held in
current instructional practices. March.
The progress monitoring process began The March 2003 training session empha-
around the second week of November and sized making instructional changes. Teachers
continued throughout the school year until were provided with ideas and strategies for
May 2003. The initial session in October was teachers about the progress monitoring
dedicated to introducing the concept of process. At this final session, plans for contin-
GOM in reading and math, teaching teachers uing progress monitoring for the following
how to collect progress monitoring data, and school year were also discussed.
concepts of graphing the data. Teachers were
Results
instructed that they needed to select at least
two students, obtain baselines, and begin the Data were analyzed using several metrics.
progress monitoring process prior to the next Using the ordinary least squares (OLS)
session. method, each student’s performance for both
At the December training session, teachers computation and concepts/applications was
presented the outcomes of their data collec- regressed against assessment sessions. This
tion. The session emphasized the processes of of
resulted in the calculation slopes reflecting
instructional decision making, specifically the rate of change per assessment session.
using decision rules and analyzing data. Given that assessment data for computation
Teachers were taught to examine changes in and concepts/applications were collected
level, variability, and trend when considering every two weeks, the slopes were divided by
graphed student performance. Finally, they 0.5 to reflect the rate of change per week.
were instructed to begin examining their data The degree to which student performance
and to apply decision rules following the matched the goals set by the teacher was also
inservice. calculated. Goals for student performance
In January or February 2003, onsite visits were set based on achieving a gain of 0.5 dig-
22
Table 2 Mean Slope and SEM for Computation and Concepts Across Participants by
Teacher Assigned Instructional Level
one or more years from their chronological students who were five grade levels behind
grade levels. Table 3 displays the performance showed slopes of improvement that nearly
of students based on the difference between equaled overall levels across all participants.
their assigned grade and the instructional lev- The same pattern was not evident for math
els used for monitoring. concepts. The performance of students who
In computation and concepts, all but 25 were at grade level substantially exceeded the
and 10 students, respectively, were being overall level across participants. Both the 36
monitored at least one grade level below their students who were monitored one year below
chronological grade. In computation, students grade level and the one student whose
who were between grade level and two grades instructional level was five grade levels below
below showed rates of improvement that his grade (an 8th grader being monitored at
equaled or were somewhat higher than the the 3rd grade level) made much slower
overall slope across participants regardless of progress (approximately 0.20 points correct
instructional level. Students whose instruc- increase per week). Students who were two,
tional level fell three or four years below grade three, or four
grade levels behind showed
levels showed slower rates of gain than those increasingly higher levels of improvement,
two or fewer grade levels behind, but the ranging from 0.31 to 0.92 points per week.
number of students four grade levels behind The small number of students who were four
was quite small, making any conclusions or five grade levels behind makes any conclu-
about this group tentative. Interestingly, two sions about this group tentative.
Table 3 Mean Slope and SEM Across Participants Based on the Difference Between Grade
and Instructional Level for Progress Monitoring
24
Attainment of Goals 0.70 digits per week. A Goal Score was calcu-
lated by subtracting the value of her slope of
The percentage of students who attained a
Goal Score that was equal to or greater than performance from the weekly expected rate of
the expected levels of performance as set by gain set by her teacher (0.5 digits); her Goal
the instructors ( i.e., a gain of 0.5 digits or Score of +0.20 digits reflected a student who
exceeded the expected rate of gain.
points per week) is Figure 1. As
displayed in
Examination of the pattern of her perfor-
illustrated, in computation, approximately
mance showed that Kelly appeared initially
66% of students attained a rate of improve-
ment that met their goal, whereas in concepts not to be responsive to the instruction deliv-
ered in her math program, with data points
only 37% of students met this goal.
that fell below her aimline (11/21 to 1/6).
Illustrative Cases When her teacher examined the graph after
Two cases are presented to illustrate the data were collected on 1/28, she noticed an
rates of improvement typical across students. increase in Kelly’s performance and decided
to wait to see if the instruction being deliv-
Kelly. Kelly was fourth-grade student
a
enrolled in a part-time special education pro- ered as part of her math program was becom-
gram (25-50% of time in general education ing effective. When the data were examined
setting) for students who need learning sup- on 3/3, the teacher noted substantial
port (i.e., classified as having a learning dis- improvement in Kelly’s performance and
ability). Her teacher elected to monitor her decided that no specific instructional changes
were needed.
progress in mathematics computation at the
third-grade level, where Kelly was currently Niki. Figure 3 reflects Niki’s performance
being instructed. Figure 2 reflects Kelly’s per- in concepts/applications, and is a good illus-
formance in computation. Kelly had a base- tration of a student who made gains through-
line level of 14 digits correct and progressed out the progress monitoring process but who
over the school year to a rate of 25 digits cor- did not reach the level of expected perfor-
rect across the last three sessions. Her rate of mance as set by the instructors. Niki was a
assessed in mathematics at the third-grade was not equal the rate set by her teachers,
to
level. Starting at a baseline of 23 points cor- and an earlier instructional change might
rect, the teacher set an improvement goal of have been beneficial, Niki clearly showed
0.5 points per week. Over the course of the gains in her performance once her teacher
seven months during which Niki was moni- paid attention to the probe data.
tored, she showed a gain of 0.15 points per
week. Her Goal Score, calculated by subtract- Discussion
ing the value of her slope from the expected Slope of Student Performance
slope of improvement, was -0.35 points per
week. Although Niki’s performance was In computation and concepts/applications,
below her aimline, from 1/19 through 2/16 students showed overall gains in performance
her teacher noted an increasing trend and across the school year. The level of gain for
elected not to change instruction. Data col- both computation and concepts/application
lected from 3/1 to 3/29 indicated that the was the same, equal to a gain of approximate-
increasing trend was no longer present. ly 14 total digits or total points over baseline
Through an analysis of the error patterns in levels across the academic year, a gain of
the probes, Niki’s teacher recognized that she approximately 0.38 digits or points per four
was struggling in the area of graphing and weeks .
between 3/29 and 4/2 implemented mini- When individual student performance was
lessons as part of her regular instructional examined based on the level at which stu-
activities. As a result, gains in performance dents were being monitored, we found similar
were reflected in the progress monitoring patterns across grade levels for computation
data. That is, Niki raised her performance and concepts. Between the second- and
from a baseline of 23 points to a level of over fourth-grade level, students’ rate of growth
31, 37, and 32 points in each of the last three tended to increase as instructional level
assessment sessions. Although the rate of gain increased. In computation, students moni-
26
tored at the fourth-grade level achieved highly responsive to the more intense and
improvement ratesthat were nearly triple focused instruction. However, when the gap
those of students at the second-grade level. between instructional and grade level widens
Similarly, in concepts students at the fourth- to three or four grade levels, students may be
grade level attained the highest slopes, so severely behind that instructional modifi-
although not substantially greater than those cations based on the progress monitoring data
at second- or third-grade instructional levels. alone are not sufficient to close the gap.
The impact of instructional level seemed A second explanation is that the wider gap
even clearer when looking at student perfor- between instructional and grade level reflects
mance when the gap between instructional a student who has a more severe and perva-
and grade level was considered. In computa- sive difficulty in acquiring mathematical
tion, students showed better growth when the understandings. Such students who are being
gap between instructional and grade level was taught well below their actual grade level
two versus one grade, but then showed the might be expected to progress at slower learn-
opposite effect when the gap widened to three ing rates, and this effect was displayed by the
or four grade levels. One explanation for this progress monitoring data collected in this
may be related to the amount of material that study.
a student needs to learn to &dquo;catch up&dquo; to In contrast to computation, students who
his/her chronological grade level. A teacher show wide gaps between instructional and
who is monitoring a student working below grade level in concepts/applications may be
grade level is likely to be intensifying instruc- offering teachers clear indications of where
tion on target skills that are assessed on the more intensive instructionneeded.
is
CBM probes. When the gap is one or two Although only a speculation, anecdotal evi-
grade levels, teachers have fairly prescribed dence from discussions with teachers found
choices of what to teach, and students may be performance on the concepts/application
27
tional levels, who performed at a somewhat cations, the goal of 0.5 points per week is con-
lower level than typical third- and fourth- sistent with realistic levels of performance
28
based on the Fuchs et al. (1999) study, the tem for mathematics in their classrooms. The
only data available to make such a recom- use of both computation and concepts/appli-
mendation. In this project, approximately two cations appeared to be important, as the two
thirds of the students met or exceeded these areas represent somewhat different, albeit
goal levels in computation, and one third in related, skill domains, and were found to grow
concepts/applications. Additionally, when at different rates. Finally, the assessment
considering students whose Goal Scores fell schedule used (i.e., alternating weekly assess-
within one SEM, the percentage of students ment between computation and
who met or exceeded the goals increased to concepts/applications) appeared to be a rea-
82.5% in computation and to 50.9% in con- sonable timeframe for data collection.
cepts/applications. These findings suggest Teachers reported that conducting the
that many of the students who did not meet monitoring was feasible within their routine
the goals established by the teacher fell just schedule and that using the probes helped to
short of the expected levels. These very posi- shape their instructional decisions for all stu-
tive results may reflect the progress monitor- dents. For example, one teacher reported that
one of her students who had been struggling
ing project’s emphasis on using data to make
instructional decisions. Because the focus was in math computation was presented with a
implement a weekly progress monitoring sys- as well as a mechanism for focused discussion
29
on areas in need of more attention. Teachers ed by one of the authors) to help them record
also reported the usefulness of involving stu- and graph student data. Teachers were also
dents very directly in the progress monitoring offered a commercially available Macintosh
process. For example, some teachers asked software program linked to the probes that
students to graph their own data both with were being used (Fuchs et al., 1999). But only
pencil and paper and on the computer. a few of the teachers took advantage of these
achievement. Additionally, some teachers Basic Skills Progress, Basic Math (Fuchs et al.,
began to use the measures in the process of 1999) or Yearly Progress Pro (McGraw-Hill,
developing IEP goals. http://www.mhdigitalleaming.com) to stream-
Although the project had many benefits line the data collection, scoring, and graphing.
for students and teachers, several challenges One of the other challenges encountered
were identified. The teachers who participat- in this project was the difficulty that some
ed in this project were all volunteers. As such, teachers had making time to deliver instruc-
they were motivated to establish the progress tional interventions indicated as being neces-
monitoring system in their classes, and they sary by the progress monitoring data. This was
maintained a high level of implementation a particular problem for teachers who deliv-
fidelity. At the same time, teachers expressed ered special education services within a full
concern about the difficulties they had in inclusion model. Within this model, the spe-
finding time in their students’ schedules to cial education teachers were expected to sup-
incorporate the progress monitoring process. port students in the general education setting
As a result, some teachers elected to moni- by making accommodations to the general
tor only computation or only concepts/appli- curriculum while students were engaged in
cations. Others decidedto assess only reading, the standard classroom instruction. They
foregoing the math assessment entirely. One were not supposed to deliver supplemental or
of the challenges for all teachers doing specific instruction despite what was indicat-
progress monitoring was to make the process ed by progress monitoring.
part of the normal weekly instructional rou- Many of these teachers reported that while
tine. Teachers who could see gains in student they collected the data and recognized when
performance, could recognize the sensitivity instructional modifications were needed, they
of the measures to instruction, and could use could not find the time in a student’s schedule
the data for instructional decision making to deliver such instruction without sacrificing
found ways to incorporate the progress moni- the required support that general education
toring of math into their instructional pro- teachers expected for students who were fully
grams. included. Unfortunately, these observations
Another challenge was related to the are similar to previous research reported by
teachers’ technological capabilities. Most of Fuchs et al. (1995) on the extent to which
the teachers chose to use paper-and-pencil general education teachers engage in special-
graphing methods. Although these methods ized instructional adaptations as result of the
are valuable, the process of progress monitor- use of CBM in math instruction. Thus, Fuchs
ing can be enhanced by using technology such et al. (1995) remarked on the substantial vari-
as computerized generation of graphs. During ability in general education teachers’ use of
the project, teachers were offered some pre- progress monitoring data to make individual
programmed Microsoft Excel software (initial- adjustments in instruction. Such issues con-
ly developed by one of the teachers and adapt- tinue to raise caution regarding the extent to
30
ment progress monitoring in inclusive mod- and concepts/applications, many students (25
els. This did not appear to be a problem for and 10, respectively) were not deficient in
teachers who were assigned to part-time, mathematics achievement. Future studies
resource, or full-time special education ser- should more carefully select students for
vice delivery models although they, too, had progress monitoring based on identified levels
instructional routines that made it difficult to of mathematics problems.
find time to do new things.
Conclusions
Limitations
Despite the limitations, the outcomes of
This project was not designed to be a care- this project show that the monitoring of com-
fully controlled research study. Therefore, putation and concepts/applications together
explanations for the levels and patterns of can be a powerful tool for examining the
improvement noted among students cannot progress of special education students within
be derived empirically. Although teachers math curricula. Students in this project dis-
were instructed to use the data to make played gains in mathematics skills that were
instructional decisions, and many appeared to equal to or better than those of typical stu-
have done so throughout the project, the dents at equivalent grade levels. Given that
degree to which teachers systematically made the majority of students were performing one
use of the data to drive instruction was not or more grade levels below their chronologi-
well documented. Thus, we do not know if cal grade, progress monitoring served to
some students did not make progress because demonstrate the potential to accelerate learn-
their teachers were not examining their data ing outcomes for students in special educa-
as instructed. It is well established that using tion. Teachers were capable of fully managing
progress monitoring data to make instruction- the system, integrating both data collection
al decisions is the best predictor of successful and analysis into their weekly routine.
student outcomes. However, simply collecting While instructional gains of 1.5 digits per
the data is not sufficient to result in academic month in computation may seem relatively
improvement (Fuchs & Fuchs, 1986). small in terms of overall rate of growth, the
Another limitation of the project is that progress made by students with learning dis-
teachers were all volunteers. As such, they abilities in this project highlights the impor-
were motivated to learn and use the progress tance of viewing growth over an extended
monitoring processes. Given that most of the period of time. Teachers trying to make
teachers were quite naive and unfamiliar with instructional decisions on a daily or weekly
the concepts of General Outcome basis may express frustration at what appears
Measurement prior to the study, we do not to be only slight patterns of student progress.
know the degree to which teacher self-moti- However, our data suggest that the progress
vation and interest resulted in better out- that students with learning disabilities make
comes than one might get with teachers who in math when viewed over extended time is
are less predisposed to implementing the comparable to the progress of nondisabled
progress monitoring process. students at similar instructional levels.
Finally, teachers were free to select stu- Therefore, fairly significant gains in student
dents from whom progress monitoring data math achievement may be linked to the
31
dents with learning disabilities. Remedial & Special Learning Disabilities Research and Practice, 15
(3), 128-
Education, 23, 268-278. 134.
Shapiro, E. S. (1996). Academic skills problems: Direct Thurber, R. S., Shinn, M. R., & Smolkowski. K. (2002).
assessment and intervention (2nd ed.). New York: The What is measured in mathematics tests? Construct
Guilford Press. validity of curriculum-based mathematics measures.
Shepard, L. A. (2000). The role of assessment in a School Psychology Review, 31, 498-513.
learning culture. Educational Researcher, 29
(7), 4-14. Woodward, J., & Montague, M. (2002). Meeting the
Shinn, M. R. (Ed.). (1989). Advanced applications of cur- challenge of mathematics reform for students with
riculum-based measurement. New York: Guilford. learning disabilities. Journal of Special Education, 36,
Shinn, M. R., Shinn, M. M., Hamilton, C., & Clarke, 89-101.
B. (2002). Using curriculum-based measurement in
general education classrooms to promote reading Author Note
success. In M. R. Shinn, H. M. Walker, & G. Stoner
(Eds.), Interventions for academic and behavior prob- This project was conducted as part of an
lems II: Preventative and remedial approaches (pp. 113- by the Bureau of Special Education,
initiative
142). Bethesda, MD: National Association of School
Pennsylvania Department of Education, Dr.
Psychologists. Fran Warkomski, Director, and the
Stecker, P. M., & Fuchs, L. (2000). Effecting superior
achievement using curriculum-based measurement: Pennsylvania Training and Technical
The importance of individual progress monitoring. Assistance Network (PaTTAN).