Professional Documents
Culture Documents
Improving Outcomes With Data Based Decision Making PDF
Improving Outcomes With Data Based Decision Making PDF
Improving Outcomes With Data Based Decision Making PDF
C
ollecting and graphing Coleman, Buysse, & Neitzel, 2006).
performance data are Additionally, there is an increasing
important parts of the trend in the early childhood field
educational process. Such procedures toward the ongoing use of
help educators, caregivers, and other performance data; innovative
important stakeholders make data- projects, such as Individual Growth
based decisions to accelerate child and Development Indicators (IGDI;
progress. With school-age children, see http://www.ggg.umn.edu) and
collecting and graphing data have the Parenting Interactions With
been associated with more frequent Children: Checklist of Observations
instructional changes to better meet Linked to Outcomes (PICCOLO; see
children’s needs (Fuchs, Fuchs, http://www.cpd.usu.edu/project.php?
Hamlett, & Stecker, 1991), increased id=119), include progress
quality of Individual Education Plan monitoring as a central feature of
(IEP) objectives (Codding, Skowron, interventions designed to improve
& Pace, 2005), and increased child outcomes for young children.
performance (Browder, Demchak, Although early childhood
Heller, & King, 1989; Fuchs & educators report that data collection
“
Collecting and graphing
Fuchs, 1986). Furthermore, many
applied research studies in early
intervention use frequent collection of
performance data and evaluation of
is important, research suggests data
collection practices in early care and
education settings are inconsistent,
and lack of skill has been reported as
performance data are an graphed data (e.g., Duda, Dunlap, one of the barriers to frequent and
Fox, Lentini, & Clark, 2004; systematic use of data (Sandall,
important part of the Godfrey, Grisham-Brown, Schuster, Schwartz, & LaCroix, 2004). The
& Hemmeter, 2003; Ingersoll & purpose of this article is to describe
educational process. Schreibman, 2006; Ziolkowki & basic elements of collecting
performance data to promote
”
Goldstein, 2008) to examine the
effects of intervention and instruction. systematic progress monitoring and
Collecting and graphing data improve child outcomes in early care
also are important elements of tiered and education settings. Although the
models of service delivery (e.g., topic of collecting data could include
response to intervention), which are many technical aspects, the goal of
becoming part of the dialogue in this article is to provide the reader
early childhood education (Brown, with basic knowledge needed to
Odom, & Conroy, 2001; Fox, collect meaningful child performance
Dunlap, Hemmeter, Joseph, & information through identification of
Strain, 2003; Sandall & Schwartz, important, valued, and functional
2002; Schwartz & Olswang, 1996; behaviors that are then targeted for
VanDerHeyden & Snyder, 2006). instruction or intervention.
For example, “recognition and
response” is a model developed for
early childhood programs that
Selecting a Target
focuses on data-based decision Behavior
making and increasing services on
the basis of child response to current One of the first considerations in
intervention and instruction (Buysse, collecting data is selecting a target
Winton, & Zimmerman, 2007; behavior as the focus of intervention
“
Identifying a target
important to the child’s ability to
function in his or her daily
environment, enhance the child’s
engagement as physical, verbal, or
vocal behavior that is consistent
with the designated task. This broad
behavior facilitates successful participation in activities definition allows for flexibility in
and interactions, and promote measuring the target behavior across
collection of child growth in other developmental
areas. Typically, target behaviors are
settings and contexts.
Sometimes early learning,
selected in the areas of early cognitive, or adaptive target
performance data that can learning and social behavior. These behaviors are generated from
domains are often the foundation of assessment data. For Jaylen,
be graphed to early education experiences, and as rhyming is targeted because
such, educators often develop goals acquisition of this phonological
demonstrate the child’s for children that focus on early awareness skill is an important
learning skills and social behavior. indicator of general emergent
progress toward a goal. literacy skill development (Anthony
& Lonigan, 2004), and the IGDI
“
toy, noncompliance). Problem behavior. By understanding the
behaviors concern teachers and are function of the problem behavior,
When intervening with selected as behaviors for interventions can target appropriate
intervention because of the impact and adaptive behaviors that serve
social behaviors, it is problem behaviors can have on the the same function. Typically, the
child’s ability to engage in classroom function of a behavior is identified
important to attend activities, benefit from instruction, as either (a) gaining access to
and engage effectively with peers something or (b) avoiding or
to the function of the and adults. In these situations, the
target behavior can be a
escaping something. Gaining access
can be further broken into gaining
replacement behavior (see O’Neil, access to attention (e.g., teacher,
problematic behavior or Horner, Albin, & Storey, 1996, for a parent), to desired materials or
more detailed discussion) or the tangibles (e.g., food, toys), or to
the purpose that the alternative and desired behavior that sensory stimulation. Similarly,
the child should use in place of the avoiding or escaping can be further
behavior serves. problematic behavior (e.g., broken into avoiding attention or
requesting, compliance) as the target
”
task demands or reducing sensory
behavior. We advocate focusing on stimulation. Identifying the function
replacement behaviors when of a particular behavior is
developing interventions and accomplished usually through a
tracking response to interventions detailed process that involves
for several reasons. First, focusing interviews and collection of
on replacement behaviors addresses observational data that focus on
the notion of the function of the the environmental context of the
problem behavior by identifying problem behavior. Often the
behaviors that meet the child’s need function of a behavior can be
(e.g., gaining adult attention). defined by attending to what
Second, the replacement behavior happens just before and right after
may be an important keystone the problem behavior occurs.
behavior that has the potential to Identifying predictors of the
affect other behaviors of concern behavior can be helpful in
(e.g., teaching the child to use verbal developing interventions. For
communication). Finally, selecting a example, if the problem behavior
positive target behavior shifts the seems to occur more often during
Figure 1
Functions of behavior
Access Escape/Avoid
“
Dominique’s aggressive behavior as and/or flailing of arms and/or legs
“verbal, vocal, or physical behaviors that lasts longer than 3 min).
Operational definitions that result in discomfort or injury to Adding a time element to an
a peer or adult, including yelling, operational definition of compliance
specify important hitting, kicking, and pushing.” clarifies the conditions under which
Nonexamples of her aggressive a behavior is considered compliant
elements of the target behavior might include hitting a (e.g., child response consistent with
peer’s hand in a “high five” or adult request within 10 s).
behavior so that shouting loudly in play. In defining
the desired and alternative Selecting a Measurement
behaviors, Ms. Carol describes
accurate data can requests as “any verbal, vocal, or
System
gestural behavior used to obtain a The dimensions of the
be collected. desired object.” The inclusion of operational definitions of the target
”
verbal, vocal, and gestural behaviors behavior will inform the focus of the
allows for multiple ways that measurement and the type of
requests can be made, thus creating recording method. Direct
a response class (or a set of observation is used frequently with
acceptable behaviors) for a range of behaviors, because it is a
communication. For children at method that teachers can use during
various levels of skill development, everyday routines in naturalistic
this flexibility might be needed. For settings. Table 1 provides a brief
children who have verbal skills for description of recording methods
requesting, the operational that are useful for direct observation
definition may be limited to verbal of target behaviors. It is important
behavior. to select a recording method that
In selecting and defining a target will best capture the target behavior.
behavior, the teacher needs to Ms. Carol observes Dominique’s use
consider which dimension(s) (e.g., of requesting and waiting during
frequency, duration, intensity) playtime using a frequency count,
should be the focus. Specifying these whereas Mr. Nick observes Trevor’s
dimensions as part of the engagement using an interval
operational definition helps make recording system. If Mr. Nick was
the target behavior less ambiguous concerned only with increasing
Table 1
Methods of Recording Data
Recording Method Description Example
Event recording • Each occurrence of the target behavior is recorded, and at the end of Ms. Rita makes a mark on a recording form
(frequency count) the observation, a total number of occurrences is calculated, yielding posted on the cabinet near the art area each
the number or frequency of behaviors. time Lilly asks for materials during project
• Best used with behaviors that are short in duration and have a clear time.
beginning and end (e.g., positive behaviors, such as requests and social
initiations, or negative behaviors, such as hitting or calling out).
• Uses some indicator of the occurrence of the behavior, such as tally
marks on a recording form.
Time sampling • Specific time intervals (e.g., 30 s, 2 min) are selected and used in
observing and recording the target behavior. Sampling methods yield
an approximation of the frequency of behavior as opposed to a precise
recording of actual frequency.
Partial-interval time • A predetermined time interval is used, and the target behavior is Mr. Tom observes during circle time to see if Jay
sampling recorded if it occurs during any part of the interval, yielding a is actively engaged. Because it is difficult to
percentage of total intervals (or percentage of observation) that the observe and conduct circle time, Mr. Tom uses
behavior is observed. Occurrence of the target behavior is recorded only intervals that correspond to each circle time
once during an interval regardless of whether there are additional activity, which are approximately 3 min. Mr.
occurrences of the behavior. Tom marks yes or no on a clipboard in the cir-
• Best used with behaviors that occur frequently. cle area if he observes Jay as actively
engaged during any part of the specific activ-
ity or interval.
Whole-interval time • A predetermined time interval is used, and the target behavior is Mr. Tom observes during circle time to see if Jay
sampling recorded if it occurs and is maintained during the entire interval. If the is actively engaged. Because it is difficult to
behavior begins and ends before the interval has elapsed, the target observe and conduct circle time, Mr. Tom uses
behavior is not recorded as occurring. This method yields a percentage intervals that correspond to each circle time
of total intervals (or percentage of observation time) that the behavior activity, which are approximately 3 min. Mr.
is observed. Tom marks yes or no if he observes Jay as
• Best used with behaviors that are longer in duration; otherwise, the actively engaged during the entire activity or
method will underestimate the occurrence of the behavior interval.
Momentary time • Interval is divided into a “rest” part and a “watch” part. Observation of Mr. Tom observes during circle time to see if Jay
sampling the target behavior occurs only for a portion of the predetermined time is actively engaged. Because it is difficult to
interval or during the “watch” part of the interval (e.g., last 5 s of a 15- observe and conduct circle time, Mr. Tom uses
s interval). The target behavior is recorded as occurring only if it occurs intervals that correspond to each circle time
during the “watch” part of the interval. activity, which are approximately 3 min. Mr.
• This method yields a percentage of total intervals (or percentage of Tom marks yes or no if he observes Jay as
observation time) behavior is observed and is best utilized with high- actively engaged at the end of each specific
frequency behaviors or behaviors that are longer in duration. activity or interval.
Duration • The elapsed time between onset and offset of the target behavior is Ariel has difficulty choosing and staying with an
recorded. appropriate activity during independent
• Duration data can be summarized by each occurrence or by the total exploration. Ms. Tina starts her watch when
duration of the behavior during the period of observation. Ariel begins to wander during independent
• Observer starts the stopwatch when the behavior begins and stops the exploration and stops her watch when Ariel
watch when the behavior ends. chooses an activity and begins the activity.
• Best used with behaviors with a clear beginning and end, where the
dimension of interest is how long behavior lasts and where the behavior
is longer in duration (e.g., on-task, prosocial, or out-of-area behaviors).
Latency • The elapsed time between the prompt or request for behavior and the Mr. Andre starts his watch when he gives Leon a
performance of the target behavior is recorded. direction to line up at the door and stops his
• Observer starts the stopwatch when the prompt or request is given and watch when Leon complies with the request
stops the watch when the target behavior is initiated. and has lined up behind his peers.
• Latency data can be summarized by each occurrence.
• Best used with behaviors that have a clear beginning and are signaled
by some type of prompt (e.g., compliance).
minimize the need for additional collected, in most cases. Ms. Carol
materials. For example, in collecting collects data during playtime, when
frequency data, a teacher can place the target behaviors occur. In
a specific number of rubber bands Jaylen’s case, the time of day or
on her wrist and transfer one rubber setting is less relevant because
band to the other wrist each time emergent literacy skills are not
the behavior is observed. A similar explicitly linked to or dependent on
system could be used to transfer a specific activity. For some
“
objects in pockets or cotton balls behaviors that are of concern
placed in a jar each time the throughout the day, teachers and
Engaging in regular behavior occurs. In Trevor’s case, caregivers may prioritize the most
Mr. Nick wants to record whether important setting for the target
data-based decision Trevor is engaged in different behavior and collect data in that
activities during large-group context only. For example, Trevor’s
making by collecting, instruction. To do this, he places a participation in classroom activities
piece of masking tape on his is important throughout the day, but
graphing, and interpreting clothing for each activity and then
marks on the tape whether or not
Mr. Nick decides that participation
in large-group instruction is the
Trevor is engaged. A similar system priority because of the implications
data is a significant and could be used with multiple pieces for actively engaging in learning
of tape if data are being collected on activities in this setting.
meaningful way to fully more than one child. These data are Data should be collected by the
recorded on a form at a time more person who has the most
engage in the process of convenient for the teacher. Also, opportunity to observe the target
data recording forms can be placed behavior. If Ms. Carol is responsible
intentional, systematic, and on clipboards and placed near the for supervision of the block area
area where the skill will be observed and that is where the behavior most
effective intervention. or in a location that is convenient often occurs, then she would collect
and easily accessible for the teacher. the data. In other cases, more than
Note
You may reach Robin L. Hojnoski by e-mail at roh206@lehigh.edu.
References
Alberto, P. A., & Troutman, A. C. (1999). Applied behavior analysis for
teachers (5th ed.). Upper Saddle River, NJ: Prentice Hall.
Anthony, J. L., & Lonigan, C. J. (2004). The nature of phonological awareness:
Converging evidence from four studies of preschool and early grade school
children. Journal of Educational Psychology, 96, 43-55.
Barnett, D. W., Bauer, A. M., Ehrhardt, K. E., Lentz, F. E., & Stollar, S. A.
(1996). Keystone targets for change: Planning for widespread positive
consequences. School Psychology Quarterly, 11, 95-117.
Browder, D., Demchak, M., Heller, M., & King, D. (1989). An in vivo evaluation
of the use of data-based rules to guide instructional decisions. Journal of the
Association for Persons With Severe Handicaps, 14(3), 234-240.
Brown, W. H., Odom, S. L., & Conroy, M. A. (2001). An intervention
hierarchy for promoting preschool children’s peer interactions in natural
environments. Topics in Early Childhood Special Education, 21, 162-175.
Buysse, V., Winton, P., & Zimmerman, T. (Eds.). (2007). RTI goes to Pre-K: An
early intervening system called recognition and response. Early
Developments, 11, 6-10.
Chandler, L. K., & Dahlquist, C. M. (2002). Functional assessment: Strategies
to prevent and remediate challenging behavior in school settings. Upper
Saddle River, NJ: Merrill/Prentice Hall.
Codding, R. S., Skowron, J., & Pace, G. M. (2005). Back to basics: Training
teachers to interpret curriculum-based measurement data and create
observable and measurable objectives. Behavioral Interventions, 20, 165-176.
Coleman, M. R., Buysse, V., & Neitzel, J. (2006). Recognition and response: An
early intervening system for young children at-risk for learning disabilities.
Full report. Chapel Hill: University of North Carolina at Chapel Hill, FPG
Child Development Institute.
Duda, M. A., Dunlap, G., Fox, L., Lentini, R., & Clarke, S. (2004).
An experimental evaluation of positive behavior support in a
community preschool program. Topics in Early Childhood Special
Education, 24, 143-155.
Early Childhood Research Institute on Measuring Growth and Development.
(2000). Individual Growth and Development Indicators for preschool
children: Rhyming/early literacy. Available online from Center for Early
Education and Development, University of Minnesota, Minneapolis, Web
site: http://www.ggg.umn.edu
Fox, L., Dunlap, G., Hemmeter, M. L., Joseph, G. E., & Strain, P. (2003). The
teaching pyramid: A model for supporting social competence and
preventing challenging behavior in young children. Young Children, 58(4),
48-53.
Fuchs, L. S., & Fuchs, D. (1986). Effects of systematic formative evaluation: A
meta-analysis. Exceptional Children, 53, 199-208.
Fuchs, L. S., Fuchs, D., Hamlett, C. L., & Stecker, P. M. (1991). Effects of
curriculum-based measurement and consultation on teacher planning and
student achievement in mathematics operations. American Educational
Research Journal, 28(3), 617-641.
Godfrey, S. A., Grisham-Brown, J., Schuster, J. W., & Hemmeter, M. L. (2003).
The effects of three techniques on student participation with preschool
children with attending problems. Education and Treatment of Children,
26(3), 255-272.
Ingersoll, B., & Schreibman, L. (2006). Teaching reciprocal imitation skills to
young children with autism using a naturalistic behavioral approach:
Effects on language, pretend play, and joint attention. Journal of Autism
and Developmental Disorders, 36(4), 487-505.
O’Neil, R. E., Horner, R. H., Albin, R. W., & Storey, K. (1996). Functional
assessment and program development for problem behavior: A practical
handbook. Pacific Grove, CA: Brooks Cole.
Sandall, S., & Schwartz, I. (2002). Building blocks for teaching preschoolers
with special needs. Baltimore: Brookes.
Sandall, S. R., Schwartz, I. S., & LaCroix, B. (2004). Interventionists’
perspectives about data collection in integrated early childhood classrooms.
Journal of Early Intervention, 26, 161-174.
Schwartz, I. S., & Olswang, L. B. (1996). Evaluating child behavior change in
natural settings: Exploring alternative strategies for data collection. Topics
in Early Childhood Special Education, 16(1), 82-101.
VanDerHeyden, A. M., & Snyder, P. (2006). Integrating frameworks from early
childhood intervention and school psychology to accelerate growth for all
young children. School Psychology Review, 35(4), 519-534.
Ziolkowski, R., & Goldstein, H. (2008). Effects of an embedded phonological
awareness intervention during repeated book reading on preschool children
with language delays. Journal of Early Intervention, 31(1), 67-90.