Professional Documents
Culture Documents
Jaba 42 01 1 PDF
Jaba 42 01 1 PDF
Jaba 42 01 1 PDF
WILLIAM H. BROWN
UNIVERSITY OF SOUTH CAROLINA
KARIN A. PFEIFFER
MICHIGAN STATE UNIVERSITY
AND
The present study describes the development and pilot testing of the Observation System for
Recording Physical Activity in Children–Home version. This system was developed to document
physical activity and related physical and social contexts while children are at home. An analysis
of interobserver agreement and a description of children’s physical activity in various settings are
presented. The system, which was shown to be reliable, provides a direct observation tool for
researchers who are interested in assessing and intervening in physical activity in the home
environment.
DESCRIPTORS: direct observation, home environment, physical activity, physical
environment, preschool children
________________________________________
Understanding the social and environmental are at risk for becoming overweight (Ogden et
contexts associated with participation in physical al., 2006). In addition, rates are higher for
activity is a critical public health issue (Pate, African-American and Hispanic children and in
2001; Pate, Pfeiffer, Trost, Ziegler, & Dowda, children from low socioeconomic backgrounds.
2004). Currently, 13.9% of all preschool-aged More troubling is that children who were above
children are overweight and an additional 12.3% the 85th percentile for body mass index at 24,
36, or 54 months of age were over five times
Preparation of this article was partially supported by
Grant 3R01HD043125-02S2 from the National Institutes
more likely to be overweight at 12 years of age
of Health. The content and opinions expressed herein do compared to peers who were below the 85th
not necessarily reflect the position or policy of the percentile; further, 60% of children who were
University of South Carolina or the National Institutes overweight as preschoolers were also overweight
of Health, and no official endorsement should be inferred.
We thank Carrie Zier for her excellence in data collection at 12 years of age (Nader et al., 2006). The causes
and Kristen Swaney and Chevy Jeter for their help in of the population trend in childhood obesity
coordinating the project. have not been identified definitively. However, it
Correspondence concerning this article should be
addressed to Kerry L. McIver, 160 Minges Coliseum, is likely that reduced physical activity and
Department of Exercise and Sport Science, College increased participation in sedentary behaviors
of Health and Human Performance, East Carolina are important contributing factors (Dennison,
University, Greenville, North Carolina 27858 (e-mail:
mciverkl@mailbox.sc.edu). Erb, & Jenkins, 2002; Epstein, Paluch, Gordy,
doi: 10.1901/jaba.2009.42-1 & Dorn, 2000; Gortmaker et al., 1996).
1
2 KERRY L. MCIVER et al.
purpose of our paper is to provide preliminary first version of the OSRAC-H was field tested.
data on children’s physical activity in their Two observers, previously trained on the
homes collected with the OSRAC-H and to OSRAC-P system, completed several booster
provide interobserver agreement analyses of the sessions prior to observing in children’s homes.
same data. The purpose of these booster sessions was to
examine interobserver agreement on the re-
METHOD tained observational categories, especially phys-
ical activity level and group composition, while
Development of the OSRAC-H at the same time preparing the observers for
To develop the OSRAC-H, a preliminary subsequent home observations.
evaluation of the existing direct observation The final version of the OSRAC-H differs from
system, OSRAC-P (Brown et al., 2006), was the OSRAC-P in that it contains specific indoor
conducted by a team of researchers who and outdoor activity context codes relevant to
developed the observational assessment. The homes. The OSRAC-H includes codes in two
OSRAC-P was developed to observe behaviors additional categories: (a) engagement, to assess
in preschool settings and contained the follow- parent and peer engagement in children’s activi-
ing observational categories: (a) physical activity ties; and (b) television (TV) use, to determine
levels, (b) physical activity types, (c) locations, whether the TV was on during home activities. A
(d) indoor activity contexts, (e) outdoor activity complete list of the categories and codes in the
contexts, (f ) activity initiators, (g) group com- OSRAC-H is available in the Appendix.
positions, and (h) adult and peer prompts for To obtain data on children’s physical activity
physical activity. Observers use a focal-child and related contextual variables using the
momentary time-sampling procedure with 5-s OSRAC-H, families were recruited from a
observe and 25-s record intervals every 30 s. variety of socioeconomic and geographic strata.
This yields two observation intervals per minute All families gave their informed consent, and
and 60 observation intervals per 30-min session. the institutional review board at the University
Observations are coded using INTMAN soft- of South Carolina approved the study and
ware (Tapp & Wehby, 2000) on handheld consent procedures.
computers. In our coding system, the highest
level of physical activity during the 5-s observe Procedure
period is coded, and all accompanying obser- Thirteen children were observed in their
vational information is recorded with reference homes on three occasions for 1.5 hr each. Three
to the highest activity level. The accompanying visits were conducted in order to observe and
codes are recorded after physical activity level in describe patterns of behavior across several days.
the order presented in the Appendix. In this During each home visit, three 30-min observa-
system, each category is mutually exclusive, and tions were completed. Home visits took place
only one code per category is allowable for each on two weeknights between 5:00 p.m. and 8:00
interval. p.m. and one Saturday between 9:00 a.m. and
During the initial refinement for the OS- 2:00 p.m. Children were observed for nine
RAC-H, researchers retained relevant codes observations, totaling 4.5 hr per child. Data
from the OSRAC-P. Informal environmental were collected according to the families’
observations were then conducted in three availability, and scheduled times may have
homes to identify additional codes that were included dinner or lunch observations; however,
needed to capture potential contextual infor- no observations were conducted while children
mation specific to homes. After additions and were preparing for bed (e.g., bathing, changing
modifications to the observational protocol, the clothes).
4 KERRY L. MCIVER et al.
Note. A/(A+D) is total number of agreements divided by the total number of agreements plus disagreements.
activities were coded for slightly more than Alternatively, when a child was running, the
2.4% of the recorded intervals, as indicated by physical activity level was always coded as Level
an activity Level 4 (moderate movement), and 5 (fast movement). In general, the majority of
slightly more than 4.7% of intervals were the activity types represented were sedentary in
recorded as Level 5 (fast movement), indicating nature. As the figure shows, very few intervals
vigorous activity. Levels 4 and 5 were combined were coded as MVPA for the total sample. The
to represent MVPA (7.1% of intervals). For the least active child spent many more intervals in
most active child, 28.6% of all intervals were lie down, sit or squat, and stand activities than
coded as light activity and 16.5% were coded as did the most active child. In comparison, the
MVPA, whereas the least active child had 13% most active child had 72 observation intervals
of intervals coded as light activity and 1.9% coded as MVPA, and the least active child had
coded as MVPA. only 10 observation intervals coded as MVPA.
Figure 2 presents the proportion of intervals The most active child also engaged in more
coded as sedentary, light, or MVPA by physical types of activities than the least active child.
activity type for the most active child, least The indoor and outdoor activity contexts are
active child, and total sample. Each panel mutually exclusive, in that if indoor was coded
represents the range of activity intensities for location, only indoor contexts can be coded;
performed within each code. To better illustrate the outdoor activity context was coded as not
the number of intervals represented and the applicable and vice versa. As shown in Figure 3,
intensity of activities performed for the most physical activity levels for the total sample
active and least active children, the y axes are the during indoors were mostly sedentary. The
same for those panels. For type of activity, activity contexts that were associated with more
several codes were inherently restricted to allow intervals of light activity and MVPA were
only Levels 1 and 2 (sit or squat, stand), whereas chores, transition, rough and tumble, and gross
others could represent a range of levels for motor. The least active child spent many more
movement (e.g., jump or skip, climb, ride). observation intervals participating in indoor
6 KERRY L. MCIVER et al.
Figure 1. Percentage of intervals spent in sedentary, light, moderate, and vigorous physical activity for the total
sample, the most active child, and the least active child.
activities than the most active child (470 and observation intervals, respectively). When out-
281 observational intervals, respectively). Al- doors, the least active child was observed in
though indoor activities were generally seden- MVPA during fewer intervals than the most
tary for both children, the least active child active child (6 and 42 observational intervals,
spent more intervals in sedentary activities. respectively). Children were not observed in all
Specifically, the least active child participated in contexts. For example, the least active child did
many more intervals of TV watching and snacks not participate in any ball or object play,
than the most active child. whereas the most active child participated
When children were outside (Figure 4), a mostly in ball or object play when outdoors.
higher proportion of intervals were coded as Engagement was defined as participation by
light activity or MVPA for the total sample. adults, siblings, or peers in the same activity in
The outdoor activity contexts associated with which focus children were participating during
more intervals of light activity and MVPA an interval. Parents, siblings, and peers were not
include open space, pets, games, and ball or engaged with the children during 58% of the
object play. The least active child was observed intervals observed. Adults were engaged with
in outdoor activity contexts for many fewer the children during 13% of the recorded inter-
intervals than the most active child (57 and 157 vals, whereas peers were engaged with them
PHYSICAL ACTIVITY IN HOMES 7
Figure 2. Proportion of intervals coded as sedentary, light, and moderate-to-vigorous physical activity by physical
activity type for the most active child (top), the least active child (middle), and the total sample (bottom).
8 KERRY L. MCIVER et al.
Figure 3. Proportion of intervals coded as sedentary, light, and moderate-to-vigorous physical activity by indoor
activity context for the most active child (top), the least active child (middle), and the total sample (bottom).
PHYSICAL ACTIVITY IN HOMES 9
during 17% of the intervals. During 11% of the that the majority of children’s time was spent in
recorded intervals, both adults and peers were sedentary activities. While indoors, children
engaged in the activity with the children. spent 25% of their time involved in screen-time
Statistically, when children were indoors, their activities such as TV watching, playing video
physical activity levels were significantly games, and using the computer. When out-
lower when other persons (i.e., parents, sib- doors, children tended to be more physically
lings, peers, or some combination) were active than when they were indoors, and they
engaged in the activity with them compared spent a larger proportion of the observed
to when they were involved in a solitary activity intervals in MVPA while riding wheeled toys,
(p 5 .0008; data not shown). When children playing in open spaces, and using balls and
were outdoors, differences in their activity levels other gross motor toys.
were not evident during engagement or no Future users of the OSRAC-H will be able to
engagement. link moment-to-moment social and environ-
mental contextual information to children’s
physical activity in their homes. The informa-
DISCUSSION
tion gained from observations can assist re-
In this paper, we described the development searchers in determining the specific contexts
of the OSRAC-H and provided results from an and the circumstances related to those contexts,
application of the assessment. The OSRAC-H in which children are most active as well as
was developed using the OSRAC-P core those in which they are least active. The
categories and codes (Brown et al., 2006) with OSRAC-H was used in the current study to
additional categories and codes specific to describe physical activity in children at home
common indoor and outdoor activity contexts and identified different individual activity
in homes being integrated into the modified patterns for each child observed. To date, we
observational system. The OSRAC-H provides have employed the observational system (i.e.,
researchers with a contemporary system that can OSRAC-P) in a single pilot study (Brown,
be used with customized software programs 2006). Nevertheless, the system demonstrated
(e.g., Tapp & Wehby, 2000) to record its usefulness in measuring differences in
children’s physical activity in their homes. children’s physical activity levels when they
Specifically, it provides additional contextual participated in teacher-implemented interven-
information on indoor and outdoor activity tions compared to their routine outdoor
contexts in the home setting; TV use; and activities on preschool playgrounds. We also
engagement with parents, siblings, and peers. believe that the observational system will be
Hence, the OSRAC-H represents a relatively useful in monitoring intervention implementa-
comprehensive measurement method that is tion (e.g., adult-implemented physical activities,
specific to physical activity and accompanying prompts for activity) as well as determining
contextual circumstances within homes. The physical activity before and following interven-
system may be useful in future research as either tion. The OSRAC-H system described different
a primary observational tool or as part of a activity patterns for 2 of the children from our
multimethod assessment of young children’s sample. Future research should determine if
physical activity. aggregating more data across longer periods of
The secondary aim of this paper was to time elucidates meaningful differences in young
provide preliminary and illustrative information children’s physical activity.
on the physical activity of children in their The OSRAC-H can be used as both a process
homes in our pilot sample. Our data indicated and outcome evaluation tool with interventions.
10 KERRY L. MCIVER et al.
Figure 4. Proportion of intervals coded as sedentary, light, and moderate-to-vigorous physical activity by outdoor
activity context for the most active child (top), the least active child (middle), and the total sample (bottom).
PHYSICAL ACTIVITY IN HOMES 11
For example, from our pilot data, we deter- mately 20 hr of booster training sessions prior
mined that boys were less active with TVs on to the start of this pilot study. Second, observer
than with TVs off, even if they were not agreement estimates may be influenced greatly
engaged in watching TV (data not shown). The by the rate of occurrence or nonoccurrence of
data indicate that with TVs off, children might behavior; in this case, occurrence and non-
be more likely to choose physical activity or occurence are specific to physical activity levels
educational pursuits inside, including playing and the accompanying codes associated with
with manipulative or gross motor toys. A those behaviors. The extremely low frequency of
potential intervention component to reduce codes in certain categories (e.g., activity initia-
children’s screen time and increase their MVPA tor, prompts) led to kappa coefficients below
might include restricting TV and other screen- .60. We acknowledge the limitation of kappa
time activities. The OSRAC-H could be used to for representing interobserver agreement with
describe any changes from sedentary activity rare behavioral events and included interval-by-
contexts to more active contexts and any altered interval percentage agreement as an additional
patterns of children’s physical activity levels method to estimate interobserver agreement.
following the reduction of TV use in homes. From our preliminary efforts, we believe that
Another potential intervention could include when observers are well trained, they may easily
increasing time spent outdoors with accompa- learn to employ both the OSRAC-P and
nying parental involvement in and encourage- OSRAC-H systems, with the coding differences
ment of children’s physical activity. The being obvious for preschool and home settings.
OSRAC-H system could be used not only to The OSRAC-H is a relatively comprehensive
document a change in time spent indoors and tool with its categories and codes for physical
outdoors but also to document any parental activity types, contexts, engagement, and TV
encouragement of and engagement in children’s use. Nevertheless, similar to many other direct-
physical activity. observation measures, the OSRAC-H is not
Based on our pilot study and the resulting without its limitations. First, like most previ-
interobserver agreement information gathered, ously developed observation systems, concur-
the OSRAC-H appears to be a reliable, multi- rent validity information is not presently
categorical direct-observation assessment that available. Comparison of the observation data
may be useful in home settings; however, several with another objective measure of physical
aspects of the system warrant further discussion activity (e.g., accelerometer data) might provide
before its adoption. First, similar to many information that is useful in validating physical
complex observational systems, extensive train- activity levels as determined by direct observa-
ing with the system is necessary before it can be tion. Second, the contexts contained in the
used as a reliable measurement tool in the field. OSRAC-H are specific to children’s homes and
Data collectors in this study underwent an their immediate home surroundings. This was
intensive 8-week training period on the OS- the intent of our pilot research, but if one
RAC-P, which included written tests on the wanted to observe the physical activity of
categories and codes, observational training children across extended neighborhood or
sessions with videotapes and in situ, and community contexts (e.g., elementary schools,
interobserver agreement sessions with a gold- community-based recreational programs, parks
standard observer (i.e., previously well-trained and playgrounds), another broader system with
researcher). Observers had extensive experience additional contextual codes will be necessary.
in live observation coding (over 150 hr) using Third, whereas the system contains a category
the OSRAC-P system and completed approxi- and codes for adult and peer activity prompts, a
12 KERRY L. MCIVER et al.
specific separate code for responses to a prompt children’s homes. However, we do believe that
is not defined in the current system. Hence, the sample was adequate to demonstrate the
researchers who are interested in information fundamental measurement properties (e.g.,
related to immediate effects of prompting will interobserver agreement and sensitivity to
need to establish a category with accompanying individual child differences) of the OSRAC-H
codes to measure any potential responses. and show its feasibility and applicability for use
A fourth potential limitation of many in children’s homes.
contemporary observation systems is that real- Children’s physical activity data obtained
time information is not available for behaviors from direct-observation studies conducted in
or the contextual circumstances of the behaviors homes is important in guiding the development
of interest. The OSRAC-H system employs a and evaluation of effective interventions to
5-s observe and 25-s record momentary time- increase children’s MVPA and to decrease their
sampling procedure. Although the INTMAN excessive sedentary behaviors (Brown et al.,
software allows customization of the observe 2006; Pate, 2001). Important descriptive infor-
and record interval lengths, observing multiple mation may be systematically collected con-
behaviors for longer periods of time or in real cerning children’s preferences for physical
time may introduce additional error in observ- activities and the level of parental and sibling
ers’ abilities to collect reliable information due assistance needed to enhance children’s healthy
to children’s rapid changes in activity types, lifestyles. In addition, given that screen-time
levels, and circumstances (Brown et al., 2006). estimates are often misreported by parents’ and
Nevertheless, we believe that observing relative- children’s self-reports, the OSRAC-H makes
ly short periods of time frequently and for possible the objective determination of screen-
multiple 30-min sessions allowed us to capture time use. Whereas the results of this study are
reliable physical activity and accompanying correlational, we believe that manipulation of
contextual information. Indeed, time-sampling some of the contexts associated with both lower
procedures have been employed frequently and and higher levels of physical activity may assist
effectively in numerious direct-observation researchers in identifying arrangements that are
studies (Hanley, Cammilleri, Tiger, & Ingvars- conducive to higher physical activity levels for
son, 2007; cf. Brown, Odom, Li, & Zercher, young children. In the future, our direct-
1999; Hartmann & Wood, 1990). Neverthe- observation system and similar assessments
less, in the future, with similar complex may be used to evaluate the effectiveness of
observational systems, researchers may want to interventions that are aimed at a variety of
carefully evaluate the extent to which relatively strategies for enhancing children’s physical
short sampling intervals can be lengthened to activity. These strategies could include reducing
capture children’s behavior while maintaining overall screen time, encouraging parental in-
accurate assessment of the behaviors of interest. volvement in and support of MVPA, and
Finally, our prelimary study with the OS- providing equipment and activities to promote
RAC-H, although stratified by socioeconomic healthier lifestyles. As with many direct-obser-
and geographic status, employed a very small vation systems, we anticipate that other inves-
sample of 3- to 6-year-old children in their tigators will adapt and enhance the measure-
homes. The activity contexts developed in this ment protocol to better meet their specific
age group may not always be relevant for older research needs. Nevertheless, we believe that the
children, particularly adolescents. Our relatively OSRAC-H (and its core behavioral, social, and
small sample limits the generalizability of the environmental dimensions that are related to
results to the general population of young potential influences on children’s physical acti-
PHYSICAL ACTIVITY IN HOMES 13
vity behaviors in their homes) is an important among children in the United States, 1986–1990.
Archives of Pediatric and Adolescent Medicine, 150,
addition to the measurement of young chil- 356–362.
dren’s physical activity. Hanley, G. P., Cammilleri, A. P., Tiger, J. H., &
Ingvarsson, E. T. (2007). A method for describing
preschoolers’ activity preferences. Journal of Applied
REFERENCES Behavior Analysis, 40, 603–618.
Baranowski, T., Thompson, W. O., DuRant, R. H., Hartmann, D. P., & Wood, D. D. (1990). Observational
Baranowski, J., & Puhl, J. (1992). Observations on methods. In A. S. Bellack, M. Hersen, & A. E. Kazdin
physical activity in physical locations: Age, gender, (Eds.), International handbook of behavior modification
ethnicity, and months effects. Research Quarterly for and therapy (pp. 107–138). New York: Plenum.
Exercise Science, 64, 127–133. Landis, J. R., & Koch, G. G. (1977). The measurement of
Bijou, S. W., Peterson, R. F., & Ault, M. H. (1968). A observer agreement for categorical data. Biometrics,
method to integrate descriptive and experimental field 33, 159–174.
studies at the level of data and empirical concepts. McKenzie, T. L., Marshall, M. A., Sallis, J. F., & Conway,
Journal of Applied Behavior Analysis, 1, 175–200. T. L. (2000). Leisure-time physical activity in school
Brown, W. H. (2006, February). Teacher-implemented environments: An observational study using SO-
interventions to enhance young children’s physical PLAY. Preventive Medicine, 30, 70–77.
activity in preschools. Poster session presented at the McKenzie, T. L., Sallis, J. F., Patterson, T. L., Elder, J. P.,
fifth biennial Conference on Research Innovations in Berry, C. C., Rupp, J. W., et al. (1991). BEACHES:
Early Intervention, San Diego, CA. An observational system for assessing children’s eating
Brown, W. H., Odom, S. L., Li, S., & Zercher, C. (1999). and physical activity behaviors and associated events.
Ecobehavioral assessment in early childhood pro- Journal of Applied Behavior Analysis, 24, 141–151.
grams: A portrait of preschool inclusion. Journal of Nader, P. R., O’Brien, M., Houts, R., Bradley, R., Belsky,
Special Education, 33, 138–153. J., Crosnoe, R., et al. (2006). Identifying risk for
Brown, W. H., Pfeiffer, K., McIver, K. L., Dowda, M., obesity in early childhood. Pediatrics, 118, 594–601.
Almeida, J., & Pate, R. (2006). Assessing preschool Ogden, C. L., Caroll, M. D., Curtin, L. R., McDowell,
children’s physical activity: An Observational System M. A., Tabak, C. J., & Flegal, K. M. (2006).
for Recording Physical Activity in Children–Pre- Prevalence of overweight and obesity in the United
school Version (OSRAC-P). Research Quarterly for States, 1999–2004. Journal of the American Medical
Exercise and Sport, 77, 167–176. Association, 295, 1549–1555.
Dennison, B. A., Erb, T. A., & Jenkins, P. L. (2002). Pate, R. R. (2001). Assessment of physical activity and
Television viewing and television in bedroom associ- sedentary behavior in preschool children: Priorities for
ated with overweight risk among low-income pre- research. Pediatric Exercise Science, 13, 129–130.
school children. Pediatrics, 109, 1028–1035. Pate, R. R., Pfeiffer, K. A., Trost, S. G., Ziegler, P., &
DuRant, R. H., Baranowski, T., Puhl, J., Rhodes, T., Dowda, M. (2004). Physical activity in children
Davis, H., Greaves, K. A., et al. (1993). Evaluation of attending preschools. Pediatrics, 114, 1258–1263.
the Children’s Activity Rating Scale (CARS) in young Sallis, J. F. (1991). Self-report measures of children’s phy-
children. Medicine and Science in Sports and Exercise, sical activity. Journal of School Health, 61, 215–219.
25, 1415–1421. Sirard, J. R., & Pate, R. R. (2001). Physical activity
Epstein, L. H., Paluch, R. A., Gordy, C. C., & Dorn, J. assessment in children and adolescents. Sports Medi-
(2000). Decreasing sedentary behaviors in treating cine, 31, 439–454.
pediatric obesity. Archives of Pediatric and Adolescent Tapp, J., & Wehby, J. (2000). Observational software for
Medicine, 154, 220–226. laptop computers and optical bar code time wands. In
Finn, K. J., & Specker, B. (2000). Comparison of T. Thompson, D. Felce, & F. Symons (Eds.),
actiwatch activity monitor and Children’s Activity Behavioral observation: Technology and applications in
Rating Scale in children. Medicine and Science in developmental disabilities (pp. 71–82). Baltimore:
Sports and Exercise, 32, 1794–1797. Brookes.
Fulton, J. E., Burgeson, C. R., Perry, G. R., Sherry, B., Watkins, M. W., & Pacheco, M. (2000). Interobserver agree-
Galuska, D. A., Alexander, M. P., et al. (2001). ment in behavioral research: Importance and calculation.
Assessment of physical activity and sedentary behavior Journal of Behavioral Education, 10, 205–212.
in preschool-age children: Priorities for research.
Pediatric Exercise Science, 13, 113–126.
Gortmaker, S. L., Must, A., Sobol, A. M., Peterson, K., Received February 14, 2007
Colditz, G. A., & Dietz, W. H. (1996). Televi- Final acceptance November 20, 2007
sion viewing as a cause of increasing obesity Action Editor, Gregory Hanley
14 KERRY L. MCIVER et al.
APPENDIX
Observational Categories, Accompanying Codes, and Brief Descriptions for the OSRAC-H
APPENDIX
(Continued)
APPENDIX
(Continued)
Engagement codesa
None Adults or peers are not engaged in the activity in which the child is
participating
Adult Adult is actively engaged in the activity in which the child is participating
and no peers are engaged
Peer Peer is actively engaged in the activity in which the child is participating
and no adults are engaged
Adult and peer Adults and peers are actively engaged in the activity in which the child is
participating
TV use codesa
Off The TV is off in the room in which the child is located
On The TV is on in the room in which the child is located
Not applicable There is no TV in the room in which the child is located or the child is
outside
a
Indicates changes or additions to the OSRAC-P.