Lec 5 Assessment of Disruptive Behavior Disorders Tools and Recommendations

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

Professional Psychology: Research and Practice © 2012 American Psychological Association

2012, Vol. 43, No. 6, 641– 649 0735-7028/12/$12.00 DOI: 10.1037/a0027324

Assessment of Disruptive Behavior Disorders: Tools and Recommendations

Cliff McKinney and Melanie Morse


Mississippi State University

Distinguishing between disruptive and normative behavior is a challenging task. How to best assess for
disruptive behavior in children and adolescents is a significant question encountered by many profes-
sionals. The purpose of this review is to summarize the existing research regarding reliable and valid
tools for assessing disruptive behavior disorders. Following a summary of these various tools available
to clinicians, recommendations for the assessment of disruptive behavior disorders are suggested. These
recommendations include ideal situations where comprehensive assessments may be conducted as well
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

as situations where resources may be limited. Clinicians must conduct as thorough of an assessment as
This document is copyrighted by the American Psychological Association or one of its allied publishers.

feasible so that accurate diagnoses and recommendations may be made to inform treatment.

Keywords: disruptive behavior, assessment, etiology, children, adolescents

Most individuals have seen a child acting out or have heard of whereas prolonged tantrums are characteristic of a clinical disorder
a teenager in trouble with the law. After all, kids will be kids, (Wakschlag et al., 2007). Further, disruptive behaviors occur
right? However, the distinction between normative behavior and across the ages and are present normally, to some extent, in
clinically disruptive behavior must be determined with a proper toddlerhood and throughout the teenage years (McKinney & Renk,
assessment. What factors must a clinician take into account when 2007). Dispute also exists over whether preschool-aged children
assessing for disruptive behavior disorders (DBDs), which include are developmentally distinguished enough to receive a DBD diag-
oppositional defiant disorder (ODD), conduct disorder (CD), and nosis (Keenan & Wakschlag, 2002). Some researchers argue that
attention deficit/hyperactivity disorder (ADHD), and what tools atypical behaviors in preschoolers are temporary developmental
are available to assess those factors? To answer the question at disruptions related to the beginning of independence from care-
hand, the current review begins with an exploration of develop- givers (Keenan & Wakschlag, 2002; Pelletier, Collett, Gimpel, &
mental considerations and the issue of comorbidity. Then, assess- Crowley, 2006). Other researchers argue that atypical behaviors
ment methods are summarized and recommendations for a reliable displayed by preschool-aged children should not be used to clas-
and valid assessment are made. sify a behavior problem but to identify a disturbance within the
parent– child relationship (Zeanah, Boris, & Scheeringa, 1997).
Developmental and Gender Considerations To help address these concerns, Wakschlag, Tolan, and Lev-
Assessment of the core features of DBDs in children has proven enthal (2010) argue for a developmentally specific classification
to be challenging for several reasons. No precise standard has been for preschool disruptive behavior. For example, Diagnostic and
accepted to accurately distinguish these common early childhood Statistical Manual of Mental Disorders (4th ed.; DSM–IV; Amer-
behaviors from behaviors of clinical concern (Wakschlag et al., ican Psychiatric Association, 1994) criteria for DBDs are worded
2007). For instance, developmental studies have found that tan- in a way that may not necessarily reflect behavior in preschoolers
trums lasting only a couple of minutes are considered normative (e.g., a preschooler is unlikely to use a weapon but may hit others).
behavior for preschoolers (Potegal, Kosorok, & Davidson, 2003), Wakschlag et al. (2010) further argue that types of aggression
frequently observed among preschoolers (e.g., reactive aggression
as a response to frustration) are developmentally appropriate and
suggest that atypical patterns of temper loss, aggression, noncom-
This article was published Online First March 5, 2012.
pliance, and low concern for others among preschoolers merits a
CLIFF MCKINNEY received his PhD in clinical psychology from the Uni-
versity of Central Florida. He is an assistant professor of psychology at warning sign for parents and clinicians. Given the large debate
Mississippi State University. His research interests include etiology and about the developmental appropriateness of DBD assessment, the
assessment of disruptive behavior disorders, parenting, and child adjust- reader is referred to Wakschlag et al. (2010) for more details.
ment. Despite the controversy, recent studies have found that problem
MELANIE MORSE received her BA in psychology from Hendrix College. behavior patterns do begin during the first few years of life (Carter,
She is a graduate student in the MS in clinical psychology program at Briggs-Gowan, Jones, & Little, 2003). Research on preschool
Mississippi State University. Her research interests include social desir- disruptive behavior finds that early disruptiveness may be distin-
ability, self-report of substance use, and multicultural mental health service
guished from normal childhood behavior as early as 3 years of age
delivery.
CORRESPONDENCE CONCERNING THIS ARTICLE should be addressed to Cliff (Moreland & Dumas, 2008). Research shows that parental char-
McKinney, Mississippi State University, Department of Psychology, P.O. acteristics, such as psychopathology, stress, and inconsistent and
Box 6161, MS State, MS 39762. E-mail: cmckinney@psychology harsh parenting practices, play a role in the development of DBDs
.msstate.edu (Capaldi, Conger, Hops, & Thornberry, 2003; Wakschlag &

641
642 MCKINNEY AND MORSE

Keenan, 2001). Disruptive behavior problems among preschoolers Assessment Methods


also are stable over extended periods of time. Roughly half of
children who exhibit significant behavior problems during the Despite the concerns noted here, clinicians must continue to
preschool years continue to demonstrate problems in the future assess and diagnose to the best of their abilities. Thus, a discussion
(Moreland & Dumas, 2008; Pelletier et al., 2006). If left untreated, of tools for the assessment of DBDs is presented, followed by
disruptive behavior problems are likely to escalate over time and, recommendations for their most effective use.
in turn, elevate the child’s risk of developing other psychiatric
disorders in adulthood (Pelletier et al., 2006). Interviewing Methods
Given that the course and symptoms of DBDs may be different
for males and females, gender also must be considered. Although Interviewing methods are a common tool used to assess for a
gender differences may be small, some trends have been identified. variety of disorders and include the Kiddie Schedule for Affective
For example, Kroneman, Loeber, Hipwell, and Koot (2009) state Disorders and Schizophrenia: Present-Lifetime Version
that boys typically display more disruptive behavior than girls (KSADS-PL) and the Diagnostic Interview Schedule for Children
(DISC). These diagnostic interviews may be administered in 1–2
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

before puberty, whereas this difference levels off during puberty.


This document is copyrighted by the American Psychological Association or one of its allied publishers.

From early to late adolescence, girls show a faster increase in hr to children and caregivers. In particular, the behavioral supple-
symptoms of disruptive behavior compared with boys. Overall, ment of the KSADS-PL is useful to assess for symptoms of
girls display less disruptive behavior than boys, but girls who are ADHD, ODD, and CD, whereas the other parts of the interview are
referred to clinics typically present with more severe behavioral useful to assess for comorbid diagnoses. The KSADS-PL has
symptoms than boys. Kroneman et al. (2009) further state that demonstrated strong psychometrics, including good interrater re-
boys are more likely to show aggression aimed at harming others liability and discriminant and predictive validity (Birmaher et al.,
physically (e.g., hitting, biting), whereas girls are more likely to 2009). The DISC has demonstrated strong psychometrics as it is
display aggression aimed at harming others socially (i.e., relational sensitive to detecting DBDs and has cross-informant agreement
aggression; e.g., spreading rumors or threatening to retract friend- and concurrent and predictive validity (Jewell, Handwerk,
ship). Almquist, & Lucas, 2004).

Rating Scales
Comorbidity
Research has found that DBDs may be assessed reliably across
Another complication with the diagnosis of DBDs in children the age range with the use of parent rating scales (Task Force on
deals with the frequent overlap in symptoms among ODD, CD, Research Diagnostic Criteria: Infancy and Preschool, 2003). Ad-
and ADHD (Pelletier et al., 2006). Research suggests that over half vantages to using parent report data include that it usually is easy
of the children who meet criteria for ODD or CD also meet criteria to obtain, administer, score, and interpret (Reedtz et al., 2008). The
for ADHD (Pelletier et al., 2006). This finding poses a concern use of parental report also makes it easy for clinicians to establish
about whether symptoms of ADHD, ODD, and CD should be a foundation for discussing with parents ways to manage and
considered as separate constructs or as multiple dimensions of the reduce disruptive behavior in children (Reedtz et al., 2008). In
same construct (Pelletier et al., 2006). For example, research addition to parent report, many rating scales also rely on teachers.
suggests distinct differences in the expression of ODD and CD in Teacher ratings of disruptive behaviors in children are especially
children with and without ADHD, where children with comorbid important because teachers commonly give students referrals to
diagnoses experience higher rates of ADHD symptom severity, mental health services. Teachers are exposed to groups of children
delinquent behavior, and overt aggression (Connor & Doerfler, on a daily basis; therefore, they easily can compare typical and
2008). Additionally, research indicates that ODD is predictive of atypical behaviors among children (Pelletier et al., 2006).
future CD, and that ADHD is predictive of future ODD and CD One system that utilizes multiple informants is the Achenbach
(Pardini & Fite, 2010), suggesting that these disorders may be System of Empirically Based Assessment (ASEBA). This system
related to developmental pathways or common etiologies (e.g., includes the Child Behavior Checklist (CBCL; completed by care-
atypical brain development; Kaplan, Dewey, Crawford, & Wilson, givers), the Teacher Report Form (TRF), and the Youth Self
2001). Report (YSR). This system is used to assess for behavioral and
Research also suggests a relationship between DBDs and other emotional problems, and has different forms for different age
disorders. Research finds that children with ADHD in a commu- groups ranging from preschool age to adulthood. It takes approx-
nity sample often have one (44%) or more (43%) comorbid dis- imately 10 –30 min to complete the various forms (Flanagan,
orders (Barkley, 2003). Community samples also suggest that 2005). The ASEBA has demonstrated strong psychometrics, in-
children with DBDs are more likely to be diagnosed with major cluding content, criterion-related, and construct validity, and high
depressive disorder, learning disorders, and communication disor- test–retest, interrater, and internal consistency reliability (Achen-
ders (McKinney & Renk, 2007). Further, approximately 25% of bach & Rescorla, 2001; Flanagan, 2005).
clinic-referred children with ADHD also had an anxiety disorder. The Behavior Assessment System for Children (BASC) is an-
Research on the comorbidity of ADHD and bipolar disorder is other system that relies on multiple informants and is similar to the
inconclusive, although some studies have found comorbidity rates ASEBA. The BASC is designed to assess for emotional and
between 10 –20%. DBDs also may present with associated devel- behavioral disorders among individuals ages 2–25 years and in-
opmental and social problems, including motor incoordination and cludes a Teacher Rating Scale (TRS), Parent Rating Scale (PRS),
impaired intellectual and academic functioning (Barkley, 2003). and Self-Report of Personality (SRP). The BASC has demon-
DISRUPTIVE BEHAVIOR ASSESSMENT 643

strated good psychometrics, including concurrent and construct preschoolers. The DB-DOS utilizes two types of observational
validity, and high internal consistency, test–retest, and interrater methods. The first is a laboratory-based method known as a
reliability (Stein, 2007). “performance-based” task, aimed at obtaining specific clinically
The Eyberg Child Behavior Inventory (ECBI) is another rating relevant processes in children. Performance tasks may include
scale available to detect the behaviors associated with DBDs in simulations, tasks with the child alone, or tasks where the parental
children that relies on parent report. The ECBI consists of 36 behavior is scripted to systematically elicit the full range of be-
specific problem behaviors and their frequency. The ECBI has haviors relevant to a particular diagnosis. The DB-DOS also in-
demonstrated concurrent and construct validity as well as good cludes diagnostic observation, which is structured to allow for a
test–retest and internal consistency reliability across gender, age, wide range of clinically relevant behaviors to be observed, and
and ethnic groups (Whiston & Bouwkamp, 2003). clinical judgment may be used to rate behaviors on a continuum of
The Strengths and Difficulties Questionnaire (SDQ) is a 25-item atypicality, ranging from normative variation to clinically con-
measure that may be completed by parents and teachers for chil- cerning. The DB-DOS demonstrates good interrater and test–retest
dren age 3–16 years and by children age 11–16 years. The SDQ reliability as well as strong predictive and concurrent validity
has five subscales that assess for emotional symptoms, conduct (Wakschlag et al., 2005; 2007).
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

problems, hyperactivity-inattention, peer problems, and prosocial


behavior. An advantage of the SDQ is that it has been translated Intellectual and Achievement Assessment
into over 60 languages and is a good screening measure, as it is
short, includes positive items, and is easy to score (Stone, Otten, Children with DBDs tend to have lower verbal intelligence and
Engels, Vermulst, & Janssens, 2010). The SDQ has shown good achievement than other children, which may be related to reduced
psychometrics, including construct and concurrent validity, and communication and/or executive functioning skills (Pihl, Vant, &
high internal consistency and adequate interrater reliability (Stone Assaad, 2003). Deficits in these areas are found in children with
et al., 2010). ADHD who frequently experience comorbid DBDs, whereas chil-
Other rating scales that assess disruptive behavior and have dren with only ODD or CD usually do not have these cognitive
adequate psychometrics include the Disruptive Behavior Rating deficits (Hogan, 1999). Additionally, learning disorders are comor-
Scale – Parent Version (Friedman-Weieneth, Doctoroff, Harvey, & bid with DBDs, as described previously. Due to the evidence
Goldstein, 2009), the Disruptive Behavior Disorders Rating Scale suggesting a link between DBDs and intelligence and achieve-
(Pelletier et al., 2006), the Child and Adolescent Disruptive Be- ment, clinicians may assess intellectual and achievement function-
havior Inventory (Shipp, Burns, & Desmul, 2010), and the School ing as part of a comprehensive assessment.
Situations Questionnaire (Pelletier et al., 2006). Overall, it is The Wechsler series of intelligence tests includes the Wechsler
important to note that discrepancies among informants may be Preschool and Primary Scale of Intelligence–Third Edition
common and related to mental health issues, social characteristics, (WPPSI-III), the Wechsler Intelligence Scale for Children–Fourth
or differences in the amount of time spent with the child (Bingham, Edition (WISC-IV), and the Wechsler Adult Intelligence Scale–
Loukas, Fitzgerald, & Zucker, 2003). Further, although rating Fourth Edition (WAIS-IV). The WPPSI-III may be used to assess
scales are certainly a useful tool in identifying DBDs among children ages 2 years 6 months to 7 years 3 months. The measure
children and adolescents, they should be used only as an aid rather yields scores for Verbal and Performance indices for all ages as
than a sole determinant in DBD diagnosis (Manning & Miller, well as a Processing Speed Index for ages 4 years and up. The
2001). Verbal Index and Performance Index scores factor into the Full
Scale IQ score, which has a mean of 100 and a standard deviation
Observational Assessment of 15. The Wechsler Intelligence Scale for Children–Fourth Edi-
tion (WISC-IV) and Wechsler Adult Intelligence Scale–Fourth
In addition to general behavioral observations that may be done Edition (WAIS-IV) are similar to the WPPSI-III but are for use
during testing, at home, or in the classroom, structured diagnostic with children ages 6 years to 16 years 11 months, and 16 years and
observations are an effective standardized tool for identifying older, respectively. Verbal Comprehension, Perceptual Reasoning,
DBDs (Wakschlag et al., 2007). Observed behaviors within the Working Memory, and Processing Speed indices load onto the Full
laboratory have been found to accurately reflect everyday behavior Scale IQ score for both tests. These measures demonstrate excel-
(Wakschlag et al., 2005). Thus, observational measures of DBDs lent psychometrics and are widely used to test the intelligence of
function as valuable supplements to parental reports. Observa- children (Madle, 2005; Maller, 2005).
tional methods are particularly important in the assessment of The Stanford-Binet–Fifth Edition (SB5) is a test of intelligence
DBDs in children because they provide relevant information that and may be used for ages 2 years to 89 years 11 months. The
the child would not typically disclose on his or her own, enable the measure yields a Full Scale IQ score as well as two domain scores
discovery of salient behaviors, distinguish between a child’s typ- (Nonverbal IQ and Verbal IQ) and five factor indices (Fluid
ical and atypical behavior, and allow direct assessment of contex- Reasoning, Knowledge, Quantitative, Reasoning, Visual-Spatial
tual information (Wakschlag et al., 2007). For example, clinicians Processing, and Working Memory). The SB5 was normed on a
may observe how parents enforce rules with their children, how large sample and has good psychometrics (Johnson & D’Amato,
children respond to commands and consequences, and how parent– 2005).
child interactions contribute to positive and negative behaviors. The Kaufman Brief Intelligence Test (KBIT) is another intelli-
Wakschlag et al. (2005) developed the Disruptive Behavior gence test that may be used for ages 4 to 90 years. Similar to the
Diagnostic Observation Schedule (DB-DOS) to serve as a com- SB5, the KBIT yields Nonverbal and Verbal scores as well as a
panion to parent-interview methods in the assessment of DBDs in Full Scale IQ score. The psychometrics of the Kaufman are good
644 MCKINNEY AND MORSE

and the measure is a good option for assessing IQ in preschool and dren. The CPNI is designed for parent, guardian, teacher, or
primary schoolchildren (Madle, 2007). immediate-family-member responses and seeks to assess person-
The Woodcock-Johnson Tests of Achievement–Third Edition ality disorders, neuropsychological dysfunction, and other clinical
(WJ-A-III) is a test of academic functioning for ages 2 to 90 years, syndromes, including DBDs. The CPNI is measured on a 4-point
and helps to determine academic strengths and weaknesses. The Likert scale and has demonstrated high internal consistency and
standard administration contains 12 subtests assessing reading, predictive validity (Coolidge et al., 2002).
writing, mathematics, and oral language, and provides information
on total achievement and equivalent age and grade levels. The Additional Areas of Importance in Determining
measure has shown excellent psychometrics and is a first-line Specific Etiologies of DBDs
choice for achievement testing among children (Cizek, 2003).
Should the results of an assessment indicate the presence of a
The Wechsler Individual Achievement Test–Third Edition
DBD, the specific etiology must be considered. Environmental or
(WIAT-III) is designed to measure listening, speaking, reading,
dispositional factors may contribute separately or simultaneously
writing, and mathematics achievement in children ages 4 years
to disruptive behavior (McKinney & Renk, 2006, 2007).
through 19 years 11 months. A total of 7 composite scores load
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

onto the Total Achievement score. The WIAT-III helps inform


decisions regarding eligibility for services or placement for stu-
Callous-Unemotional Traits
dents with learning disabilities and has strong psychometrics Research has shown a pattern between the presence of callous-
(Miller, 2010). unemotional (CU) traits and DBDs. CU traits are characterized by
a lack of guilt and empathy as well as the manipulative use of
Temperament and Personality Assessment others for personal gain. CU traits are related to conduct problems,
aggression, and delinquency (Frick & White, 2008), and predict
Some researchers have suggested that temperament in early severe and persistent delinquency (Pardini & Fite, 2010). One
childhood forms the basis for personality disorders in adulthood measure of CU traits is the Antisocial Process Screening Device
(Millon, 1996). Perhaps the greatest evidence for the development (APSD), which includes 20 items completed by parents, teachers,
of personality disorders is linked to DBDs in childhood (Coolidge, or youth (Frick & Hare, 2001). Frick’s (2003) Inventory of
Thede, Stewart, & Segal, 2002). Research suggests that negative Callous-Unemotional Traits (ICU) is another measure of CU traits.
temperamental factors, including short attention span, are highly The ICU is a 24-item measure that can be completed by adoles-
correlated with disruptive behavior (Wakschlag & Keenan, 2001). cents, parents, or teachers. The measure consists of 12 positively
Other research suggests that it is the goodness of fit between parent and 12 negatively worded questions about the adolescent. Factor
and child that influences the development of disruptive behavior analyses suggest that the ICU evaluates callousness, uncaring, and
(McClowry, Rodriguez, & Koslowitz, 2008). For example, a child unemotional behavior. Hierarchical regression analyses support
with a negative temperament may not go on to develop disruptive the ICU’s ability to predict problematic behaviors and construct
behavior if the parent has the abilities, supports, and resources to validity was supported by the measurement’s association with the
care for such a child. Clinicians may assess for temperament with Big Five personality dimensions (Essau, Sasagawa, & Frick,
the Dimensions of Temperament Survey–Revised (Canals, 2006).
Hernández-Martı́nez, & Fernández-Ballart, 2011).
The Minnesota Multiphasic Personality Inventory (MMPI) for Behavioral Disinhibition
Adolescents (MMPI-A) is a comprehensive personality assessment
Behavioral disinhibition is another characteristic that should be
device used to assess psychological functioning in adolescents.
assessed in the presence of a DBD. Behavioral disinhibition en-
The MMPI-A is for use with adolescents aged 14 to 18 years. The
compasses the tendency to demonstrate boldness, approach, and
MMPI-A includes 478 total items from the MMPI and MMPI-2 as
spontaneity in unfamiliar situations. Research has identified a
well as items unique to adolescents (i.e., relationships with parents,
relationship between childhood DBDs and behavioral disinhibi-
sexuality, identity formation). Completion time is about an hour
tion. For example, youth who are unable to inhibit their behaviors
and the adolescent rates each item as true or false. The MMPI-A
may have a higher threshold for novelty and sensation-seeking
contains seven validity scales, 10 clinical scales, 15 content scales,
activities, thus leading to disruptive behavior (Hirshfeld-Becker et
clinical subscales, and supplementary scales. Psychometrics for
al., 2007). The Brief Sensation Seeking Scale (BSSS) is an 8-item
the MMPI-A is based on the MMPI-2, which shows strong psy-
questionnaire designed to assess sensation-seeking in children and
chometrics (Lanyon, 1995).
adolescents. The questionnaire contains four scales: Experience
The Personality Assessment Inventory for Adolescents (PAI-A)
Seeking, Boredom Susceptibility, Thrill and Adventure Seeking,
is similar to the MMPI-A and is for use with ages 12 to 18 years.
and Disinihbition. The validity of the BSSS is supported by the
The measure contains 264 items and typically takes adolescents
strong correlation between scores on the measurement and mari-
about 45 min to complete and examiners about 15 min to score.
juana use (Essau et al., 2006). The BSSS also may be helpful in
Items are answered on a 4-point scale and load onto corresponding
predicting CU traits in adolescents. The APSD also screens for
validity and clinical scales. The PAI-A has strong psychometrics,
behavioral disinhibition.
including criterion-related validity and good internal consistency
and test–retest reliability (Kade, 2010).
Executive Functioning
The Coolidge Personality and Neuropsychological Inventory for
Children (CPNI) is a 200-item questionnaire designed to aid par- Children with DBDs also often have difficulties in executive
ents and clinicians in identifying problematic behaviors in chil- functioning, which is defined as the initiation and regulation of
DISRUPTIVE BEHAVIOR ASSESSMENT 645

goal-directed behavior, ability to perceive and encode cues in the be considered closely. For example, some children may develop
environment, and control over impulses. Children with lower disruptive behavior as a child, related to a combination of both
executive functioning are more likely to show disruptive behavior biological and environmental factors, whereas others may develop
symptoms compared with children with higher executive function- disruptive behavior as an adolescent, related to environmental
ing, and this difference may be due to poor problem-solving and/or factors only. Following a thorough history and diagnostic inter-
communication skills (Pihl et al., 2003). Kaplan et al. (2001) view, a case conceptualization may be developed.
suggest that deficits in executive functioning are associated with Step 2: In the first meeting with the guardians, age-
ADHD, which poses as a risk factor for the future development of appropriate rating scales may be provided for parents, teach-
ODD and CD. Thus, determining if deficits in executive function- ers, and the child to complete. Informants should be instructed
ing are present may help differentiate among various developmen- to complete their scales independently so that other informants do
tal pathways associated with DBDs. Clinicians may use measures not bias their responses. The ASEBA is recommended, as it
such as the detour-reaching box (Hughes & Russell, 1993) and the assesses for a range of disorders; may be completed by parents,
Tower of London (Shallice, 1982) to assess for executive func- teachers, and the child, depending on age; and provides an easy to
tioning. These devices assess a child’s ability to develop strategies, interpret cross-informant report. Alternatively, the SDQ may be
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

reach goals, and deal with frustration. recommended, as it is a shorter measure that correlates with the
ASEBA. Results of rating scales may be used to provide confir-
Social Cognition mation of the results of diagnostic interviewing as well as provide
information about additional areas needing follow-up.
Social cognition is also a relevant area to assess when a DBD Step 3: Meet with the child. Establish rapport by asking
has been identified. Children with DBDS are likely to perceive open-ended questions about the child’s interests and expectations
high threat in ambiguous or positive situations and are prone to about testing. Engage in an age-appropriate game or activity and
display disruptive behaviors when they view their environment as establish age-appropriate rules as necessary, particularly if the
threatening (Kempes, Matthys, de Vries, & van Engeland, 2005). child presents with disruptive behavior. The use of a colorful,
For instance, if a child accidentally spills milk on another child, simple rule chart that tracks the child’s progress and allows for
this child may believe that the action was intentional. This may stickers and other relevant rewards to be earned may be particu-
lead to a more aggressive response than if the child believed it larly useful in managing behavior. If the child is old enough,
happened by accident. Clinicians may use the computer-based developmentally appropriate questions may be asked regarding the
Schedules for the Assessment of Social Intelligence (Skuse, Law- child’s perceptions of the presenting problem. If a rating scale is
rence, & Tang, 2005) or the DVD-based Schultz Test of Emotion completed by the child, it can be used to help structure an inter-
Processing–Preliminary Version (Schultz et al., 2010) to assess for view with the child about his or her thoughts of the problem. This
social cognition. also is an opportune time to gather behavioral observations of the
child. In meeting with the child, care should be taken in how the
Discussion environment is structured. It is not uncommon for individuals
working with children to have a play area, and the child may
The research reviewed in this article is particularly relevant to behave very differently in an area intended for play compared with
clinicians who seek accurate identification of DBDs in children an area that appears more professional. For example, a child may
and adolescents, the teachers responsible for the safety of their have greater difficulty regulating behaviors when excitement or
classrooms and the well being of their students, and the parents interest in the environment around them is high. Given this, it may
raising children with disruptive behavior. Given the large number be particularly important to gather behavioral observations of the
of tools available, clinicians must choose carefully in conducting child in several different contexts (e.g., school during work and
their assessments. To assist with this, an illustrative example of an recess, home during structured and free time, etc.).
ideal assessment, as well as recommendations for a more practical, Step 4: Complete individual testing with the child. Testing
real-world assessment, are provided. may begin during the first meeting with the child. The child should
use any aids that are normally available (e.g., glasses, hearing
Illustrative Example aids), and the examiner should question the child about his or her
hunger, fatigue, and other characteristics that may be related to the
Step 1: Obtain informed consent with the legal guardian(s) child’s ability to respond to test items in a valid manner. Guardians
and discuss the presenting problem. Obtain a detailed history should be encouraged to ensure the child has had a healthy break-
and complete a diagnostic interview. The KSADS-PL is recom- fast or lunch prior to testing. Further, it may be recommended for
mended, as it assesses for a range of disorders and has a behavioral the child to be excused from school on testing days so that the
supplement that provides a thorough assessment for symptoms of child is not subjected to extended hours of mental activity. At
ADHD, ODD, and CD. Although it always is important to collect times, the child also may be taking a medication. It is important
a thorough history for any presenting problem, certain areas may that potential side effects of a child’s medication, such as drows-
be especially important to assess when it comes to DBDs. In iness and difficulty concentrating, are not present during testing.
particular, sleep patterns should be addressed thoroughly, as lack One major issue with medication and assessment is when the child
of sleep may result in symptoms consistent with ADHD (e.g., is taking medication for ADHD. Should the child be tested while
inattentiveness, difficulty concentrating) and with ODD/CD (e.g., taking the medication or should the child stop the medication for
irritability, aggressiveness). In addition, the developmental path- the assessment? Active consultation with the guardians and pre-
way, as well as course and onset of the disruptive behavior, should scribing doctor, along with clinical judgment, assist with this
646 MCKINNEY AND MORSE

decision. For example, the guardians and the doctor may be For example, managed care may not allow for a costly and time-
comfortable with continuing the medication, and so it would be consuming assessment, clients may be unable to afford or spend
best to obtain information about the child’s abilities while taking the time necessary completing such an assessment, and clinicians
the medication. Alternatively, guardians and the doctor may be may be strapped for time in providing a comprehensive assess-
considering reducing the medication or stopping the medication, ment, depending on their caseloads. Thus, it may be necessary to
and so it would be best to conduct the assessment after the choose particular tools in an effort to save time and money.
medication has been discontinued. Research investigating the predictive and incremental validity of
After these background characteristics are thoroughly consid- assessment methods may assist clinicians in choosing wisely.
ered, age-appropriate intellectual and academic assessment may be In particular, rating scales appear to be an inexpensive and
completed. It is encouraged to provide as many breaks as neces- timely method of assessing not only for DBDs but also for other
sary so that the child is able to provide his or her best effort, and possible comorbid disorders. In fact, Granero, Ezpeleta, de la Osa,
intellectual and achievement testing should be completed across and Doménech (2009) suggest that, compared with other methods,
multiple sessions. For example, the child may complete intellec- the CBCL is most predictive of disruptive behavior. Further,
tual testing during one session if the child is able to sustain his or Granero et al. (2009) state that clinical interviews with family
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

her best effort, but, particularly with younger children, intellectual members significantly increase predictive validity above using the
testing will need to be completed across multiple sessions. Com- CBCL alone. Consistent with this, Odgers et al. (2007) state that
pleting testing across multiple sessions provides the advantage of family history of externalizing disorders differentiates life-course
gathering additional behavioral observations over time. The persistent conduct problems from childhood- or adolescent-limited
Wechsler series is recommended for intellectual assessment and conduct problems and demonstrates incremental validity above
the WJ-A-III is recommended for academic assessment. Together, family and child risk factors. Odgers et al. (2007) suggest that brief
these tools provide a wealth of information on intellectual and family history questions may assist clinicians in diagnosing chil-
academic abilities. dren with DBDs and identifying children who most need treat-
Step 5: When a DBD is diagnosed, specific areas (e.g., CU ment. Behavioral observations also demonstrate significant incre-
traits, behavioral disinhibition) should be assessed to help mental validity in predicting disruptive behavior above parent and
determine the etiology of the disruptive behavior. Children teacher ratings. In addition to research indicating that formal
may present with DBDs for a variety of reasons, and the specific observation systems add incremental validity to rating scales (i.e.,
areas described previously may all contribute to a particular child’s DB-DOS; Wakschlag et al., 2008), informal behavioral observa-
presentation. tions also add incremental validity (McConaughy et al., 2010).
Step 6: Complete a comprehensive assessment report with Although research suggests that intellectual and academic as-
recommendations and meet with the guardians and, if appro- sessments may help distinguish children with and without DBDs
priate, the child. The goals of most any assessment are to (Hogan, 1999; Hooper & Evans, 1984; Lewin, Davis, & Hops,
provide an adequate description and explanation of the problem as 1999; Semrud-Clikeman, Hynd, Lorys, & Lahey, 1993; Willcutt,
well as to provide as many relevant, specific recommendations to Pennington, Chhabildas, Friedman, & Alexander, 1999), less re-
help improve the child’s functioning in a variety of domains. search examines the incremental validity of these tools above
Recommendations should begin with the most important issue at rating scales, interviews, and behavioral observations. Thus, it is
hand and should address areas of weakness as well as strength. not known if intellectual and academic assessment allows for more
Anyone who receives the results of the assessment should be accurate diagnosis above other methods.
provided with a thorough debriefing about the findings, recom- Overall, when a comprehensive assessment is not possible, a
mendations, and limitations of the assessment. This may be a good briefer assessment including interviews, rating scales, and behav-
time to complete any relevant release-of-information forms so that ioral observations may provide good clinical utility in diagnosing
other important individuals may consult about the results of the DBDs, particularly given the research described here regarding the
report. effectiveness of ratings scales (Granero et al., 2009), and the
Various aspects of a comprehensive assessment may be com- incremental validity of interviews (Granero et al., 2009; Odgers et
pleted by individuals with a range of training, including school, al., 2007) and behavioral observations (McConaughy et al., 2010).
educational, counseling, and clinical psychology. For example, It is important to note that even when resources are limited,
rating scales may be administered and scored by supervised tech- clinicians should screen for comorbid disorders (Willcutt et al.,
nicians, behavioral observations and formal assessment methods 1999) as part of a DBD assessment. Failing to treat associated
(e.g., intellectual assessment) may be conducted by supervised or mood and/or academic problems, among others, may severely
licensed master’s-level clinicians, and interpretation of results and limit treatment. Further, clinicians must take into account devel-
integrative report writing may be completed by supervised or opmental and gender considerations, as noted in this article. Cli-
licensed doctorate level clinicians, although many settings allow nicians should understand that females may present with different
for this to be done by supervised or licensed master’s-level clini- types of disruptive behavior than males and that some disruptive
cians as well. behavior may be normative, particularly for toddlers and teenag-
ers. To assist in distinguishing between normative and clinical
When Resources Are Limited disruptive behavior, clinicians are urged to consider degree of
impairment and persistence of the disruptive behavior. For exam-
Although a comprehensive assessment accomplishes several ple, disruptive behavior that is associated with problems at home,
things, many clinicians are faced with making difficult choices at school, and/or with peers and that persists beyond normal strives
about which tools they are able to use when resources are limited. for autonomy should be considered for clinical significance.
DISRUPTIVE BEHAVIOR ASSESSMENT 647

In conclusion, clinicians, teachers, and parents should be aware Frick, P. J. (2003). The Inventory of Callous-Unemotional Traits. Unpub-
that the early identification and treatment of disruptive behavior lished rating scale. New Orleans, LA: University of New Orleans.
problems is likely to reduce, or even prevent, the development of Frick, P. J., & Hare, R. D. (2001). Antisocial Process Screening Device.
more serious psychiatric diagnoses in the future. Clinicians should Toronto, ON: Multi-Health Systems.
take care to note the developmental trajectory, gender consider- Frick, P. J., & White, S. F. (2008). Research review: The importance of
callous-unemotional traits for developmental models of aggressive and
ations, and comorbidity of DBDs and other disorders when com-
antisocial behavior. Journal of Child Psychology and Psychiatry, 49,
pleting an assessment. Honing in on these factors may help a 359 –375. doi:10.1111/j.1469-7610.2007.01862.x
clinician to pick up on symptoms of DBDs that may have other- Friedman-Weieneth, J. L., Doctoroff, G. L., Harvey, E. A., & Goldstein,
wise gone unnoticed. Overall, professionals must conduct as thor- L. H. (2009). The disruptive behavior rating scale – parent version
ough of an assessment as feasible so accurate diagnoses and case (DBRS-PV): Factor analytic structure and validity among young pre-
conceptualizations may be made to inform treatment. Once an school children. Journal of Attention Disorders, 13, 42–55. doi:10.1177/
accurate assessment has been completed, specific interventions 1087054708322991
tailored by the results of the assessment may be implemented. Granero, R., Ezpeleta, L., de la Osa, N., & Doménech, J. M. (2009).
Predictive validity of symptoms-based approaches to the adjustment of
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

References high-risk children at school and in the community. European Journal of


Psychological Assessment, 25, 274 –284. doi:10.1027/1015-5759
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA .25.4.274
school-age forms and profiles. Burlington, VT: University of Vermont, Hirshfeld-Becker, D. R., Biederman, J., Henin, A., Faraone, S. V., Micco,
Research Center for Children, Youth, & Families.
J. A., van Grondelle, A., . . . Rosenbaum, J. F. (2007). Clinical outcomes
American Psychiatric Association. (1994). Diagnostic and statistical man-
of laboratory-observed preschool behavioral disinhibition at five-year
ual of mental disorders (4th ed.). Washington, DC: Author.
follow-up. Biological Psychiatry, 62, 565–572. doi:10.1016/j.biopsych
Barkley, R. A. (2003). Attention-deficit/hyperactivity disorder. In E. J.
.2006.10.021
Mash & R. A. Barkley (Eds.), Child psychopathology (pp. 75–143). New
Hogan, A. E. (1999). Cognitive functioning in children with oppositional
York, NY: Guilford Press.
defiant disorder and conduct disorder. In H. C. Quay & A. E. Hogan
Bingham, C. R., Loukas, A., Fitzgerald, H. E., & Zucker, R. A. (2003). Parental
(Eds.), Handbook of disruptive behavior disorders (pp. 317–335). New
ratings of sons’ behavior problems in high-risk families: Convergent validity,
York, NY: Kluwer Academic/Plenum Press. doi:10.1007/978-1-4615-
internal structure, and interparent agreement. Journal of Personality Assessment,
4881-2_14
80, 237–251. doi:10.1207/S15327752JPA8003_03
Hooper, F. A., & Evans, R. G. (1984). Screening for disruptive behavior of
Birmaher, B., Ehmann, M., Axelson, D. A., Goldstein, B. I., Monk, K.,
institutionalized juvenile offenders. Journal of Personality Assessment,
Kalas, C. . . . Brent, D. A. (2009). Schedule for affective disorders and
48, 159 –161. doi:10.1207/s15327752jpa4802_9
schizophrenia for school-age children (K-SADS-PL) for the assessment
Hughes, C., & Russell, J. (1993). Autistic children’s difficulty with mental
of preschool children – A preliminary psychometric study. Journal of
disengagement from an object: Its implications for theories of autism.
Psychiatric Research, 43, 680 – 686. doi:10.1016/j.jpsychires
Developmental Psychology, 29, 498 –510. doi:10.1037/0012-1649
.2008.10.003
Canals, J., Hernández-Martı́nez, C., & Fernández-Ballart, J. D. (2011). .29.3.498
Relationships between early behavioural characteristics and tempera- Jewell, J., Handwerk, M., Almquist, J., & Lucas, C. (2004). Comparing the validity
ment at 6 years. Infant Behavior & Development, 34, 152–160. doi: of clinician-generated diagnoses of conduct disorder to the Diagnostic Interview
10.1016/j.infbeh.2010.11.003 Schedule for Children. Journal of Clinical Child and Adolescent Psychology, 3,
Capaldi, D. M., Conger, R. D., Hops, H., & Thornberry, T. P. (2003). Introduction 536–546. doi:10.1207/s15374424jccp3303_11
to special section on three-generation studies. Journal of Abnormal Child Johnson, J. A., & D’Amato, R. C. (2005). Review of the Stanford-Binet
Psychology, 31, 123–125. doi:10.1023/A:1022553306549 Intelligence Scales, Fifth Edition. In R. A. Spies & B. S. Plake (Eds.),
Carter, A. S., Briggs-Gowan, M. J., Jones, S. M., & Little, T. D. (2003). The sixteenth mental measurements yearbook. Retrieved from the Buros
The infant-toddler social and emotional assessment (ITSEA): Factor Institute’s of Test Reviews Online website: http://www.unl.edu/buros
structure, reliability, and validity. Journal of Abnormal Child Psychol- Kade, H. D. (2010). Review of the Personality Assessment Inventory-
ogy, 31, 495–514. doi:10.1023/A:1025449031360 Adolescent. In R. A. Spies, J. F. Carlson, & K. F. Geisinger (Eds.), The
Cizek, G. J. (2003). Review of the Woodcock-Johnson(r) III. In B. S. eighteenth mental measurements yearbook. Retrieved from the Buros
Plake, J. C. Impara, & R. A. Spies (Eds.), The fifteenth mental measure- Institute’s of Test Reviews Online website: http://www.unl.edu/buros
ments yearbook. Retrieved from the Buros Institute’s of Test Reviews Kaplan, B. J., Dewey, D. M., Crawford, S. G., & Wilson, B. N. (2001). The
Online website: http://www.unl.edu/buros term comorbidity is of questionable value in reference to developmental
Connor, D. F., & Doerfler, L. A. (2008). ADHD with comorbid opposi- disorders: Data and theory. Journal of Learning Disabilities, 34, 555–
tional defiant disorder or conduct disorder: Discrete or nondistinct 565. doi:10.1177/002221940103400608
disruptive behavior disorders? Journal of Attentional Disorders, 12, Keenan, K., & Wakschlag, L. S. (2002). Can a valid diagnosis of disruptive
126 –134. doi:10.1177/1087054707308486 behavior disorder be made in preschool children? American Journal of
Coolidge, F. L., Thede, L. L., Stewart, S. E., & Segal, D. L. (2002). The Psychiatry, 159, 351–358. doi:10.1176/appi.ajp.159.3.351
Coolidge personality and neuropsychological inventory for children Kempes, M., Matthys, W., de Vries, H., & van Engeland, H. (2005).
(CPNI). Behavior Modification, 26, 550 –566. doi:10.1177/ Reactive and proactive aggression in children: A review of theory,
0145445502026004007 findings and the relevance for child and adolescent psychiatry. European
Essau, C. A., Sasagawa, S., & Frick, P. J. (2006). Callous-unemotional Child and Adolescent Psychiatry, 14, 11–19. doi:10.1007/s00787-005-
traits in a community sample of adolescents. Assessment, 13, 454 – 469. 0432-4
doi:10.1177/1073191106287354 Kroneman, L. M., Loeber, R., Hipwell, A. E., & Koot, H. M. (2009). Girls’
Flanagan, R. (2005). Review of the Achenbach System of Empirically disruptive behavior and its relationship to family functioning: A review.
Based Assessment. In R. A. Spies & B. S. Plake (Eds.), The sixteenth Journal of Child and Family Studies, 18, 259 –273. doi:10.1007/s10826-
mental measurements yearbook. Retrieved from the Buros Institute’s of 008-9226-x
Test Reviews Online website: http://www.unl.edu/buros Lanyon, L. (1995). Review of the Minnesota Multiphasic Personality
648 MCKINNEY AND MORSE

Inventory - Adolescent. In J. C. Conoley & J. C. Impara (Eds.), The naire. Journal of Psychoeducational Assessment, 24, 3–18. doi:10.1177/
twelfth mental measurements yearbook. Retrieved from the Buros Insti- 0734282905285235
tute’s of Test Reviews Online website: http://www.unl.edu/buros Pihl, R. O., Vant, J., & Assaad, J. M. (2003). Neuropsychological and
Lewin, L. M., Davis, B., & Hops, H. (1999). Childhood social predictors neuroendocrine factors. In C. A. Essau (Ed.), Conduct and oppositional
of adolescent antisocial behavior: Gender difference in predictive accu- defiant disorders: Epidemiology, risk factors, and treatment (pp. 163–
racy and efficacy. Journal of Abnormal Child Psychology, 27, 277–292. 189). Mahwah, NJ: Erlbaum.
doi:10.1023/A:1022606608840 Potegal, M., Kosorok, M., & Davidson, R. (2003). Temper tantrums in
Madle, R. A. (2005). Review of the Wechsler Preschool and Primary Scale young children: 2. Tantrum duration and temporal organization. Journal
of Intelligence – Third Edition. In R. A. Spies & B. S. Plake (Eds.), The of Developmental and Behavioral Pediatrics, 24, 148 –154. doi:10.1097/
sixteenth mental measurements yearbook. Retrieved from the Buros 00004703-200306000-00003
Institute’s of Test Reviews Online website: http://www.unl.edu/buros Reedtz, C., Bertelsen, B., Lurie, J., Handegard, B. H., Clifford, G., &
Madle, R. A. (2007). Review of the Kaufman Brief Intelligence Test – Morch, W. T. (2008). Eyberg child behavior inventory (ECBI): Norwe-
Second Edition. In R. A. Spies, K. F. Geisinger, & B. S. Plake (Eds.), gian norms to identify conduct problems in children. Scandinavian
The seventeenth mental measurements yearbook. Retrieved from the Journal of Psychology, 49, 31–38. doi:10.1111/j.1467-9450.2007
Buros Institute’s of Test Reviews Online website: http://www.unl.edu/ .00621.x
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

buros Schultz, D., Ambike, A., Logie, S., Bohner, K. E., Stapleton, L. M.,
Maller, S. J. (2005). Review of the Wechsler Intelligence Scale for Chil- Vanderwalde, H., . . . Betkowski, J. A. (2010). Assessment of social
dren – Fourth Edition. In R. A. Spies & B. S. Plake (Eds.), The sixteenth information processing in early childhood: Development and initial
mental measurements yearbook. Retrieved from the Buros Institute’s of validation of the Schultz Test of Emotion Processing - Preliminary
Test Reviews Online website: http://www.unl.edu/buros Version. Journal of Abnormal Child Psychology, 38, 601– 613. doi:
Manning, S. C., & Miller, D. C. (2001). Identifying ADHD subtypes using 10.1007/s10802-010-9390-5
the parent and teacher rating scales of the Behavior Assessment Scale for Semrud-Clikeman, M., Hynd, G. W., Lorys, A. R., & Lahey, B. B. (1993).
Children. Journal of Attention Disorders, 5, 41–51. doi:10.1177/ Differential diagnosis of children with ADHD and ADHD/with co-
108705470100500104 occurring conduct disorder. School Psychology International, 14, 361–
McClowry, S. G., Rodriguez, E. T., & Koslowitz, R. (2008). 370. doi:10.1177/0143034393144006
Temperament-based intervention: Re-examining goodness of fit. Euro- Shallice, T. (1982). Specific impairments in planning. Philosophical
pean Journal of Developmental Science, 2, 120 –135. Transactions of the Royal Society of London, B298, 199 –209. doi:
McConaughy, S. H., Harder, V. S., Antshel, K. M., Gordon, M., Eiraldi, R., 10.1098/rstb.1982.0082
& Dumenci, L. (2010). Incremental validity of test session and class- Shipp, F., Burns, G., & Desmul, C. (2010). Construct validity of ADHD-
room observations in a multimethod assessment of Attention Deficit/ IN, ADHD-HI, ODD toward adults, academic and social competence
Hyperactivity Disorder. Journal of Clinical Child and Adolescent Psy- dimensions with teacher ratings of Thai adolescents: Additional validity
chology, 39, 650 – 666. doi:10.1080/15374416.2010.501287 for the Child and Adolescent Disruptive Behavior Inventory. Journal of
McKinney, C., & Renk, K. (2006). Similar presentations of disparate Psychopathology and Behavioral Assessment, 32, 557–564. doi:
etiologies: A new perspective on oppositional defiant disorder. Child 10.1007/s10862-010-9185-6
and Family Behavior Therapy, 28, 37– 49. doi:10.1300/J019v28n01_03 Skuse, D., Lawrence, K., & Tang, J. (2005). Measuring social-cognitive
McKinney, C., & Renk, K. (2007). Emerging research and theory in the functions in children with somatotropic axis dysfunction. Hormone
etiology of oppositional defiant disorder: Current concerns and future Research, 64, 73– 82. doi:10.1159/000089321
directions. International Journal of Behavioral Consultation and Ther- Stein, S. (2007). Review of the Behavior Assessment System for Children
apy, 3, 349 –371. – Second Edition. In R. A. Spies, K. F. Geisinger, & B. S. Plake (Eds.),
Miller, M. D. (2010). Review of the Wechsler Individual Achievement The seventeenth mental measurements yearbook. Retrieved from the
Test – Third Edition. In R. A. Spies, J. F. Carlson, & K. F. Geisinger Buros Institute’s of Test Reviews Online website: http://www.unl.edu/
(Eds.), The eighteenth mental measurements yearbook. Retrieved from buros
the Buros Institute’s of Test Reviews Online website: http:// Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens,
www.unl.edu/buros J. M. A. M. (2010). Psychometric properties of the parent and teacher
Millon, T. (1996). Disorders of the Personality: DSM–IV and beyond (2nd versions of the Strengths and Difficulties Questionnaire for 4- to 12-
ed.). New York, NY: Wiley. year-olds: A review. Clinical Child and Family Psychology Review, 13,
Moreland, A. D., & Dumas, J. E. (2008). Categorical and dimensional 254 –274. doi:10.1007/s10567-010-0071-2
approaches to the measurement of disruptive behavior in the preschool Task Force on Research Diagnostic Criteria: Infancy and Preschool.
years: A meta-analysis. Clinical Psychology Review, 28, 1059 –1070. (2003). Research diagnostic criteria for infants and preschool children:
doi:10.1016/j.cpr.2008.03.001 The process and empirical support. Journal of the American Academy of
Odgers, C., L., Milne, B. J., Caspi, A., Crump, R., Poulton, R., & Child and Adolescent Psychiatry, 42, 1504 –1512. doi:10.1097/
Moffitt, T. E. (2007). Predicting prognosis for the conduct-problem 00004583-200312000-00018
boy: Can family history help? Journal of the American Academy of Wakschlag, L. S., Bennett, L. L., Briggs-Gowan, M. J., Danis, B., Keenan,
Child and Adolescent Psychiatry, 46, 1240 –1249. doi:10.1097/chi K., Hill, C., . . . Carter, A. S. (2005). Defining the “disruptive” in
.0b013e31813c6c8d preschool behavior: What diagnostic observation can teach us. Clinical
Pardini, D. A., & Fite, P. (2010). Symptoms of conduct disorder, opposi- Child and Family Psychology Review, 8, 183–201. doi:10.1007/s10567-
tional defiant disorder, attention-deficit/hyperactivity disorder, and 005-6664-5
callous-unemotional traits as unique predictors of psychosocial malad- Wakschlag, L. S., Briggs-Gowan, M. J., Carter, A. S., Hill, C. Danis, B.,
justment in boys: Advancing an evidence base for DSM-V. Journal of Keenan, K., . . . Leventhal, B. L. (2007). A developmental framework
the American Academy of Child and Adolescent Psychiatry, 49, 1134 – for distinguishing disruptive behavior from normative misbehavior in
1144. preschool children. Journal of Child Psychology and Psychiatry, 48,
Pelletier, J., Collett, B., Gimpel, G., & Crowley, S. (2006). Assessment of 976 –987. doi:10.1111/j.1469-7610.2007.01786.x
disruptive behaviors in preschoolers: Psychometric properties of the Wakschlag, L. S., Briggs-Gowan, M. J., Hill, C., Danis, B., Leventhal,
disruptive behavior disorders rating scale and school situations question- B. L., Keenan, K., . . . Carter, A. S. (2008). Observational assessment of
DISRUPTIVE BEHAVIOR ASSESSMENT 649

preschool disruptive behavior, part II: Validity of the disruptive behavior measurements yearbook. Retrieved from the Buros Institute’s of Test
diagnostic observation schedule (DB-DOS). Journal of the American Reviews Online website: http://www.unl.edu/buros
Academy of Child and Adolescent Psychiatry, 47, 632– 641. doi: Willcutt, E. G., Pennington, B. F., Chhabildas, N. A., Friedman, M. C., &
10.1097/CHI.0b013e31816c5c10 Alexander, J. (1999). Psychiatry comorbidity associated with DSM–IV
Wakschlag, L. S., & Keenan, K. (2001). Clinical significance and corre- ADHD in a nonreferred sample of twins. Journal of the American
lates of disruptive behavior in environmentally at-risk preschoolers. Academy of Child and Adolescent Psychiatry, 38, 1355–1362. doi:
Journal of Clinical Child Psychology, 30, 262–275. doi:10.1207/ 10.1097/00004583-199911000-00009
S15374424JCCP3002_13 Zeanah, C. H., Boris, N. W., & Scheeringa, M. S. (1997). Psychopathology
Wakschlag, L. S., Tolan, P. H., & Leventhal, B. L. (2010). Research in infancy. Journal of Child Psychology and Psychiatry, 38, 81–99.
review: “Ain’t misbehaving”: Towards a developmentally-specified no- doi:10.1111/j.1469-7610.1997.tb01506.x
sology for preschool disruptive behavior. Journal of Child Psychology
and Psychiatry, 51, 3–22. doi:10.1111/j.1469-7610.2009.02184.x
Whiston, S. C., & Bouwkamp, J. C. (2003). Review of the Eyberg Child Received August 25, 2011
Behavior Inventory and Sutter-Eyberg Student Behavior Inventory- Revision received December 12, 2011
Revised. In B. S. Plake & J. C. Impara (Eds.), The fifteenth mental Accepted December 13, 2011 䡲
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Members of Underrepresented Groups:


Reviewers for Journal Manuscripts Wanted
If you are interested in reviewing manuscripts for APA journals, the APA Publications and
Communications Board would like to invite your participation. Manuscript reviewers are vital to the
publications process. As a reviewer, you would gain valuable experience in publishing. The P&C
Board is particularly interested in encouraging members of underrepresented groups to participate
more in this process.

If you are interested in reviewing manuscripts, please write APA Journals at Reviewers@apa.org.
Please note the following important points:

• To be selected as a reviewer, you must have published articles in peer-reviewed journals. The
experience of publishing provides a reviewer with the basis for preparing a thorough, objective
review.

• To be selected, it is critical to be a regular reader of the five to six empirical journals that are most
central to the area or journal for which you would like to review. Current knowledge of recently
published research provides a reviewer with the knowledge base to evaluate a new submission
within the context of existing research.

• To select the appropriate reviewers for each manuscript, the editor needs detailed information.
Please include with your letter your vita. In the letter, please identify which APA journal(s) you
are interested in, and describe your area of expertise. Be as specific as possible. For example,
“social psychology” is not sufficient—you would need to specify “social cognition” or “attitude
change” as well.

• Reviewing a manuscript takes time (1– 4 hours per manuscript reviewed). If you are selected to
review a manuscript, be prepared to invest the necessary time to evaluate the manuscript
thoroughly.

You might also like