Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

Journal of Abnormal Child Psychology, Vol. 26, No. 4, 1998, pp.

279-291

Revision and Restandardization of the Conners Teacher


Rating Scale (CTRS-R): Factor Structure, Reliability, and
Criterion Validity
C. Keith Conners,1,4 Gill Sitarenios,2 James D. A. Parker,3 and Jeffery N. Epstein1

Received May 9, 1997; revision received October 23, 1997; accepted September 9, 1997
The Conners Teacher Rating Scale (CTRS) is a commonly used research and clinical tool
for assessing children's behavior in the classroom. The present study introduces the revised
CTRS (CTRS-R) which improves on the original CTRS by (1) establishing normative data
from a large, representative North American sample, (2) deriving a factor structure using
advanced statistical techniques, and (3) updating the item content to reflect current concep-
tualizations of childhood disorders. Using confirmatory factor analysis, a six-factor structure
was found which includes Hyperactivity-Impulsivity, Perfectionism, Inattention/Cognitive
Problems, Social Problems, Oppositionality, and Anxious/Shy factors. The reliability of the
scale, as measured by test-retest correlations and internal consistency, is generally satisfac-
tory. Using all of the scale factors to discriminate between attention deficit hyperactivity
disordered and normal children, 85 percent of children were correctly classified, supporting
the validity of the scale and indicating excellent clinical utility. Similarities and differences
between the original CTRS factor structure and the CTRS-R factor structure are discussed.
KEY WORDS: ADHD; CTRS-R; rating scale; classroom behavior; children.

For over 30 years, the Conners' Teacher Rating Edelbrock, Greenbaum, & Conover, 1985; Epstein &
Scale (CTRS) has been used by clinicians and re- Nieminen, 1983; Roberts, Milich, Loney, & Caputo,
searchers to assess teachers' perceptions of children's 1981; Zentall & Barack, 1979), validity (Camp &
behavior in the classroom. This scale was first intro- Zimet, 1974; Kendall & Brophy, 1981; Klee & Gar-
duced in a series of research reports demonstrating finkel, 1983; Roberts et al., 1981), and clinical utility
the efficacy of psychostimulant medication as an in- (Brown, 1985; Satin, Winsberg, Monetti, Sverd, &
tervention for behaviorally disordered children (Con- Foss, 1985; Stein & O'Donnell, 1985). Indeed, it is
ners & Eisenberg, 1963; Conners, Eisenberg, & Bar- because of its excellent psychometric properties that
cai, 1967). Since the introduction of the original the CTRS has received widespread use and has ap-
39-item CTRS (CTRS-39), abbreviated versions of peared in hundreds of research studies.5
this scale have been offered. These include the 28- The major purpose of the CTRS is to provide
item CTRS (Goyette, Conners, & Ulrich, 1978), Ab- information at a screening level to assist clinicians
breviated Symptom Questionnaire (Sprague & Slea- and researchers in understanding several important
tor, 1973), and IOWA Conners (Pelham, Milich, domains of child behavior. Such information is con-
Murphy, & Murphy, 1989). All of the CTRS scales sidered a necessary part of the process of assess-
have well-established reliability (Conners, 1969; ment, diagnosis, and treatment monitoring. Such
screening information is helpful in directing more
detailed observations in the classroom, guiding fur-
1Duke University Medical Center, Durham, North Carolina 27710. ther inquiry in clinical situations, or in charac-
2York University, Toronto, Ontario, Canada M3J-1P3.
3Trent University, Peterborough, Ontario, Canada K9J-7B8.
4 Address all correspondence concerning this article to C. Keith 5An annotated bibliography of research utilizing the CTRS is
Conners, Box 3431, Duke University Medical Center, Durham, available from Multi-Health Systems, 908 Niagra Falls Blvd.,
North Carolina 27710. North Tonawanda, NY 14120-2060.

279
0091-0627/98/0800-0279$15.00/0 C 1998 Plenum Publishing Corporation
280 Conners, Sitarcnios, Parker, and Epstein

terizing the broad outlines of behavior in group or not been agreed upon. The original factor analysis
epidemiological investigations. In addition to its fre- of the 39-item scale (Conners, 1969) demonstrated
quent usage as a screening instrument, the CTRS that the CTRS items clustered into easily identifiable
has also been utilized as an adjunctive measure to factors, including Conduct Problems, Daydreaming-
a comprehensive assessment battery (Barkley, 1990) Inattention, Anxious-Fearful, and Hyperactive Be-
and as a measure of treatment effectiveness (Con- havior, that corresponded well with teacher reports
ners, 1994). Many clinicians and researchers com- of student behavior. Subsequent studies have found
plement parental clinical interviews with CTRS rat- somewhat different factor structures (Leung, Luk, &
ings in order to obtain an accurate measure of Lee, 1989; Luk, Leung, & Lee, 1988; O'Leary,
children's classroom behavior. Teacher ratings have Vivian, & Nisi, 1985; Taylor & Sandberg, 1984; Trites
become even more essential to the diagnostic proc- et al., 1982; Werry & Hawthorne, 1976). Though fac-
ess given recent changes in Diagnostic and Statistical tor similarities across these studies far outweigh the
Manual of Mental Disorders (DSM) nosology which differences (Epstein, March, Conners, & Jackson,
require evidence of cross-situational (home and 1997; Reid, 1995; Trites et al., 1982), uncertainties
school) behavioral problems for an attention deficit exist regarding specific item loadings, number of fac-
hyperactivity disorder (ADHD) diagnosis. tors, and the importance of factors that are inconsis-
Consistent with its origins, the CTRS has also tent across studies. As with the normative data, scor-
been utilized to measure the effects of medication ing of the factors has relied on the factor analytic
treatment on classroom behavior (Fischer & Newby, results of Trites et al. However, this factor structure
1991; Rapport, DuPaul, Stoner, & Jones, 1986). Re- has never been replicated, cross-validated, or sub-
search studies have shown that the CTRS is a sen- jected to confirmatory factor analysis. Therefore, the
sitive measure of titration effects and treatment out- stability of the original CTRS factor structure/scoring
come in drug studies using psychostimulants (e.g., system remains unsettled. A more systematic ap-
Abikoff & Gittelman, 1985b) and antidepressants proach to constructing a definitive factor structure
(e.g., Gualtieri, Keenan, & Chandler, 1991). Last, the for the revised CTRS using empirical validation is
CTRS has been used for measuring the effects of required.
nondrug interventions in the classroom (Abikoff & Third, the content of the scale needs to be up-
Gittleman, 1984, 1985a; Horn, lalongo, Popovich, & dated to fit current conceptualizations of childhood
Peradotto, 1987; Kendall & Braswell, 1982). disorders. The items on the original 39-item CTRS
Despite its continued and widespread use, sev- were derived to capture a wide variety of misbehav-
eral factors indicate the need to update the CTRS iors that could occur in a classroom environment.
in terms of its form and test construction properties. Since the development of the CTRS in the 1960s, a
First, original standardization of the CTRS was non- large body of empirical studies concerning child-
systematic. Several research reports on normative hood disorders has been accomplished. Advances in-
data were published using geographically specific and clude the development of a clinical nosology for dis-
modest-sized samples (Conners, 1969; Goyette et al., orders such as ADHD, as well as reports on the
1978; Trites, Blouin, & Laprade, 1982). Since Trites comorbidities with other childhood disorders, such
et al.'s sample was the largest of those published, the as cognitive problems and other externalizing disor-
normative results from their sample of 9,583 Cana- ders (Hinshaw, 1991). The original CTRS contained
dian schoolchildren have been those most often util- few items that related specifically to cognitive prob-
ized for scoring of the CTRS (Conners, 1989). Chil- lems or learning disabilities in the classroom. Includ-
dren from varying backgrounds, cultures, and ing behaviors that are related to ADHD is necessary
geographic regions are scored according to these in order to accurately portray the full range of prob-
norms. Though the Trites et al. sample is impressive lems that these children may be experiencing in the
in size, the geographic and cultural representation of classroom.
a single province in Canada (Ottawa) probably does In sum, the major purpose of the present study
not generalize to all North American children. There was to revise the CTRS in order to (1) provide new
is a clear need for updated norms based upon a na- norms using a large, representative North American
tionally representative sample of North American sample of schoolchildren; (2) provide a definitive,
schoolchildren. stable, and reliable factor structure for the CTRS;
A second reason for revising the CTRS is that and (3) update items on the CTRS to incorporate
a definitive, empirically derived factor structure has current conceptualizations of childhood disorders.
Conners Teacher Rating Scale Restandardized 281

The reliability and validity of this revised scale was changes in clinical practice and obtain clinically rele-
also examined. vant pieces of information. The large project called
the ACQ study, headed by Thomas Achenbach, pro-
vided crucial information from a large national study
STUDY 1: SCALE DEVELOPMENT6 of parent-related items and factor structure that also
helped shape thinking regarding the item pool
Method (Achenbach, Howell, Quay, & Conners, 1991). Once
the item pool was established, a number of psycholo-
Participants gists with clinical and/or research experience re-
viewed the proposed items and commented on item
Participants consisted of 1,702 students (832 clarity and clinical significance. Through this review,
males and 870 females) ranging in age from 3 to 17 some of the items were discarded, and others were
years. Females had a mean age of 10.51 years (SD = revised. A preliminary pool of 131 items covering the
3.34) and males a mean age of 10.34 years (SD = following seven content areas remained: conduct
3.35). The median combined annual household in-
problems, activity problems, attention problems,
come of the students who were rated by their teacher
emotionality, learning problems, social problems, and
was between $40,001 and $50,000. This compares
perfectionism. The 131 items were rated using a 4-
with 1993 U.S. census data of $43,005 median com-
point Likert scale (ranging from 0 for not at all true
bined household income (U.S. Department of Com-
to 3 for very much true). The revised 4-point Likert
merce, 1996.) The 200 data collection sites covered
49 U.S. states as well as all 10 provinces in Canada. scale also included temporal descriptions (e.g., very
The number of cases in each state was roughly pro- often) for each point on the Likert scale in order to
portional to the population density, with the most simplify both responding and interpretation. The fi-
cases coming from the East and West Coasts. Eighty- nal version of the scale included a subset of items
three percent (83%) of the students were European which comprised the old Hyperactivity Index score,
American, 7% African American, 5% Hispanic, and as well as a new ADHD Index derived from empiri-
5% other. The U.S. census figures from 1990 pro- cal discrimination between clinical and matched con-
jected to 1993 (U.S. Office of Commerce, 1996) in- trol cases. The psychometric properties of the Hy-
dicated that 83% of the population were European peractivity Index and DSM-IV scales are reported
American, 12% African-American, 10% Hispanic, elsewhere (Conners, Parker, & Sitarenios, 1997)
and 4% other. Thus, the children in this study were (Parker, Sitarenios, & Conners, 1997).
slightly underrepresentative of African-American and
Hispanic children.
Procedure
Measure
Officials and school psychologists from 200
schools throughout Canada and 49 of the United
An item pool was developed stemming from
various sources including the original CTRS scale. States functioned as site coordinators for the present
Other items were adapted from other versions of the study. Site coordinators were provided with consent
Conners' Rating Scales (e.g., lOWA-Conners). Eight- forms, questionnaires, and forms which outlined the
een items were closely worded to conform with cur- background of the study to students, parents, and
rent Diagnostic and Statistical Manual of Mental Dis- teachers in their school. Teachers who agreed to par-
orders (4th ed.) (DSM-IV; American Psychiatric ticipate were asked to rate as many children in their
Association, 1994) criteria for ADHD (these items classes as possible, but no more than 10 children for
have been analyzed separately and will be reported any one teacher. The median number of children
independently). Some items were created to reflect rated by a teacher was three students. Teachers did
not receive incentives for completing forms. Children
and adolescents in special education classes were not
6Considerably more detail on sample characteristics, including age,
gender, geographic distribution, and statistical analyses, is avail-
included in this study. Completed forms were re-
able in separate users' manual and technical manual, Multi- turned to the site coordinators who forwarded them
Health Systems, Toronto, Canada. to the authors.
282 Conners, Sitarenios, Parker, and Epstein

Statistical Analyses five-, six-, and seven-factor solutions were rotated to


solution (varimax rotation). Results indicated that
The sample was randomly separated into a deri- the six-factor solution produced the highest factor
vation sample (n = 1,200) and a replication sample comparability coefficients. Based on these results, the
(n = 502). The 131 items from the derivation sample entire derivation sample was factor-analyzed and six
were intercorrelated and the resulting matrix sub- factors were rotated to a varimax solution. Items
jected to principal-axis factoring. A series of factor were eliminated from further analyses because they
analyses were conducted to determine what items failed to load (above .30) on any one factor, or be-
should be retained. Items were included on the final cause they loaded above .30 on more than one factor
version of the scale if the following criteria were met: (in several cases items were retained that double-
(1) Items had to load significantly (greater than .30) loaded above .30 because there was a high loading
on a given factor and lower than .30 on the other for the target factor and the loading for the second
factors, and (2) following the rational approach to factor was just above .30). The remaining items were
scale construction, an item was eliminated if it lacked factor-analyzed and six factors rotated to a varimax
conceptual coherence with its factor. Scree test and solution. This procedure was repeated until 38 items
eigenvalues (> 1.0) were used to select the number remained.
of factors for rotation (Cattell, 1978). In addition, we Table I presents the factor loadings, eigenvalues,
employed the split-half factor comparabilities and percentage of variance for each factor for this
method (Everett, 1983) to determine the most reli- analysis. The six rotated factors accounted for 63.1%
able factor solution. of the total variance. The first factor accounted for
The factor structure for the revised CTRS 14.3% of the total variance and the seven items that
(CTRS-R) was tested in the replication sample (n = loaded on this factor appeared to tap a "hyperactiv-
502) using confirmatory factor analysis with EQS for ity-impulsivity" dimension. The second factor ac-
Windows (version 5.1; Bentler, 1995). As recom- counted for 12.0% of the total variance and the six
mended by Cole (1987) and Marsh, Balla, and items that loaded on this factor appeared to tap a
McDonald (1988), multiple criteria were used to as- "perfectionism" dimension. The third factor ac-
sess the goodness-of-fit of the six-factor model: the counted for 11.2% of the total variance and the eight
goodness-of-fit index (GFI; Joreskog & Sorbom, items that loaded on this factor appeared to tap an
1986), the adjusted GFI (AGFI; Joreskog & Sorbom, "inattention/cognitive problems" dimension. The
1986), and the root-mean-square residual (RMS). fourth factor accounted for 9.2% of the total vari-
Based on the recommendations of Anderson and ance and the five items that loaded on this factor
Gerbing (1984), Cole (1987) , and Marsh, et al. appeared to tap a "social problems" dimension. The
(1988), the following criteria were used to indicate fifth factor accounted for 9.2% of the total variance
the goodness-of-fit of the model to the data: GFI > and the six items that loaded on this factor appeared
.85; AGFI > .80; RMS < .01. to tap an "oppositional" dimension. The sixth factor
accounted for 7.2% of the total variance and the six
items that loaded on this factor appeared to tap an
Results "anxious/shy" dimension.

Scale Development
Factor Replication
The correlation matrix of the 131 item-pool was
subjected to principal-axis factoring and scree test The six-factor model for the CTRS-R was tested
and eigenvalue greater than 1.0 criteria (Cattell, using an oblique and an orthogonal solution using
1978), and indicated the relative suitability of four, confirmatory factor analysis (n = 502). Since the
five, six, and seven factors for rotation. In order to oblique model was more consistent with the signifi-
determine the most reliable number of factors to re- cant correlations between factors and subsequently
tain for rotation, the split-half factor comparabilities provided a better model fit, only results from the
method was applied (Everett, 1983). To this end, the oblique confirmatory factor analysis are presented.
derivation sample was randomly split into two sub- All three goodness-of-fit indicators suggested that
samples (n = 600 and 600). For each sample four-, the model had good fit to the data (GFI = .852,
Conners Teacher Rating Scale Restandardized 283
Table I. Rotated Factor Loadings from a Principal Axis Factor Analysis of Items from the Conners' Teacher
Rating Scale— Revised (Derivation Sample, N = 1..200)
Factors
Items 1 2 3 4 5 6
Factor 1: Hyperactivity-Impulsivity
31 Restless .775 .063 .221 .073 .101 .094
35 Always on the go .818 -.032 .139 .077 .199 .030
33 Leaves seat .727 .064 .219 .144 .249 .042
28 Difficulty waiting .757 .031 .171 .139 .288 .112
30 Runs about .739 .044 .156 .181 .264 .030
34 Difficulty playing .714 -.004 .210 .147 .242 .061
26 Excitable .758 -.026 .148 .088 .271 .115

Factor 2: Perfectionism
108 Perfectionist -.038 .808 -.125 -.03 -.014 .052
100 Things just so -.013 .819 -.090 .000 .010 .135
103 Checking -.053 .791 -.089 -.007 -.035 .033
104 Over-focused -.036 .743 -.014 .052 -.010 .104
106 Neat -.093 .629 -.138 -.066 -.030 -.016
101 Same way every time .122 .654 .079 .082 .032 .180

Factor 3: Inattention/Cognitive Problems


70 Forgets things .177 .060 .810 .112 .108 .121
47 Avoids mental effort .382 .105 .695 .212 .167 .071
67 Poor spelling .130 .060 .756 .102 .096 .124
66 Poor reading .159 .036 .793 .141 .070 .151
72 Lacks interest .238 .139 .603 .253 .285 .044
69 Poor arithmetic .104 .065 .760 .119 .103 .151
38 Fails to finish .336 .130 .565 .267 .172 .051
118 Loses things .282 .137 .439 .298 .186 .014

Factor 4: Social Problems


79 Unaccepted .195 -.011 .146 .755 .193 .172
95 Last to be picked .185 -.010 .240 .733 .137 .208
77 No friends .119 .000 .188 .764 .204 .205
89 Doesn't make friends .247 -.016 .218 .760 .272 .225
96 Poor social skills .257 .010 .300 .643 .338 .239

Factor 5: Oppositional
11 Defiant .267 .015 .154 .164 .808 .088
10 Sassy .228 .020 .137 .110 .798 .072
21 Defies .322 .018 .169 .173 .763 .078
22 Spiteful .135 .001 .102 .188 .657 .115
20 Argues .371 .021 .125 .126 .733 .079
7 Explosive .313 -.011 .133 .138 .589 .197

Factor 6: Anxious/Shy
76 Feelings hurt .074 -.138 .127 .168 .086 .754
57 Emotional .219 -.083 .084 .117 .280 .688
55 Timid -.086 -.086 .169 .255 -.104 .515
58 Sensitive .175 -.158 .103 .060 .174 .688
52 Cries .075 -.042 .041 .138 .154 .587
75 Shy -.179 -.092 .211 .295 -.130 .467

Eigenvalue 5.437 4.562 4.253 3.5 3.486 2.752


% of Variance 14.3 12 11.2 9.2 9.2 7.2
284 Conners, Sitarenios, Parker, and Epstein

AGFI = .825, and RMS = 0.025).7 All of the pa- positional, .72 (p < .05) for Hyperactivity-Impulsiv-
rameter estimates between items and factors were ity, .47 (p < .05) for Inattention/Cognitive Problems,
significant: for the Oppositional factor, the six-pa- .61 (p < .05) for Social Problems, .88 (p < .05) for
rameter estimates ranged from .732 to .903 (mean = Anxious/Shy, and .77 (p < .05) for Perfectionism.
.823); for the Hyperactivity-Impulsivity factor, the Several investigators have demonstrated significant
seven-parameter estimates ranged from .806 to .863 drops in CTRS scores from the first to the second
(mean = .840); for the Inattention/Cognitive Prob- administration (Milich, Roberts, Loney, & Caputo,
lems factor, the eight-parameter estimates ranged 1980; Werry & Sprague, 1974). This effect was as-
from .609 to .868 (mean = .728); for the Social Prob- sessed in this sample (n = 50) using all six factors.
lems factor, the five-parameter estimates ranged A statistically significant increase in Oppositional
from .776 to .927 (mean = .836); for the Anxious/Shy scores was observed between Time 1 (mean = .68,
factor, the six-parameter estimates ranged from .474 SD = 1.70) and Time 2 (mean = 1.10, SD = 2.51;
to .834 (mean = .644); for the Perfectionism factor, f(49) = 2.19, p = .033). Also, a decrease in Hyper-
the six-parameter estimates ranged from .632 to .859 active scores was documented between Time 1
(mean = .753). (mean = 4.66, SD = 5.26) and Time 2 (mean =
3.18, SD = 4.13; t(49) = 2.85, p = .006). No other
factors displayed significant trends across administra-
STUDY 2: RELIABILITY, INTERNAL tions (all ps > .2).
CONSISTENCY, AND AGE AND SEX
Means and standard deviations for the various
DIFFERENCES
CTRS-R scales (separately by sex and age group) are
presented in Table III. A series of (Sex x Age
Method
Group) analyses of variance analyses were conducted
with each of the CTRS-R scales as the dependent
Participants
variable. For the Oppositional scale, males were
rated significantly higher than females, F(l, 1,696) =
The sample consisted of the 1,702 students used
25.91, p < .001, but the main effect for age group
in Study 1 (832 males and 870 females). A subset of
and the interaction were not significant.
50 children (25 males and 25 females) were rated by
For the Hyperactivity-Impulsivity scale, males
their teachers on the CTRS-R on two occasions ap-
proximately 6 weeks apart. were rated significantly higher than females, F(l,
1,696) = 83.46, p < .001, and a significant main ef-
fect was found for age group, F(2, 1,696) = 9.91, p <
Results .001; the interaction was not significant. Using uni-
variate analysis of variance for age group, the 3- to
Table II presents the internal reliability coeffi- 7-year-olds were rated significantly higher than the
cients for the CTRS-R scales, separately for 3- to 7- 8- to 12-year-olds, F(1, 1,696) = 6.18, p < .05, and
year-olds, 8- to 12-year-olds, and 13- to 17-year-olds.8 the 13- to 17-year-olds, F(1, 1,696) = 19.76, p <
Coefficient alphas for the six scales ranged from .73 .001, and the 8- to 12-year-olds were rated signifi-
to .95 for males and .76 to .94 for females, suggesting cantly higher than the 13- to 17-year-olds, F(l,
that the scales on the CTRS-R have excellent inter- 1,696) = 6.67, p < .001.
nal reliability. For the Inattention/Cognitive Problems scale,
Using Pearson product-moment correlations males were rated significantly higher than females,
(n = 50), the CTRS-R scales had the following 6- F(l, 1,696) = 45.25, p < .001, and a significant main
week test-retest correlations: .86 (p < .05) for Op- effect was found for age group, F(2, 1,696) = 6.57,
p < .001; the interaction was not significant. Using
univariate analysis of variance for age group, the 3- to
7
The model had to be slightly modified with the addition of se- 7-year-olds were rated significantly higher than the 13-
lected correlated errors (2.6% of possible correlated errors). See to 17-year-olds, F(l, 1,696) = 3.77, p < .05, and the
Tanaka and Huba (1984) for a discussion of this procedure. The 8- to 12-year-olds were rated significantly higher than
mean for these error correlation was .345 (range = .177 to .661).
8
These age ranges are used for ease of presentation. For a more
the 13- to 17-year-olds, F(l, 1,696) = 13.14, p < .001.
detailed presentation and analysis of age effects, see Conners For the Social Problems scale, males were rated
(1997). significantly higher than females, F(1, 1,696) =
Conners Teacher Rating Scale Restandardi/ed 285

Table II. Internal Reliability Coefficients for Scales on the Conners' Teacher Rating Scale— Revised (CTRS-R)
3 to 7 years 8 to 12 years 13 to 17 years
CTRS-R Scale Males Females Males Females Males Females
Oppositional .91 .88 .92 .93 .91 .92
Hyperactivity-Impulsivity .95 .92 .94 .88 .93 .91
Inattentive/Cognitive Problems .87 .94 .93 .92 .92 .89
Social Problems .93 .91 .93 .93 .91 .9
Anxious/Shy .83 .84 .82 .8 .73 .76
Perfectionism .91 .88 .86 .9 .85 .86
n 203 202 399 416 230 252

20.95, p < .001, but the main effect for age group termining the equality of the correlation matrices was
and the interaction were not significant. a nonnormed fit index (NNFI; Bentler & Bonett,
For the Anxious/Shy scale, a significant main ef- 1980) greater than .900 and a comparative fit index
fect was found for age group, F(2, 1,696) = 5.28, p < (CFI; Bentler, 1990) greater than .900. Results indi-
.001, but the main effect for sex and the interaction cated that the pattern of intercorrelations for the
were not significant. Using univariate analysis of vari- CTRS-R scales was virtually identical across the
ance for age group, the 3- to 7-year-olds were rated sexes (NNFI = .972 and CFI = .986). A similar pat-
significantly higher than the 13- to 17-year-olds, F(l, tern of results was found when the equality of the
1,696) = 10.51, p < .001, and the 8- to 12-year-olds correlation matrices among the three age groups was
were rated significantly higher than the 13- to 17- tested using EQS (NNFI = .966 and CFI = .977).
year-olds, F(l, 1,696) = 3.77, p < .05.
For the Perfectionism scale, females were rated
significantly higher than males, F(l, 1,696) = 21.43, STUDY 3: CRITERION VALIDITY
p < .001, and a significant main effect was found for
age group, F(2, 1,696) = 7.42, p < .001; the inter- Method
action was not significant. Using univariate analysis
of variance for age group, the 3- to 7-year-olds were Participants
rated significantly lower than the 8- to 12-year-olds,
F(l, 1,696) = 7.94, p < .001, and the 13- to 17-year- Two groups of children were used in the present
olds, F(l, 1,696) = 14.40, p < .001. study. The first group consisted of 160 children (127
The intercorrelations of the CTRS-R scales are males and 33 females) who met the following criteria:
presented in Table IV (separately for males and fe- (a) parent and/or teacher referral to an outpatient
males). To examine for possible gender differences ADHD clinic due to reported problems with inatten-
in the pattern of intercorrelations, the equality of the tion, hyperactivity, and/or impulsivity; (b) independent
correlation matrices was tested using EQS for Win- diagnosis of ADHD by psychologist and/or psychiatrist
dows (version 5.1; Bentler, 1995). The criteria for de- using DSM-IV criteria for ADHD. Diagnosis was

Table III. Means and Standard Deviations for Scales on the Conners' Teacher Rating Scale— Revised (CTRS-R)a
3 to 7 years 8 to 12 years 13 to 17 years
CTRS-R Scale Females Males Females Males Females Males

Oppositional 0.57 (1.66) 1.23 (2.85) 0.75 (2.24) 1.38 (2.92) 0.88 (2.22) 1.57 (3.09)
Hyperactivity-Imp. 1.55 (3.28) 3.49 (5.25) 0.99 (2.42) 2.92 (4.76) 0.74 (2.17) 2.06 (3.79)
Inatten./Cognitive 3.07 (5.27) 4.26 (5.15) 2.94 (4.8) 5.19 (6.14) 2.09 (3.59) 3.9 (5.09)
Social Problems 0.88 (2.29) 1.42 (2.86) 0.99 (2.54) 1.61 (3.12) 0.66 (1.81) 1.32 (2.61)
Anxious/Shy 2.36 (3.05) 2.26 (2.87) 2.05 (2.64) 2 (2.82) 1.86 (2.36) 1.59 (2.14)
Perfectionism 2.42 (3.38) 1.62 (3.17) 3.13 (3.89) 2.07 (3.08) 3.17 (3.55) 2.62 (3.2)
n 202 203 416 399 252 230
a
Hyperactivity-Imp. = Hyperactivity-Impulsivity; Inatten./Cognitive = Inattention/Cognitive Problems.
286 Conners, Sitarenios, Parker, and Epstein

Table IV. Correlations Among Scales on the Conners' Teacher Rating Scale— Revised
(CTRS-R)a
CTRS-R scale 1 2 3 4 5 6
1. Oppositional .62* .46* .53* .37* .05
2. Hyperactivity-Impulsivity .52b .56* .48* .30* -.02
3. Inattentive/Cognitive Problems .34b .46* .54* .39* -.11*
4. Social Problems .47b .38* .49* .53* .08*
5. Anxious/Shy .26b .19* .27* .43* .21*
6. Perfectionism -.03 -.04 -.18* .00 .23*
a
Males (n = 832) above the diagonal and females (n = 870) below.
b
p < .01.

based upon a structured clinical interview by James ADHD groups. The ADHD group scored signifi-
Swanson and Eric Taylor (personal communication), cantly higher (using t-tests) than the non-ADHD
modified to include current DSM-IV criteria, and cov- group on the Oppositional scale, the Hyperactivity-
ering ADHD as well as DSM-IV criteria for opposi- Impulsivity scale, the Inattention/Cognitive Problems
tional-defiant and conduct disorder. Additional infor- scale, the Social Problems scale, and the Anxious/Shy
mation included a developmental history (Conners & scale; the non-ADHD group scored significantly
March, 1994) and review of school records. Eighty-six higher than the ADHD group on the Perfectionism
percent of the participants were European American, scale.
8.8% were African American, 1.9% were Hispanic, A direct discriminant function analysis was per-
and 3.0% were other; the mean age was 10.36 years formed using CTRS-R scales as predictors of mem-
(SD = 3.57). bership in the two groups (ADHD vs. non-ADHD).
The second group (non-ADHD) consisted of Discriminant function scores were subsequently used
160 children (33 males and 127 females) from studies to classify the 320 children into ADHD and non-
1 and 2 who were randomly selected and matched ADHD groups. The results of this classification are
with the ADHD sample on the basis of age, sex, and presented in Table VI. Following the definitions and
ethnicity. procedures outlined by Kessel and Zimmerman
(1993), a variety of diagnostic efficiency statistics
were calculated for the CTRS-R from these classifi-
Procedure cation results: Sensitivity was 78.1%, specificity was
91.3%, positive predictive power was 89.9%, negative
For participants in the ADHD sample, the predictive power was 80.7%, false positive rate was
CTRS-R information was obtained as part of routine 8.8%, false negative rate was 21.9%, kappa was .694,
clinical assessment. and the overall correct classification rate was 84.7%.

RESULTS GENERAL DISCUSSION

Table V presents means and standard deviations The revision of the CTRS presented herein is a
for the CTRS-R scales for the ADHD and non- substantial upgrade from the widely used, previous

Table V. Means and Standard Deviations (in Parenthesis) for the Non-ADHD (n = 160)
and ADHD (n = 160) Groups on the Conners' Teacher Rating Scale— Revised (CTRS-R)"
CTRS-R Scale Non-ADHD ADHD T P
Oppositional 0.65 (1.62) 4.48 (4.95) 9.31 <.001
Hyperactivity-Impulsivity 1.46 (2.94) 7.92 (6.28) 11.77 <.001
Inattentive/Cognitive Problems 2.46 (3.58) 11.18 (5.79) 16.21 <.001
Social Problems 0.93 (1.91) 5.01 (4.70) 10.19 <.001
Anxious/Shy 1.80 (2.50) 4.01 (3.54) 6.45 <.001
Perfectionism 2.70 (3.77) 1.90 (3.28) 2.03 .043
a
ADHD = attention deficitftyperactivity disorder.
Conners Teacher Rating Scale Restandardized 287
Table VI. Classification Results (ADHD vs. Non-ADHD) rating, it seems likely that decreases in their Hyper-
for the Conners' Teacher Rating Scale— Reviseda
activity scores over time may be explained by regres-
Diagnosis sion to the mean as well. This result suggests the
Test ADHD Non-ADHD Total need to obtain multiple baseline ratings of children,
Present 125 14 139 especially if the CTRS-R is to be used to assess treat-
Absent 35 146 181 ment efficacy. The observed increase in Oppositional
Total 160 160 320 scores across administration is a less robust finding
a
ADHD = attention deficit/hyperactivity disorder. that needs to be replicated.
The sensitivity (78%) and specificity (91%) of
the CTRS-R in identifying ADHD children appear
to be much improved from examinations of the di-
version of this scale. The major improvements lie in agnostic sensitivity and specificity of the original
the revision's psychometric development and repre- CTRS (Klee, 1983; Luk & Leung, 1989). The most
sentativeness of the standardization sample. First, likely reason for this increase in diagnostic utility is
the derived norms from this large North American because of better coverage of ADHD diagnostic cri-
sample should provide a more accurate account of teria and more overlap between DSM criteria and
normative classroom behavioral patterns than pre- scale items.
viously used norms developed on a less-repre- Despite a number of important changes, efforts
sentative sample. Second, the revised CTRS has a were made to keep the key features of the previous
stable factor structure that was developed with a versions intact. The scale remains relatively brief,
large representative sample and confirmed using ad- which is crucial for increasing teachers willingness to
vanced statistical techniques. complete these questionnaires. Also, the 4-point Lik-
In terms of test construction statistics, the re- ert style format which provides a simple format for
vised CTRS conforms with American Psychological
teachers to report on the severity of children's class-
Association guidelines (APA, 1985). As with the
room misbehavior has been retained.
original CTRS, high levels of reported reliability sug-
The factor structure of the CTRS-R has changed
gest that an accurate, reliable assessment of teacher
from the original CTRS because of the inclusion of
perceptions of child misbehavior are obtained
a new and broader item pool, more representative
through the use of this scale. However, there is one
sampling, and more stringent methodological devel-
anomalous finding in that the Inattention factor,
though internally consistent (alpha = .87 to .94), has opment. Most previous studies agreed in finding fac-
a moderate test-retest reliability (r = .47). Previous tors representing conduct problems, hyperactivity, so-
studies have generally found high test-retest reliabili- cial problems, and emotional problems. But a variety
ties for the comparable factor of the earlier version of other factors had been proposed, with little agree-
of the teacher scale. For example, Luk et al. (1988) ment across investigators (Leung et al., 1989; Luk et
found that r = .80; Brito (1987) reported r = .74, al., 1988; O'Leary et al., 1985; Taylor & Sandberg,
Milich et al. (1980) found r = .91, and Roberts et 1984; Trites et al., 1982; Werry & Hawthorne, 1976).
al. (1981) reported r = .84. In addition, Edelbrock Many of these extraneous factors had few items and
et al. (1985) found that all scales had test-retest re- accounted for little variance on the CTRS. An exam-
liabilities between .88 and .96. Further work will be ple of one of these factors is the Daydreaming-Atten-
needed to assess whether the test-retest finding with dance Problem factor found by Trites et al. (Trites et
the current version of this factor is idiosyncratic for al., 1982) which accounted for only 2.8% of CTRS
the particular sample studied, or constitutes a weak- variance (eigenvalue = 1.1). An improvement in the
ness in the item content. CTRS-R factor analysis is that (1) factors were con-
Consistent with Milich et al. (1980), a significant firmed through confirmatory statistical techniques so
decrease in Hyperactivity scores was seen between that smaller, less stable factors would be unlikely to
subsequent administrations of the CTRS-R. Milich be retained, and (2) all of the factors retained con-
et al. concluded that regression to the mean was re- tribute significantly to the amount of variance ex-
sponsible for this effect. Given that the 50 cases used plained on the CTRS-R items (minimum eigen-
to replicate this effect in this study were clinic-re- value = 2.8). Though further factor-analytic studies
ferred children who were likely presenting with ex- that evaluate the CTRS factor structure across differ-
treme behavioral difficulties at the time of the initial ent cultures both outside and within North America
288 Conners, Sitarenios, Parker, and Epstein

are needed, the reported factor structure should re- The other domain of ADHD symptoms, inat-
main the definitive standard for scoring of this scale. tention, is also somewhat different between the
A few of the original CTRS factors have congru- original and revised CTRS. On the original CTRS,
ent factors on the revised scale. The original CTRS inattention symptoms clustered on the Hyperactivity
had two factors which measured externalizing prob- factor and were measured by three items measuring
lems labeled Hyperactivity and Conduct Problems. specifically inattentiveness (daydreams, short atten-
The CTRS-R has similar factors labeled Hyperactiv- tion span, and inattentive). The revised scale has an
ity-Impulsivity and Oppositional. The original Hyper- Inattentive/Cognitive Problems factor which has
activity factor included a wide variety of externalizing items related to forgetfulness, difficulty engaging in
behaviors including oppositional (e.g., quarrelsome), sustained mental effort, failing to finish things, and
hyperactive (e.g., fidgeting), inattentive (e.g., short at- losing things, all DSM-IV Inattention symptoms.
tention span), and socially inappropriate (e.g., hums These items provide a much wider range of symp-
and makes odd noises) behaviors. The Hyperactivity- toms associated with the inattentive domain of
Impulsivity factor on the revised CTRS is a much ADHD. Also loading on this factor are items related
more hyperactivity-specific factor. All of the items on to academic achievement and motivation for school-
CTRS-R Hyperactivity-Impulsivity factor ask specifi- work. The clustering of inattentive symptoms on the
cally about hyperactive and impulsive symptoms. same factor as academic achievement may be a re-
Thus, this factor now provides a much purer and spe- sult of the high correlation between these two vari-
cific measure of hyperactive/impulsive behaviors in ables in elementary school children (Hinshaw,
the classroom and is consequently more consistent 1991), and is in agreement with the factor structure
with its "Hyperactivity" label. derived from a national sample of parent ratings
The original CTRS had a Conduct Problems (Achenbach et al., 1991).
factor that covered a multitude of behaviors clearly Two of the CTRS-R factors are almost identical
related to current conceptualizations of oppositional- to factors on the original CTRS: Anxious/Shy and
defiant disorder (e.g., uncooperative) and conduct Social Problems. The corresponding factors on the
disorder (e.g., steals). A problem with this factor was CTRS were Anxious/Passive and Asocial. In addition
that many of the items on the Conduct Problems fac- to being similarly named, the item content and do-
tor had dual loadings on the Hyperactivity factor; mains that are measured appear to be similar across
thus similar items were used in deriving scores for the scales.
both of these factors. As a result, these two factors The remaining CTRS-R factor is a measure of
were highly correlated (r = .70; Lahey, Green, & Perfectionism and includes items that appear related
Forehand, 1980), bringing into question whether dif- to obsessive-compulsive personality traits or diagno-
fering constructs were being measured. Another sis of obsessive compulsive disorder (OCD). Whether
problem with this factor was that some of this scales' such an interpretation can be sustained will await
items had very low base rates of endorsement since empirical tests, because the factor by itself does not
they assessed more deviant behaviors (e.g., "destruc- fully encompass current diagnostic criteria for OCD.
tive"). Thus, some items had minimal clinical utility Though between-group differences on this factor
for the majority of children being rated. The compa- were opposite in direction from the other factor
rable factor on the CTRS-R is the Oppositional fac- scores—all of which showed higher symptomatology
tor, which includes only items that are consistent with in ADHD than normal children, scores on the Per-
an Oppositional-Defiant Disorder diagnosis. Since fectionism factor added discriminatory power to the
factor construction techniques for the CTRS-R ex- discriminant function analysis in identifying ADHD
cluded items with dual loadings (see Methods), cor- children. This discriminatory power may be a result
relations between the Hyperactivity factor and Op- of ADHD children being rated low on this factor be-
positional factor (average r across sexes = .57) are cause perfectionism is often antithetical to disorgani-
smaller than comparable correlations on the original zation, even though comorbidity between OCD and
CTRS. The smaller correlations among the external- ADHD has been reported in the literature (Curry &
izing factors and the behavior-specific domains en- Murphy, 1995). The identification of perfectionistic
compassed by each factor allow for a finer analysis behaviors is important since OCD children often
of the domains of externalizing problem behavior share similar symptomatology with ADHD children,
than was possible with the broad Conduct Problems particularly inattentiveness, even though the neuro-
and Hyperactivity factors of the original CTRS. cognitive processes that cause inattention in ADHD
Conners Teacher Rating Scale Restandardized 289

(inability to engage and sustain attention) and OCD (NIMH) Grant No. MH01229 (C. Keith Conners,
(difficulty disengaging attention) may be entirely dif- principal investigator).
ferent (March, Leonard, & Swedo, 1995). The authors wish to thank Drew Erhardt, John
In summary, the CTRS-R factor structure and March, Steve Stein, members of the NIMH MTA
scoring system provides an effective structure for Steering Committee, and a number of unnamed col-
measuring specific symptom patterns related to leagues who contributed their expertise over several
ADHD. In addition, corollary factors are present years.
which measure many of the symptoms and disorders
that are often comorbid with ADHD. Among these
comorbid symptom clusters are oppositionality REFERENCES
(Barkley, Fischer, Edelbrock, & Smallish, 1990) ,
cognitive and learning problems (Hinshaw, 1991), Abikoff, H., & Gittelman, R. (1985a). Hyperactive children
anxiety disorders (Munir, Biederman, & Knee, 1987), treated with stimulants: Is cognitive training a useful adjunct?
Archives of General Psychiatry, 42, 953-961.
social problems (Milich & Landau, 1982), and obses- Abikoff, H., & Gittelman, R. (1985b). The normalizing effects of
sive/compulsive behaviors (Curry & Murphy, 1995). methylphenidate on the classroom behavior of ADDH chil-
Thus, a CTRS-R scoring profile can provide the re- dren. Journal of Abnormal Child Psychology, 13, 33-44.
Abikoff, H., & Gittleman, R. (1984). Does behavior therapy nor-
searcher or clinician information with information re- malize the classroom behavior of hyperactive children? Ar-
garding the severity of ADHD as well as valuable chives of General Psychiatry, 41, 449-454.
information about comorbid conditions which may be Achenbach, T. M., Howell, C. T., Quay, H. C., & Conners, C. K.
(1991). National survey of problems and competencies among
interacting with ADHD symptomatology. four- to sixteen-year-olds: Parents' reports for normative and
A limitation of the present study concerns the clinical samples. Monographs of the Society for Research in
manner in which data were collected. Teachers often Child Development, 56 (3), 1-131.
American Psychiatric Association. (1994). Diagnostic and statistical
filled out forms on several children at once, whereas manual of mental disorders (4th ed.). Washington, DC:
typical clinical use is for the teacher to rate one child Author.
of interest at a time. Whether this procedure adds American Psychological Association. (1985). Standards for educa-
tional and psychological testing. Washington, D.C.: Author.
noise to the resulting data is unknown. But the large Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling
sample size and discriminative power of the scales error on convergence, improper solutions, and goodness-of-fit
suggests that there is sufficient precision to allow indices for maximum likelihood confirmatory factor analysis.
Psychometrika, 49, 155-173.
useful decisions in individual cases. Barkley, R. A. (1990). Attention deficit hyperactivity disorder: A
We expect the CTRS-R to replace the original handbook for diagnosis and treatment. New York: Guilford
version and receive the same widespread use as was Press.
Barkley, R. A., Fischer, M., Edelbrock, C. S., & Smallish, L.
afforded the original version. With widespread use (1990). The adolescent outcome of hyperactive children diag-
can come abuse of an instrument. Therefore, a word nosed by research criteria: I. An 8-year prospective follow-up
of caution must be issued regarding its clinical usage. study. Journal of the American Academy of Child and Adoles-
cent Psychiatry, 29, 546-557.
As reported, the CTRS-R has excellent clinical utility Bentler, P. M. (1990). Comparative fit indexes in structural mod-
and provides a reliable, valid, and convenient means els. Psychological Bulletin, 107, 238-246.
of measuring teacher perceptions of classroom mis- Bentler, P. M. (1995). EQS structural equations program manual.
behavior. However, a comprehensive assessment Encino, CA: Multivariate Software.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and
should usually include other data, such as the clinical goodness of fit in the analysis of covariance structures. Psy-
interview, a medical examination, and objective data cholgical Bulletin, 88, 588-606.
regarding school functioning such as test scores, Brito, G. N. (1987). The Conners Abbreviated Teacher Rating
Scale: Development of norms in Brazil. Journal of Abnormal
grades, and longitudinal school progress. (Barkley, Child Psychology, 15, 511-518.
1990). Thus, a rating scale such as the CTRS-R Brown, R. T. (1985). The validity of teacher ratings in differenti-
should be only one component of the evaluative ating between two subgroups of attention deficit disordered
children with or without hyperactivity. Educational and Psy-
process and should not be solely relied upon for chological Measurement, 45, 661-669.
making clinical decisions. Camp, B. W., & Zimet, S. G. (1974). The relationship of teacher
rating scales to behavior observations and reading achieve-
ment of first-grade children. Journal of Special Education, 8,
353-359.
ACKNOWLEDGMENTS Cattell, R. B. (1978). The scientific use of factor analysis in behav-
ioral and life sciences. New York: Plenum Press.
Cole, D. A. (1987). Utility of confirmatory factor analysis in test
Preparation of this manuscript was partially sup- validation research. Journal of Consulting and Clinical Psychol-
ported by National Institute of Mental Health ogy, 55, 584-594.
290 Conners, Sitarenios, Parker, and Epstein

Conners, C. K. (1969). A teacher rating scale for use in drug stud- Kendall, P. C., & Brophy, C. (1981). Activity and attentional cor-
ies with children. American Journal of Psychiatry, 126, 884-888. relates of teacher ratings of hyperactivity. Journal of Pediatric
Conners, C. K. (1989). Manual for Conner's Rating Scales. N. To- Psychology, 6, 451-458.
nawanda, NY: Multi-Health Systems. Kessel, J. B., & Zimmerman, M. (1993). Reporting errors in stud-
Conners, C. K. (1994). The Conners Rating Scales: Use in clinical ies of the diagnostic performance of self-administered ques-
assessment, treatment planning and research. In M. Maruish tionnaires: Extent of the problem, recommendations for
(Ed.), Use of psychological testing for treatment planning and standardized presentation of results, and implications for the
outcome assessment (pp. 550-578). Hillsdale, NJ: Erlbaum peer review process. Psychological Assessment, 5, 395-399.
Associates. Klee, S. H., & Garfinkel, B. D. (1983). The computerized con-
Conners, C. K. (1997). Conners' Rating Scales—Revised; technical tinuous performance task: A new measure of inattention.
manual. North Tonawanda, NY: Multi-Health Systems. Journal of Abnormal Child Psychology, 11, 487-496.
Conners, C. K., & Eisenberg, L. (1963). The effects of methyl- Lahey, B. B., Green, K. D., & Forehand, R. (1980). On the in-
phenidate on symptomatology and learning in disturbed chil- dependence of ratings of hyperactivity, conduct problems, and
dren. American Journal of Psychiatry, 120, 458-464. attention deficits in children: A multiple regression analysis.
Conners, C. K., Eisenberg, L., & Barcai, A. (1967). Effect of dex- Journal of Consulting and Clinical Psychology, 48, 566-574.
troamphetamine on children. Studies on subjects with learn- Leung, P. W., Luk, S. L., & Lee, P. L. (1989). Problem behaviour
ing disabilities and school behavior problems. Archives of Gen- among special school children in Hong Kong: A factor-ana-
eral Psychiatry, 17, 478-85. lytical study with Conners' Teacher Rating Scale. Psychologia
Conners, C. K., & March, J. S. (1994). A developmental history An International Journal of Psychology in the Orient, 32, 120-
form for ADHD and related disorders. North Tonawanda, NY: 128.
Multi-Health Systems. Luk, S. L., & Leung, P. W. (1989). Conners' Teacher's Rating
Conners, C. K., Parker, J. D. A., & Sitarenios, O. (1997). Parent Scale: A validity study in Hong Kong. Journal of Child Psy-
and teacher ratings of DSM-IV ADHD symptoms: A test of the chology and Psychiatry and Allied Disciplines, 30, 785-793.
subtype model. Manuscript submitted for publication. Luk, S. L., Leung, P. W., & Lee, P. L. (1988). Conner's Teacher
Curry, J., & Murphy, L. (1995). Comorbidity of anxiety disorders. Rating Scale in Chinese children in Hong Kong. Journal of
In J. March (Ed.), Anxiety disorders in children and adolescents Child Psychology and Psychiatry and Allied Disciplines, 29, 165-
(pp. 301-317). New York: Guilford Press. 174.
Edelbrock, C., Greenbaum, R., & Conover, N. C. (1985). Reli- March, J. S., Leonard, H. L., & Swedo, S. E. (1995). Neuropsy-
ability and concurrent relations between the teacher version chiatry of pediatric obsessive-compulsive disorder. Compre-
hensive Therapy, 21, 507-512.
of the Child Behavior Profile and the Conners Revised
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-
Teacher Rating Scale. Journal of Abnormal Child Psychology,
of-fit indexes in confirmatory factor analysis: The effect of
13, 295-303.
sample size. Psychological Bulletin, 103, 391-410.
Epstein, J. N., March, J. S., Conners, C. K., & Jackson, D. (1998).
Milich, R., & Landau, S. (1982). Socialization and peer relations
Racial differences on the Conners Teacher Rating Scale. Jour-
in hyperactive children. In K. D. G. I. Bialer (Ed.), Advances
nal of Abnormal Child Psychology, 26, 109-118.
in learning and behavioral disabilities (Vol. 1, pp. 283-339).
Epstein, M. H., & Nieminen, G. S. (1983). Reliability of the Con-
Greenwich, CT: JAI Press.
ners Abbreviated Teacher Rating Scale across raters and
Milich, R., Roberts, M. A., Loney, J., & Caputo, J. (1980). Dif-
across time: Use with learning disabled students. School Psy-
ferentiating practice effects and statistical regression on the
chology Review, 12, 337-339. Conners Hyperkinesis Index. Journal of Abnormal Child Psy-
Everett, J. E. (1983). Factor comparability as a means of deter- chology, 8, 549-552.
mining the number of factors and their rotation. Multivariate Munir, K., Biederman, J., & Knee, D. (1987). Psychiatric comor-
Behavioral Research, 18, 197-218. bidity in patients with attention deficit disorder: A controlled
Fischer, M., & Newby, R. F. (1991). Assessment of stimulant re- study. Journal of the American Academy of Child and Adoles-
sponse in ADHD children using a refined multimethod clini- cent Psychiatry, 26, 844-848.
cal protocol [Special issue: Child psychopharmacology]. Jour- O'Leary, K. D., Vivian, D., & Nisi, A. (1985). Hyperactivity in
nal of Clinical Child Psychology, 20, 232-244. Italy. Journal of Abnormal Child Psychology, 13, 485-500.
Goyette, C. H., Conners, C. K., & Ulrich, R. F. (1978). Normative Parker, J. D. A., Sitarenios, G., & Conners, C. K. (1996). Abbre-
data on revised Conners Parent and Teacher Rating Scales. viated Conner's Rating Scales revisited: A confirmatory factor
Journal of Abnormal Child Psychology, 6, 221-236. analytic study. Journal of Attention Disorders, 1, 55-62.
Gualtieri, C. T., Keenan, P. A., & Chandler, M. (1991). Clinical Pelham, W. E., Milich, R., Murphy, D. A., & Murphy, H. A.
and neuropsychological effects of desipramine in children (1989). Normative data on the IOWA Conners Teacher Rat-
with attention deficit hyperactivity disorder. Journal of Clinical ing Scale. Journal of Clinical Child Psychology, 18, 259-262.
Psychopharmacology, 11, 155-159. Rapport, M. D., DuPaul, G. J., Stoner, G., & Jones, J. T. (1986).
Hinshaw, S. P. (1991). Externalizing behavior problems and aca- Comparing classroom and clinic measures of attention deficit
demic underachievement in childhood and adolescence: disorder: Differential, idiosyncratic, and dose-response effects
Causal relationships and underlying mechanisms. Psychologi- of methylphenidate. Journal of Consulting and Clinical Psy-
cal Bulletin, 110, 1-29. chology, 54, 334-341.
Horn, W. F., lalongo, N., Popovich, S., & Peradotto, D. (1987). Reid, R. (1995). Assessment of ADHD with culturally different
Behavioral parent training and cognitive-behavioral self-con- groups: The use of behavioral rating scales. School Psychology
trol therapy with ADD-H children: Comparative and com- Review, 24, 537-560.
bined effects. Journal of Clinical Child Psychology, 16, 57-68. Roberts, M. A., Milich, R., Loney, J., & Caputo, J. (1981). A mul-
Joreskog, K. G., & Sorbom, D. (1986). LISREL VI: Analysis of titrait-multimethod analysis of variance of teachers' ratings of
linear structural relationships by maximum likelihood, instru- aggression, hyperactivity, and inattention. Journal of Abnormal
mental variables, and least squares methods. Mooresville, IN: Child Psychology, 9, 371-380.
Scientific Software. Satin, M. S., Winsberg, B. G., Monetti, C. H., Sverd, J., & Foss,
Kendall, P. C., & Braswell, L. (1982). Cognitive-behavioral self- D. A. (1985). A general population screen for attention deficit
control therapy for children: A components analysis. Journal disorder with hyperactivity. Journal of the American Academy
of Consulting and Clinical Psychology, 50, 672-689. of Child Psychiatry, 24, 756-764.
Conners Teacher Rating Scale Restandardized 291
Sprague, R. L., & Sleator, E. K. (1973). Effects of psychopharma- mative sample. Journal of Consulting and Clinical Psychology,
cologic agents in learning disorders. Pediatric Clinics of North 50, 615-623.
America, 20, 719-735. U.S. Department of Commerce. (1996). Statistical abstract of the
Stein, M. A., & O'Donnell, J. P. (1985). Classification of children's United States: The national data book. Washington DC: U.S.
behavior problems: Clinical and quantitative approaches. Department of Commerce, Bureau of the Census.
Journal of Abnormal Child Psychology, 13, 269-279. Werry, J. S., & Hawthorne, D. (1976). Conner's Teacher Ques-
Tanaka, J. S., & Huba, O. J. (1984). Confirmatory hierarchical tionnaire—Norms and validity. Australian and New Zealand
factor analyses of psychological distress measures. Journal of Journal of Psychiatry, 10, 257-262.
Personality and Social Psychology, 46, 621-635. Werry, J. S., & Sprague, R. L. (1974). Methylphenidate in chil-
Taylor, E., & Sandberg, S. (1984). Hyperactive behavior in English dren: Effect of dosage. Australian and New Zealand Journal
schoolchildren: A questionnaire survey. Journal of Abnormal of Psychiatry, 8, 9-19.
Child Psychology, 12, 143-155. Zentall, S. S., & Barack, R. S. (1979). Rating scales for hyperac-
Trites, R. L., Blouin, A. G., & Laprade, K. (1982). Factor analysis tivity: Concurrent validity, reliability, and decisions to label
of the Conners Teacher Rating Scale based on a large nor- for the Conners and Davids Abbreviated Scales. Journal of
Abnormal Child Psychology, 7, 179-190.

You might also like