The Relationship Between The Childhood Autism Rating Scale: Second Edition and Clinical Diagnosis Utilizing The DSM-IV-TR and The DSM-5

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

J Autism Dev Disord (2016) 46:3361–3368

DOI 10.1007/s10803-016-2860-z

BRIEF REPORT

The Relationship Between the Childhood Autism Rating Scale:


Second Edition and Clinical Diagnosis Utilizing the DSM-IV-TR
and the DSM-5
Tamara Dawkins1 • Allison T. Meyer2 • Mary E. Van Bourgondien1

Published online: 15 July 2016


Ó Springer Science+Business Media New York 2016

Abstract The Childhood Autism Rating Scale, Second is now referred to as the CARS2-Standard Version
Edition (CARS2; 2010) includes two rating scales; the (CARS2-ST) and includes updated field trial data. The
CARS2-Standard Version (CARS2-ST) and the newly CARS2-ST continues to be used with children under the
developed CARS2-High Functioning Version (CARS2- age of 6 and individuals of any age with less developed
HF). To assess the diagnostic agreement between the verbal skills and IQ scores less than 80. The CARS2-High
CARS2 and DSM-IV-TR versus DSM-5 criteria for Autism Functioning Version (CARS2-HF) was added to assess
Spectrum Disorder (ASD), clinicians at community based individuals with estimated overall IQ scores of 80 or higher
centers of the University of North Carolina TEACCH who are verbally fluent and 6 years of age or older.
Autism Program rated participants seen for a diagnostic In the three decades since the first edition of the CARS,
evaluation on symptoms of autism using both the DSM-IV- there have been several changes in the diagnostic criteria
TR and DSM-5 criteria and either the CARS2-HF or the for Autism Spectrum Disorder (ASD) as outlined by the
CARS2-ST. Findings suggest that overall, the diagnostic Diagnostic and Statistical Manual of Mental Disorders
agreement of the CARS2 remains high across DSM-IV and (DSM). During all of these revisions in the diagnostic
DSM-5 criteria for autism. system, the CARS has consistently been shown to have
good diagnostic agreement with the DSM-III-R (Nordin
Keywords Autism Spectrum Disorder  Diagnosis  et al. 1998; Sevin et al. 1991; Sponheim 1996; Van
CARS2  DSM-IV-TR  DSM-5 Bourgondien et al. 1992) and DSM-IV (Perry et al. 2005;
Rellini et al. 2004). The purpose of the present study is to
examine the diagnostic agreement of the CARS2 with the
Introduction DSM-5 criteria for ASD.
With the publication of the DSM-IV, concerns were
The Childhood Autism Rating Scale (CARS; Schopler raised around consistent diagnostic classification and dif-
et al. 1988, 2010) is one of the most widely researched ferentiation of individuals with Autistic Disorder versus
rating scales for evaluating clinical behaviors of autism that Asperger’s Syndrome versus Pervasive Developmental
has been used around the world (Lord and Corsello 2005). Disorder-Not Otherwise Specified (PDD-NOS) when using
The CARS-original version (CARS; Schopler et al. 1988) the CARS. The CARS exhibited strong agreement with the
DSM-IV, although this agreement varied depending on the
inclusion or exclusion of those diagnosed with PDD-NOS.
& Tamara Dawkins When the CARS scores were compared for toddlers with
Tamara_dawkins@med.unc.edu Autistic disorder without including those with PDD-NOS,
1 the sensitivity (i.e., the ability of a measure to correctly
TEACCH Autism Program, Department of Psychiatry,
University of North Carolina – Chapel Hill, CB 7180, identify individuals with a disorder) went up from .889 to
Chapel Hill, NC 27599-7180, USA .963 but the specificity (i.e., the ability of a measure to
2
Department of Psychology, University of North Carolina – correctly exclude cases without a disorder) went down
Chapel Hill, CB 7180, Chapel Hill, NC 27599, USA from 1.00 to .667 (Ventola et al. 2006). The CARS and the

123
3362 J Autism Dev Disord (2016) 46:3361–3368

DSM-IV have inconsistently agreed on diagnostic classi- current study was to evaluate the effectiveness of using the
fication for those with Asperger’s Syndrome diagnoses. In CARS2-ST and the more recently developed CARS2-HF in
a study of children 18 months to 11 years of age, Rellini a community referred sample to identify individuals with
et al. (2004) found that the CARS was a useful tool for an Autism Spectrum Disorder according to both DSM-IV-
picking up individuals diagnosed with autistic disorder by TR and DSM-5 criteria. An additional aim of the present
DSM-IV criteria (100 %). However, 5 individuals with study was to examine the effectiveness of the CARS2 for
Asperger’s Syndrome and 4 individuals with PDD-NOS identifying individuals across the lifespan in a clinic-based
did not meet the clinical cut-off score for autism. sample referred for an evaluation for autism.
In a more recent study, Chlebowski et al. (2010)
assessed the sensitivity and specificity of CARS in rela-
tionship to DSM-IV with samples of 2 and 4 year olds. In Method
the 2 year old sample, utilizing the standard CARS cut off
of 30 yielded a sensitivity of .93, and specificity of .49 for Participants
autistic disorder. The low specificity according to the
authors was due to incorrectly diagnosing 52 PDD-NOS Participants for this study included 183 individuals that
children as in fact meeting criteria of autism. For the 4 year were seen at one of the TEACCH Autism Program
old sample, the traditional 30 point cut-off resulted in good (TEACCH) Centers in North Carolina for a diagnostic
sensitivity (.86) and specificity (.80) when compared to the evaluation of ASD from 2012 to 2014. Participants ranged
DSM-IV. In order to establish a means for capturing the in age from 1 to 62 years (M = 9.02 years;
PDD-NOS on a rating scale, Chlebowski et al. recom- SD = 8.12 years). 78.6 % of individuals were male and
mended a cut off of 25.5 on the CARS for toddlers and racial and ethnic composition was comparable to the gen-
preschoolers. For distinguishing between autism and PDD- eral population of North Carolina (61.2 % Caucasian,
NOS, they recommend a cut off of 32. To date, several 20.9 % African American, 7.7 % Hispanic, 5.1 % more
studies have been published assessing diagnostic agree- than one race, 2 % Asian, 1 % American Indian, 2 %
ment between the CARS and DSM-5. For example, Mayes unknown or not reported).
et al. (2014) found 84 % agreement between the CARS and
DSM-5 in a sample of individuals between the ages of 1 Procedure
and 18. The authors reported that diagnostic agreement
improved to 94 % when the number of DSM-5 symptoms Participants in this study were referred to one of five
within the category of social communication and interac- TEACCH Autism Centers in North Carolina for a clinical
tion was reduced from 3 to 2. evaluation of ASD. The TEACCH Autism Program is a
A significant development in the CARS2-HF is the use University of North Carolina at Chapel Hill (UNC-CH)
of a lower clinical cut-off score (28) compared to the program that has been serving the North Carolina (NC)
CARS2-ST (30). Perry et al. (2005) found that young autism population since the 1970s and currently has 7
children ages 2–6 years with a diagnosis of PDD-NOS had community clinics around the state. Five of these com-
an average CARS2-ST score of 28 compared to 36 for munity clinics located in Chapel Hill, Greenville, Fayet-
those with Autistic Disorder suggesting that a lower cut-off teville, Wilmington, and Charlotte, NC participated in this
score may better capture individuals with PDD-NOS or study. Clinics serve populations in urban (e.g. Charlotte)
individuals with autism who are higher functioning. In a and rural (e.g. Greenville) areas of NC.
comparison study of the same individuals tested before age The evaluation team consisted of a Clinical Psycholo-
10 with the CARS and then retested as teenagers, Van gist, Autism Specialists with experience assessing and
Bourgondien and Mesibov (1989) also showed that a lower treating individuals with ASD, and/or supervised trainees
cut-off score of 28 better captured the group with autism as in relevant fields. The evaluation included an in-person
they got older. However, others have reported that an even assessment of the individual using the CARS2, informal
lower cut-off score of 25.5 may best distinguish between assessments and records review of previous testing. In
children with high functioning autism or Asperger syn- addition, the ADOS-2 was administered to all individuals
drome and children who are better characterized by another rated using the CARS2-HF. For the CARS2-ST, 75 indi-
diagnosis such as ADHD (Mayes et al. 2011). viduals were assessed using the ADOS-2, 22 were assessed
With the publication of the DSM-5 (American Psychi- using the Psychoeducational Profile 3rd Edition (PEP-3),
atric Association 2013), Autism Spectrum Disorder (ASD) and 1 was assessed using the TEACCH Transition
replaced PDD as the broader category. In addition, there Assessment Profile (TTAP). If cognitive testing was not
are no longer separate subtypes within ASD such as conducted at the TEACCH center, cognitive scores were
Asperger’s Syndrome or PDD-NOS. The objective of the obtained from records review. In addition, caregivers or

123
J Autism Dev Disord (2016) 46:3361–3368 3363

another individual familiar with the participant were Program. The PEP-3 is designed to assess skills in children
interviewed about the participant’s current and past with autism and communication difficulties between the
behavior related to ASD symptoms and adaptive ages of 6 months to 7 years. Similar to the ADOS-2, sev-
functioning. eral subtests of the PEP-3 assess skills in the area social
The psychologist used a rating form to indicate which communication including shared enjoyment, asking for
criteria were met on both the DSM-IV-TR and DSM-5 on help, commenting, and directing attention. The TTAP, is
the basis of results from the assessments, interviews, and used to assess skills in older children and adolescents with
clinical judgment on the day of the evaluation. For DSM- autism for the purpose of educational and transition
IV, an ASD diagnosis included those meeting criteria for planning.
Autistic Disorder, Asperger’s Disorder, or PDD-NOS.
When the study began, clinicians used the proposed DSM-
5 criteria for ASD when rating individuals during assess- Results
ments. The DSM-5 was released in the middle of data
collection and the published criteria were largely consistent Descriptive Statistics
with the proposed criteria with only minor wording
differences. Table 1 depicts the demographic information for partici-
pants assessed on the basis of CARS2-ST and CARS2-HF.
Measures The sample of participants was divided into two groups. Of
the 183 participants, 98 were assessed using the CARS2-
The Childhood Autism Rating Scale-Second Edition ST form while 85 were assessed using the CARS2-HF
(CARS2; Schopler et al. 2010) is a clinician-rated scale for form.
autism symptomatology. The CARS2 includes 15 items
rated on a 7-point scale (with a range of 1–4) with higher ASD Classification Based on DSM and CARS2
scores indicating greater severity. The clinical cut-off for Criteria
ASD is a score of 30 for children 12 years and younger and
a score of 28 for children 13 years and older on the Within the sample of 183 individuals seen for a diagnostic
CARS2-ST. The clinical cut-off for ASD is 28 for the evaluation, 127 (69 %) met criteria for Autistic Disorder, 9
CARS2-HF. Individuals with average or above average (5 %) met criteria for Asperger’s Disorder, and 6 (3 %)
intelligence and were 6 years of age or older received the met criteria for PDD-NOS. The remaining 41 (22 %)
CARS2-HF. In one instance, a 5-year-old was administered individuals did not meet criteria for diagnosis under the
the CARS2-HF. Clinician report indicated that this indi- category of DSM-IV-TR Pervasive Developmental Disor-
vidual scored in the average range of intelligence with der. When the DSM-5 was used as the classification tool,
strong verbal ability. Individuals with below average 134 (73 %) cases met criteria for ASD and 49 (27 %) did
intelligence or intellectual disability and/or were 5 years of not meet criteria for ASD. For the participants assessed
age or younger received the CARS2-ST. The CARS2-ST using the CAR2-ST, 70 (71 %) participants had scores at or
was completed using direct observation of the individual’s above the autism cut-off while 61 (72 %) of participants
behavior during the assessment. The CARS2-HF was assessed using the CARS2-HF met clinical cut-off for
completed using both direct observations of the individ- autism. Typically, participants who met CARS2 but not
ual’s behavior as well as collateral information from a DSM5 were individuals with a language based learning
caregiver or informant (e.g. a spouse) that had knowledge disability coupled with Attention Deficit Hyperactivity
of the individual’s behavior across different environments. Disorder possibly with a mood disorder. However, these
The Autism Diagnostic Observation Schedule-2 individuals did not have sufficient social-communication
(ADOS-2; Lord et al. 2012) is a semi-structured assessment impairments or restricted and repetitive behaviors to meet
of social interaction, communication, repetitive behaviors criteria for ASD according to DSM-5.
and restricted interests, and imaginative or symbolic play
administered to individuals who may have ASD. The CARS2-ST Diagnostic Outcome Compared to DSM-
ADOS-2 has 5 modules. Clinicians select a module based IV-TR and DSM-5 Criteria
on the individuals’ expressive language and chronological
age. The diagnostic sensitivity and specificity of the CARS2-ST
The Psychoeducational Profile—Third edition (PEP-3; in the present sample, when compared to diagnostic out-
Schopler et al. 2005) and TEACCH Transition Assessment come on the basis of DSM-IV-TR and DSM-5 was asses-
Profile—Second Edition (TTAP; Mesibov et al. 2007) are sed (see Table 2). Within this sample the CARS2-ST had a
assessment tools developed at the TEACCH Autism sensitivity of .81 and .84 for the DSM-IV-TR and DSM-5

123
3364 J Autism Dev Disord (2016) 46:3361–3368

Table 1 Demographics
CARS2 CARS2-ST CARS2-HF
n = 183 n = 98 n = 85

Age (years)
Mean (SD) 9.02 (8.12) 4.9 (2.8) 13.8 (9.5)
Range 1.09-62.01 1.09-18.0 5.03-62.01
Gender
Male (%) 79 76 84
Female (%) 21 25 17
CARS2 total score
Mean (SD) 31.6 (5.7) 32.8 (6.0) 30.3 (5.0)
Range 18.5-45.5 18.5-45.5 18.5-41
Clinician diagnosis of Autism (%) 78 88 66

Table 2 Sensitivity and


DSM-IV DSM-5
Specificity of the CARS2-ST
with DSM-IV-TR and DSM-5 PDD (n) No PDD (n) ASD (n) No ASD (n)

CARS2-ST (score C clinical cut-off) 70 0 70 0


CARS2-ST (score \ clinical cut-off) 16 12 13 15
Sensitivity 81 % 84 %
Specificity 100 % 100 %
Clinical cut-off = 30, 28 for ages 13?

respectively, and showed 1.00 specificity with the DSM- An additional analysis was conducted to determine
IV-TR and DSM-5. whether CARS2-ST scores differed as a result of the
Of the 98 participants who were assessed using the observational tool used for scoring (e.g., ADOS2 vs. PEP-3
CARS2-ST, 16 individuals met DSM-IV-TR criteria for a vs. TTAP). Given that only 1 participant was assessed
PDD but had CARS2-ST scores below the clinical cut-off. using the TTAP, their data was removed from the analysis.
When the group of individuals who met DSM-IV-TR but not For the 97 remaining participants, a significant difference,
CARS2-STcriteria for a PDD was compared to the group of F(1,95) = 4.80, p = .03, in CARS2-ST scores was
individuals for whom there was diagnostic agreement observed between the group assessed using the ADOS2
between the CARS2-ST and DSM-IV-TR, no difference was (M = 32.0) who had lower CARS2-ST scores than the
observed on the basis of age t(96) = .6, gender, v2(1, group assessed using the PEP-3 (M = 35.1). Further
n = 98) = .52, p = .47, or IQ t(52) = .01, p = .9 (See analysis revealed that the groups did not differ on the basis
Table 3). Among the 16 participants who met DSM-IV-TR of age, F(1,95) = .15, p = .70. The intelligence quotient
criteria for a PDD but did not meet CARS2-ST cut-off for (IQ) data was available for only 54 of the 97 participants
autism, 3 received a diagnosis of PDD-NOS and the remaining assessed using either the ADOS2 or PEP-3. Within this
participants received a diagnosis of Autistic Disorder. group, CARS2-ST scores did not differ on the basis of IQ,
A similar analysis was conducted in order to investigate F(1,95) = .47, p = .50. Of note, a significant difference in
differences between the 13 participants who did not meet CARS2-ST score was observed, F(1,95) = 5.99, p = .02,
CARS2-ST clinical cut-off for autism but met the DSM-5 between the group of individuals for whom IQ data was
criteria for ASD and the 86 individuals for whom there was available (M = 31.4) and those for whom IQ data was not
agreement between the CARS2-ST and the DSM-5. No available (M = 34.3).
significant differences between groups in age,
t(96) = 1.27, p = .26, gender, v2(1, n = 98) = .92, CARS2-HF Diagnostic Outcome Compared
p = .35, or IQ, t(52) = .41, p = .52, was found among the to DSM-IV-TR and DSM-5 Criteria
group who did not meet CARS2-ST cut-off for autism but
met DSM-5 criteria for ASD in comparison to individuals Within the present sample, the CARS2-HF had a sensitivity
for whom diagnostic agreement between the two measures of 1.0 across both versions of the DSM, and showed a
was observed (see Table 3). All 13 participants received a specificity of .83 and .71 for the DSM-IV-TR and DSM-5
clinical diagnosis of ASD. respectively (see Table 4).

123
J Autism Dev Disord (2016) 46:3361–3368 3365

Table 3 Agreement and


CARS2-ST & DSM-IV-TR CARS2-ST & DSM-5
Disagreement with CARS2-ST
and DSMs Agree Disagree Agree Disagree
n = 81 n = 17 n = 84 n = 14

Age (years)
Mean (SD) 5.0 (2.9) 4.5 (2.2) 5.0 (2.9) 4.3 (1.8)
Gender
Male (%) 74 82 86 74
Female (%) 26 18 14 26
CARS2 total mean (SD) 33.9 (6.1) 27.5 (1.7) 33.7 (6.1) 27.4 (1.7)

n = 44 n = 10 n = 46 n=8

IQ
Mean (SD) 73.6 (18.1) 81.8 (16.8) 73.9 (17.8) 82.1 (18.9)
CARS2 total mean (SD) 32.4 (5.9) 27.1 (1.8) 32.2 (5.9) 27.2 (1.9)

The group of individuals who met CARS2-HF cut-off individuals who met criteria for Autistic Disorder on the
for autism but not DSM-IV-TR criteria (n = 5) was com- basis of DSM-IV-TR and ASD on the basis of DSM-5, no
pared to the group of individuals for whom there was longer met clinical cut-off on the CARS2-HF (Table 5).
diagnostic agreement between the two measures (n = 80). The group of individuals who met CARS2-HF cut-off
No significant difference in age, t(83) = -.53, p = .81, or for autism but not DSM-5 (n = 10) criteria for ASD was
gender, v 2(1, n = 85) = 2.13, p = .14 was found between compared to the group of individuals for whom there was
groups. However, a higher IQ, t(63) = .77, p \ .05 was diagnostic agreement between the two measures (n = 75).
found among the group for whom there was diagnostic A comparison of the groups revealed no significant dif-
agreement between the two measures in comparison to the ference in age, t(83) = -.61, p = .67, gender, v 2 (1,
group who met CARS2-HF cut-off for autism but did not n = 85) = 1.51, p = .22, or IQ, t(63) = 1.04, p = .22.
meet DSM-IV-TR criteria for a PDD (see Table 4). Within Among the group in which diagnostic disagreement was
this group of 5 individuals, diagnostic outcomes included observed, 3 participants received diagnoses of PDD-NOS
Attention Deficit Hyperactivity Disorder (ADHD), Dis- while the others received diagnoses including ADHD,
ruptive Behavior Disorder-NOS, Mixed Receptive-Ex- Disruptive Behavior Disorder-NOS, Mixed Receptive-Ex-
pressive Language Disorder and Cognitive Disorder-NOS. pressive Language Disorder, Anxiety Disorder-NOS and
While the national field trials indicated that a cut-off of 28 Cognitive Disorder-NOS.
yielded the best clinical sensitivity and specificity (Scho-
pler et al. 2010). An analysis was conducted to explore
outcomes if the cut-off is raised to 30 (see Table 4). Discussion
Although this adjustment increased the specificity and
lowered the sensitivity within an acceptable range, 4 of the The purpose of this study was to evaluate the appropri-
9 individuals who met criteria for Asperger’s Disorder on ateness of using the CARS2 to identify individuals with
DSM-IV-TR and ASD on DSM-5 no longer met criteria on ASD according to both the DSM-IV-TR and DSM-5.
the CARS2-HF with the raised cut-off. In addition, 6 Overall, results from the present study indicate that the

Table 4 Sensitivity and


DSM-IV DSM-5
Specificity of the CARS2-HF
with DSM-IV-TR and DSM-5 PDD (n) No PDD (n) ASD (n) No ASD (n)

CARS2-HF (score C 28.0) 56 5 51 10


CARS2-HF (score \ 28.0) 0 24 0 24
Sensitivity 100 100
Specificity 83 71
CARS2-HF (score C 30.0) 45 2 41 6
CARS2-HF (score \ 30.0) 11 27 10 28
Sensitivity 80.4 80.4
Specificity 93.1 82.3

123
3366 J Autism Dev Disord (2016) 46:3361–3368

Table 5 Agreement and


CARS2-HF & DSM-IV-TR CARS2-HF & DSM-5
Disagreement with CARS2-HF
and DSMs Agree Disagree Agree Disagree
n = 80 n=5 n = 75 n = 10

Age (years)
Mean (SD) 13.7 (9.5) 16.0 (10.4) 13.6 (9.6) 15.5 (9.4)
Gender
Male (%) 60 85 85 70
Female (%) 40 15 15 30
CARS2 total mean (SD) 30.3 (5.2) 29.7 (1.8) 30.3 (5.3) 30.6 (1.7)

n = 61 n=4 n = 56 n=9

IQ
Mean (SD) 103.2 (14.8) 96.8 (31.4) 103.6 (14.9) 97.7 (21.3)
CARS2 total mean (SD) 30.0 (5.5) 29.8 (2.0) 29.9 (5.7) 30.7 (1.8)

CARS2 continues to be an appropriate diagnostic tool for previous studies using the original CARS (now CARS2-
individuals referred for an ASD evaluation across the ST), children with lower cognitive ability received higher
lifespan when using the DSM-5 criteria. In the present scores on the CARS (Pilowsky et al. 1998; Rellini et al.
sample there were high levels of sensitivity (range 2004). This may explain why higher CARS2-ST scores
81–100 %) and specificity (range 70–100 %) for both were found among individuals assessed using the PEP-3 as
versions of the CARS2 when using DSM-IV-TR or DSM-5 the basis for observational ratings and why higher CARS2-
criteria. It is interesting to note that the CARS2-ST was ST scores were observed among those for whom no IQ data
very high in specificity while the CARS2-HF was very high was available than those for whom IQ data was available.
in sensitivity. On the CARS2-HF, the few individuals that met the
This study used the cut-offs determined by previous criteria for autism on the CARS2-HF but did not meet DSM-
research with the original CARS and subsequently sup- IV-TR criteria were typically individuals with lower IQs and
ported by the CARS2 field trials (Schopler et al. 2010). met criteria for another neurodevelopmental disorder. While
While the cut-off for the CARS2-HF (28) led to excellent the possibility of a higher cut-off (30) on the CARS2-HF
sensitivity compared to both the DSM-IV-TR and DSM-5, was notable for increased specificity in the present study, the
the CARS2-ST with its differing cut-off scores (30, 28 for accompanying decrease in sensitivity resulted in nearly half
ages 13?) had a slightly lower sensitivity. Future studies of the individuals who met criteria for Asperger’s Disorder
may continue to examine alternate cut-off scores for the no longer meeting the autism cut-off on the CARS2-HF,
CARS2-ST to increase its sensitivity without jeopardizing thus reducing the tool’s utility for identifying individuals on
its specificity with the DSM-5. In conducting these future the spectrum who are higher functioning. Therefore, the
studies of the CARS2-ST, it would be helpful to have a CARS2-HF successfully identifies individuals with ASD
large enough sample of different ages in order to determine who are high functioning with the established cut-off of 28,
if there may be a different cut-off for individuals who are but the tool should be included as part of a comprehensive
over 6 and have intellectual disabilities versus children diagnostic evaluation in order to enhance its utility for
under 6 years of age. Intelligence data was not available excluding cases that do not meet criteria for ASD.
for all the participants in the present study. Many of these The present study had a very wide age range
younger children were given the Psychoeducational Pro- (1–62 years) making it difficult to examine age-related
file-Third Edition (PEP-3) as a measure of both the child’s differences in CARS2 sensitivity and specificity. Future
developmental level as well as symptoms of autism. These studies can examine narrower age ranges with in the
children were typically of lower developmental levels who CARS2. More specifically, it is important to better deter-
presented with difficultly performing on more language mine when children are better assessed using the CARS2-
based tests of intelligence. The clinical staff using the PEP- HF compared to the CARS2-ST. The clinicians conducting
3 reported that they chose this tool over the ADOS and the study wondered whether some higher functioning
other tests of intelligence in order to develop more mean- 4–6 year olds may have been better identified by the
ingful programming ideas for these children who appeared CARS2-HF. Studies may examine children ages 3–8 years
to be functioning at a lower developmental level. In to determine the most appropriate tool for this age range.

123
J Autism Dev Disord (2016) 46:3361–3368 3367

This study had several limitations that should be noted. Chlebowski, C., Green, J. A., Barton, M. A., & Fein, D. (2010). Using
First, the CARS2 ratings and clinical diagnoses were not the childhood autism rating scale to diagnose autism spectrum
disorders. Journal of Autism and Developmental Disorders, 43,
independent. Clinicians identified the specific DSM-IV-TR 787–799.
and DSM-5 criteria each participant met in order to ensure Lord, C., & Corsello, C. (2005). Diagnostic instruments in autistic
diagnosis was based on the diagnostic criteria. However, the spectrum disorders. In F. R. Volkmar, R. Paul, A. Klin, & D.
observed estimates of sensitivity and specificity may be Cohen (Eds.), Handbook of autism and pervasive developmental
disorders, Vol. 2: Assessment, interventions, and policy (3rd ed.,
overestimates of agreement given that the CARS2 and pp. 730–771). Hoboken: Wiley.
diagnostic criteria ratings were given by the same clinician. Lord, C., Rutter, M., DiLavore, P., Risi, S., Gotham, K., & Bishop, S.
Second, the basis for behavioral observation on the CARS2- (2012). Autism diagnostic observation schedule (2nd ed.).
ST was not consistent across all participants resulting in Torrance, CA: Western Psychological Services.
Mayes, S. D., Calhoun, S. L., Murray, M. J., Morrow, J. D., Yurich,
higher CARS2-ST scores among individuals assessed using K. L., Cothren, S., et al. (2011). Use of the Childhood Autism
the PEP-3 than the ADOS2. When asked, some clinicians in Rating Scale (CARS) for children with high functioning autism
this study reported that they were more likely administer the or Asperges syndrome. Focus on Autism and Other Develop-
PEP-3 when the individual’s symptoms of autism were not mental Disabilities, 27, 29–36.
Mayes, S. D., Calhoun, S. L., Murray, M. J., Pearl, A., Black, A., &
as subtle, appeared to have a lower developmental level, and Tierney, C. D. (2014). Final DSM-5 under-identifies mild
needed the degree of structure offered by the PEP-3 in order Autism Spectrum Disorder: Agreement between the DSM-5,
to generate programming recommendations. In future stud- CARS, CASD, and clinical diagnoses. Research in Autism
ies, the use of similar observational tools across participants Spectrum Disorders, 8, 68–73. doi:10.1016/j.rasd.2013.11.002.
Mesibov, G. B., Thomas, J. B., Chapman, S. M., & Schopler, E.
may yield improved estimates of diagnostic agreement. (2007). TTAP: TEACCH transition assessment profile (2nd ed.).
Finally, the sample in the present study consisted of clients Austin, TX: Pro-ed.
referred due to suspected autism. Therefore, a high propor- Nordin, V., Gillberg, C., & Nydén, A. (1998). The Swedish version of
tion of the sample did in fact meet criteria for an autism the Childhood Autism Rating Scale in a clinical setting. Journal
of Autism and Developmental Disorders, 28(1), 69–75. doi:10.
diagnosis. The goal of the present study was to assess the 1023/A:1026067104198.
effectiveness of the CARS2 in a clinic-based sample. Perry, A., Condillac, R. A., Freeman, N. L., Dunn-Geier, J., & Belair,
Although the terms sensitivity and specificity were used J. (2005). Multi-site study of the Childhood Autism Rating Scale
throughout the paper as a test of the effectiveness of the (CARS) in five clinical groups of young children. Journal of
Autism and Developmental Disorders, 35(5), 625–634. doi:10.
measure, caution should be used when interpreting the 1007/s10803-005-0006-9.
observed estimates given that a true test of the psychometric Pilowsky, T., Yirmiya, N., Shulman, C., & Dover, R. (1998). The
properties of the CARS2 was beyond the scope of this study Autism Diagnostic Interview-Revised and the Childhood Autism
and would have required a larger sample with a higher Rating Scale: Differences between diagnostic systems and
comparison between genders. Journal of Autism and Develop-
proportion of individuals not meeting criteria for autism. mental Disorders, 28(2), 143–151.
The CARS2 is a well-validated measure that can be used Rellini, E., Tortolani, D., Trillo, S., Carbone, S., & Montecchi, F.
in community clinics as part of the diagnostic process for (2004). Childhood Autism Rating Scale (CARS) and Autism
individuals with ASD. The CARS2 can be used as part of a Behavior Checklist (ABC) correspondence and conflicts with
DSM-IV criteria in diagnosis of autism. Journal of Autism and
broader evaluation that encompasses multiple sources of Developmental Disorders, 34(6), 703–708. doi:10.1007/s10803-
information such as caregiver report and other diagnostic, 004-5290-2.
behavioral, or cognitive measures. Schopler, E., Lansing, M. D., Reichler, R. J., & Marcus, L. M. (2005).
Psychoeducational Profile (3rd ed.). Los Angeles: Western
Acknowledgments The authors would like to thank Joyce Lum, Psychological Services.
Janette Wellman, John Dougherty, Laura Grofer Klinger, and Mark Schopler, E., Reichler, R. J., & Renner, B. R. (1988). The child autism
Klinger for their contributions to this research. rating scale. Los Angeles: Western Psychological Services.
Schopler, E., Van Bourgondien, M. E., Wellman, J., & Love, S.
Author Contributions TD participated in the conception and coor- (2010). Childhood autism rating scale-second edition (CARS2):
dination of the study, drafting of the manuscript, and the design and manual. Los Angeles: Western Psychological Services.
interpretation of the data. MVB participated in the conception and Sevin, J. A., Matson, J. L., Coe, D. A., Fee, V. E., & Sevin, B. M.
design of the study and the drafting of the manuscript. ATM partic- (1991). A comparison and evaluation of three commonly used
ipated in drafting the manuscript and editing. All authors read and autism scales. Journal of Autism and Developmental Disorders,
approved the final manuscript. 21(4), 417–432. doi:10.1007/BF02206868.
Sponheim, E. (1996). Changing criteria of autistic disorders: A
comparison of the ICD-10 research criteria and DSM-IV with
DSM-III—R, CARS, and ABC. Journal of Autism and Devel-
References opmental Disorders, 26(5), 513–525. doi:10.1007/BF02172273.
Van Bourgondien, M. E., & Mesibov, G. B. (1989). Diagnosis and
American Psychiatric Association. (2013). Diagnostic and statistical treatment of adolescents and adults with autism. In G. Dawson
manual of mental disorders: DSM-5 (5th ed.). Washington, D.C.: (Ed.), Autism: Nature, diagnosis, and treatment (pp. 367–385).
American Psychiatric Association. New York: Guilford Press.

123
3368 J Autism Dev Disord (2016) 46:3361–3368

Van Bourgondien, M. E., Marcus, L. M., & Schopler, E. (1992). Ventola, P. E., Kleinman, J., Pandey, J., Barton, M., Allen, S., Green, J.,
Comparison of DSM-III—R and Childhood Autism Rating Scale et al. (2006). Agreement among four diagnostic instruments for autism
diagnoses of autism. Journal of Autism and Developmental spectrum disorders in toddlers. Journal of Autism and Developmental
Disorders, 22(4), 493–506. doi:10.1007/BF01046324. Disorders, 36(7), 839–847. doi:10.1007/s10803-006-0128-8.

123

You might also like