1851 Mychailyszyn 2017

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

Canadian Psychology / Psychologie canadienne © 2017 Canadian Psychological Association

2017, Vol. 58, No. 2, 105–115 0708-5591/17/$12.00 http://dx.doi.org/10.1037/cap0000101

“Cool” Youth: A Systematic Review and Comprehensive Meta-Analytic


Synthesis of Data From the Cool Kids Family of Intervention Programs
Matthew P. Mychailyszyn
Towson University

To conduct a meta-analysis to synthesize the available research on the family of studies belonging to the
Cool Kids Program, a cognitive– behavioral intervention for anxiety disorders in youth, and evaluate its
overall effectiveness in addressing anxious symptomatology. A search of online databases, combined
with reference list examination and communication with program implementers/developers, led to the
identification of (16) studies that explored the effects of the Cool Kids Program (N ⫽ 1579), or its
forerunners or extensions. Analyses focused on child- and parent-report of anxiety, with effect sizes
aggregated according to a random effects model and calculated as differences between intervention and
control groups at posttreatment (standardized mean difference [SMD]) as well as by considering the
changes in scores between time points (e.g., standardized mean gain [SMG]). Analyses indicate superior
improvement for youth receiving the Cool Kids intervention as compared with controls according to
SMD analyses for both child- and parent-report, as well as for SMG analyses according to parent-report,
though not according to child self-report despite a nearly identical aggregated effect size; the latter was
attributable to greater gains reported by youth in control conditions; secondary analyses also suggest
significantly greater improvements in automatic thoughts for Cool Kids participants. This intervention
has been implemented in different modalities, holds considerable promise, and in the contemporary
context of evidence-based practice, should be considered a program with strong empirical support.

Keywords: anxiety, youth, Cool Kids, meta-analysis, systematic review

Anxiety disorders represent a significant concern across the ceding the onset of substance use disorders” (Kendall et al.,
developmental course of youth. Epidemiological studies consis- 2004, p. 276). One hypothesized mechanism by which this
tently report that anxiety disorders are among the most prevalent might occur is that youth struggling with anxiety may seek to
forms of psychopathology during early to late childhood self-medicate (Manassis & Monga, 2001) using substances that
(Cartwright-Hatton, McNicol, & Doubleday, 2006). In one of the provide an escape from such negative emotion. This reflects the
most recent and largest epidemiological efforts, the National Co- powerful influence of negative reinforcement paradigms, and
morbidity Survey Replication–Adolescent Supplement (NCS-A), correspondingly how self-destructive behaviors can become
anxiety disorders were found to be the most prevalent mental easily ingrained according to behavioral models. Indeed, the
health difficulty among a nationally representative sample of ad- World Health Organization (WHO) has predicted that by 2030,
olescents in the United States (Merikangas et al., 2010), with internalizing problems such as anxiety disorders will be second
nearly one in every three adolescents (31.9%) meeting criteria for only to HIV/AIDS in international burden of disease (Mathers
a diagnosis. Moreover, such contemporary prevalence data are & Loncar, 2006).
consistent with epidemiological studies over the last 30 years (e.g., Of major concern, however, is that the majority of youth strug-
Costello, Egger, & Angold, 2005; Vikan, 1985), reflecting the gling with anxiety disorders have never received treatment (Cha-
persistent threat of internalizing psychopathology to the mental vira, Stein, Bailey, & Stein, 2004). Perhaps most disturbing of all
health well-being of youth. is that relatively little ground has been gained, as the estimated
Anxiety disorders in youth are associated with a number of percentage of those with unmet needs has remained virtually
negative outcomes and sequelae. Anxiety disorders increase unchanged over the past two decades (United States Congress,
vulnerability to development of comorbid conditions, and, if Office of Technology Assessment, 1986).
left untreated, may persist into adulthood and lead to the de- This predicament has inspired a number of researchers to de-
velopment of substance abuse problems (Albano, Chorpita, & velop programs to meet the needs of such youth with anxiety
Barlow, 2003; Kendall, Safford, Flannery-Schroeder, & Webb, disorders. One such intervention package, known as the Cool Kids
2004; Woodward & Fergusson, 2001). “Research has supported Program, is an approach based upon cognitive– behavioral therapy
a temporal relationship, with anxiety disorders typically pre- principles, and was developed as a 10-session treatment for anx-
ious youth between 7 and 17 years of age, as well as their parents
(Rapee, Wignall, Hudson, & Schniering, 2000). This intervention
This article was published Online First March 16, 2017. is acknowledged by its creators to be founded on the Coping Koala
Correspondence concerning this article should be addressed to Matthew program (Barrett, Dadds, & Rapee, 1996), the authors of which
P. Mychailyszyn, Department of Psychology, Towson University, 8000 acknowledge their program to be an Australian adaptation of
York Road, Baltimore, MD 21252. E-mail: mmychailyszyn@towson.edu Kendall’s (1994) Coping Cat program.
105
106 MYCHAILYSZYN

Barrett, Dadds, and Rapee (1996) conducted what is cited by the caregivers being provided with program leader materials for the
program developers in subsequent Cool Kids articles as the first Cool Kids program along with a commercially available book that
trial of the Cool Kids program. The study therefore sought to guides parents helping their anxious child, and independently
explore the role of parental involvement this aspect by implement- delivering the program’s 10 modules over 10 weekly sessions
ing a randomized controlled trial comparing individual CBT to a conducted in the family’s home. Parent-report of anxiety for chil-
condition wherein the child and caregivers would have a Family dren receiving either of the active treatments showed significant
Anxiety Management therapy sessions following the child’s indi- decreases compared with waitlist, though no such significant dif-
vidual CBT session; both of these conditions were also compared ferences were obtained for child- or teacher-report. As a result,
with a waiting-list control group. A total of 79 children between McLoone and Rapee concluded that “the results of the study do not
the ages of 7 and 14 (⬃57% male) participated in the study. clearly indicate whether either of these approaches was effective in
Results were mixed across child-, parent-, and clinician-report, the treatment of child anxiety due to the apparent conflicting
though mostly demonstrating superiority of active treatments, with reports from different informants” (p. 239).
gains maintained through follow-up. In 2007, Chalfant, Rapee, and Carroll investigated the efficacy
Rapee (2000) followed up on the prior study by investigating of an adaptation of Cool Kids program for youth with high func-
whether the efficiency of treatment delivery could be enhanced if tioning autism (HFA). While maintaining the core content of the
offered in group-based format and in shorter duration. As such, program, specific modifications were made “to account for the
90-min sessions to small groups of approximately 5 families, were visual and concrete learning style of HFA children” (p. 1848).
administered in by graduate clinical psychology students who Progress in the adapted Cool Kids group was compared with that
received supervision from the article author. By posttreatment, of similar HFA youth randomized to a waiting list condition. At
youth receiving the Cool Kids intervention demonstrated signifi- posttreatment, 20 of 28 youth in the adapted Cool Kids condition
cant improvement that was on par with results yielded from no longer met diagnostic criteria for a current primary anxiety
evaluations of longer treatment protocols (e.g., Barrett et al., 1996; disorder versus 0 of 19 in the control group.
Kendall, 1994). Rapee concluded that treatment for anxious youth Hudson and colleagues (2009) questioned whether efficacy is
can indeed be made more cost-effective without sacrificing clinical because of the so-called active components of a CBT intervention,
effectiveness. or simply because of nonspecific factors. To test this, the authors
Rapee (2003) sought to extend the knowledge base by compar- randomly assigned youth to either group-based Cool Kids groups
ing treatment outcomes of anxious youth with only one anxiety or Group Support and Attention groups. Though findings differed
disorder to those with additional disorders. As findings were somewhat according to reporter, results according to diagnostic
largely consistent with results obtained by Kendall and colleagues interviews indicated greater efficaciousness for Cool Kids in terms
(2001), Rapee concluded “there appears to be little influence of of there being a greater percentage no longer meeting criteria for
overall comorbidity on treatment outcome for children whose a principal anxiety disorder.
principal diagnosis is an anxiety disorder” (p. 110). Rapee, Abbott, and Lyneham (2006) examined the efficacy of
In 2005, Mifsud and Rapee investigated the effectiveness of a self-help for youth anxiety disorders delivered via the modality of
school-based trial of the Cool Kids program, noting that, at the bibliotherapy guided by parents; this was done by comparing
time of their research, “no study has looked at early intervention outcomes to a waitlist control group as well as an active compar-
for anxiety in socioeconomically disadvantaged areas, despite ison condition consisting of group treatment based on the Cool
these areas being at greatest need for identification and interven- Kids program. Results were mixed depending on level of analysis
tion for mental health disorders” (p. 997). Youth were recruited (e.g., “completer” vs. intent-to-treat [ITT]) as well as by reporter,
from across 9 schools where, according to government school though generally tended to support bibliotherapy as significantly
funding program, the community has the highest concentration of better than waitlist, though with Cool Kids group treatment out-
families disadvantaged by socioeconomic factors. Of note, unlike performing other groups.
the studies described thus far which would be deemed “treatment” In the context of disseminating treatment to rural and remote
studies (as participants were diagnosed with anxiety disorders families via bibliotherapy, Lyneham and Rapee (2006) sought to
based on clinical interview), the present investigation would be explore differences in incremental added benefit across various
classified as an “indicated prevention” study because the criterion modes of enhancing therapist-family contact (e.g., scheduled
for selection was elevated anxious symptomatology as evidenced phone calls, scheduled e-mails, or as-needed client initiated con-
by a score above the 75th percentile on the RCMAS. Results tact). Of note, when families were asked to report how many
revealed that youth receiving the intervention demonstrated sig- weeks of the program they attempted, it seemed that the nature of
nificant improvement from baseline to postintervention as well as structured contact with therapist (e.g., scheduled phone calls,
from baseline to follow-up on self-report of anxiety and teacher- scheduled e-mails, or families responsible for initiating contact
report of internalizing symptoms, but that those in the waitlist themselves) influenced engagement. Despite variations in program
condition did not experience such improvement. engagement, data demonstrated that active treatment conditions
McLoone and Rapee (2012) sought to extend research in the outperformed waitlist at posttreatment in terms of presence of
school area by comparing directly the outcomes achieved when the anxiety disorders as well as anxious symptomatology, with gains
intervention is implemented at school versus at home, as well as to maintained or improved by 12-month follow-up.
a waitlist control group. This study also took an indicated preven- Though already developed to be appropriate for adolescents,
tion approach as youth were selected via elevated scores (e.g., top subsequent adaptational work led to the creation of the Cool Teens
10%) on the SCAS combined with school counselor nomination of program (Cunningham, 2008), tailored specifically for that devel-
highly anxious students. The home-based intervention involved opmental period. A comprehensive description of the creation and
META-ANALYSIS OF COOL KIDS INTERVENTION 107

structure of this intervention is reported elsewhere for the inter- likely to be free of any anxiety disorder diagnosis; the same results
ested reader (Cunningham, Rapee, & Lyneham, 2007; Cunning- were found at 6-month follow-up.
ham & Wuthrich, 2007). In 2009, Cunningham et al. conducted a Seeking to extend the application of the Cool Kids program even
pilot case series of the Cool Teens CD-ROM program for adoles- farther, Sciberras and colleagues (2015) conducted a pilot random-
cent anxiety. Citing barriers to care and associated low treatment ized control trial of the intervention for youth with ADHD and a
utilization rates, along with an underrepresentation of adolescents comorbid anxiety disorder. Of particular note, to “cater to the
in prior intervention trials, the authors note that a different modal- needs of children with ADHD” (p. 2), this was the only study that
ity of treatment delivery might hold promise for youth at this applied an individual-, as compared with group-, format of inter-
developmental stage. Cunningham and colleagues assert that vention delivery. While the primary outcome assessment was
“There are no existing published studies on computer-based ther- “feasibility and acceptability of the intervention” (p. 2), secondary
apy programs for adolescents with anxiety” (p. 126), and thus it is analyses revealed that by assessment at 5 months, 3 of the 6 youth
from this base that such a program—the Cool Teens CD-ROM— in the Cool Kids program were free of an anxiety disorder diag-
was evaluated. At posttreatment, two of the five (e.g., 40%) no nosis whereas this was not the case for any of the individuals in the
longer met criteria for at least one of the preexisting anxiety usual care group.
disorder; two other participants showed some indications of im- The goal of the present meta-analysis was to review and aggre-
provement in other areas. In 2012, Wuthrich et al. conducted the gate the data from all available investigations of the Cool Kids
first randomized controlled trial of the Cool Teens CD-ROM Program, which have been briefly summarized above. Although
program. By posttreatment, findings indicated that, “compared some of these studies are represented in prior reviews, a compre-
with waitlist, adolescents using the Cool Teens program demon- hensive review specifically focused on this particular program
strated significant improvements both in terms of clinician re- does not yet exist. It should be noted that reviews with similar
ported severity of anxiety as well as both self- and parent-reported objectives—to synthesize the data from a single specific psycho-
measures” (p. 267). therapy intervention— have already been published in high-quality
In the first Cool Kids study to be conducted outside of Australia, outlets. For instance, Brunwasser, Gillham, and Kim (2009) con-
Lundkvist-Houndoumadi and Thastum (2013) conducted a pilot ducted a meta-analytic review of the Penn Resiliency Program’s
study case-series in Denmark. “Based on data derived from stan- (PRP) effect on depressive symptoms for youth. Additionally,
dardized diagnostic standardized interviews, self-report measures, Briesch, Hagermoser Sanetti, and Briesch (2010) evaluated the
and qualitative interview material—four of the six children ob- evidence base for the FRIENDS for Life Program. Lastly, though
tained CGI-I ratings that classified them as responders at the not exhaustively, Cuijpers and colleagues (2011) conducted a
15-month follow-up” (p. 249). Following up on this study, Arendt, meta-analysis of Interpersonal Therapy (IPT) for depression. Thus,
Thastum, and Hougaard (2015) conducted the first randomized especially within the contemporary context of evidence-based
wait-list controlled trial of Cool Kids in Denmark. Following use practice, there is a strong precedent for evaluating the usefulness
of a Danish version of the intervention, results indicated that a of specific intervention programs. It is therefore believed that
substantially larger (48.2%) proportion of youth receiving Cool the present review makes a similarly important contribution to
Kids was diagnosis-free at postintervention as compared with only the field. The central purpose of this analysis will be to deter-
5.7% in the waitlist condition. Gains were either maintained or mine the overall mean effect size produced by the Cool Kids
extended to 3-month and 12-month follow-up periods. Continuing intervention in terms of reducing anxiety; this effect will be
this line of research, J␱´ nsson, Thastum, Arendt, and Sørensen compared with that of controlled conditions to identify whether
(2015) conducted an effectiveness trial of a Danish version of the Cool Kids results in significantly greater reductions in anxiety
Cool Kids program in Denmark by investigating implementation in symptoms than those not receiving the program.
community centers. However, as many comparison group individ- An individual’s tendency to interpret events as stable, negative,
uals were already represented in other trials (e.g., Arendt et al., and global comprises the cognitive triad that has been demon-
2015), the data for these individuals are not included in the strated to underlie depression (Abramson, Alloy, & Metalsky,
meta-analysis below so as to preserve the assumption of indepen- 1989). As negatively valenced self-statements have been identified
dence. Encouraging results from the community centers suggested as contributing to the manifestation of internalizing difficulties, a
that this program is indeed transportable beyond research-based secondary goal of this review was to determine whether the Cool
settings, which adds support for the value of dissemination to a Kids program might also be able to create a more healthy shift in
wider selection of individuals. this pattern of cognitive style.
Recently, Hudson and colleagues (2014) sought to investigate
the role of parental anxiety on the treatment outcomes of anxious
Method
offspring, comparing a more conventional delivery of the Cool
Kids program with another group that received the identical inter- For the purposes of this review, an intervention was defined as
vention combined with five 45-min, brief parental anxiety man- a program of content delivered to youth by individuals trained in
agement (BPAM) sessions. Although there were no significant its implementation with the purpose of either (a) preventing the
differences across either comparison when examining by principal onset or exacerbation of anxiety symptoms or disorders, or (b)
anxiety disorder, a main effect was found for parental anxiety alleviating the symptoms and/or severity of already-existing anx-
status when looking at whether participants became free of any iety disorders and associated symptomatology. Thus, both preven-
(e.g., principal or comorbid secondary diagnoses) anxiety disorder, tion and treatment applications of the Cool Kids program were
such that those with nonanxious parents were significantly more included.
108 MYCHAILYSZYN

Searching Teens program). Second, participants had to be youth enrolled in


Grades K through 12. Third, the size of the samples under inves-
Studies for the present meta-analysis were identified through the tigation had to be sufficiently large (e.g., not single-case studies)
use of several search strategies. First, computerized searches were enough to allow for the types of statistical analyses required for
conducted using the PsycINFO and PubMed research databases. meta-analytic purposes. Fourth, the study had to provide quanti-
The search term of “Cool Kids” was utilized to identify potentially tative analyses of outcome data, with specific statistical informa-
appropriate studies. This specific search term was entered because tion needed for the calculation of effect sizes, or author contact
it was assumed that any relevant publication on this intervention information to obtain the additional data needed. Last, although the
would have referenced the program by name, and/or would have content of the intervention may have been delivered in any lan-
cited its forerunners. The final online search date was 11/06/2015. guage, the study must have been written in English. To preserve
Additionally, the reference sections of articles found via comput- assumptions of independence, studies were excluded if the sample
erized searches as well as those of previously conducted meta- under investigation overlapped either in whole or in part with the
analyses were reviewed to ensure that potentially relevant studies sample of participants from another study which met inclusion
not identified by computerized search were included. The flow of criteria.
study selection is illustrated in Figure 1.
Validity Assessment
Selection
The rigorous standards of the peer-review process have led to
Studies were selected as appropriate for inclusion if they met the the speculation that studies which have made it to print are more
following criteria. First, the study had to explore the outcome of an likely to have obtained statistically significant findings as com-
application of the Cool Kids program (or one of its forerunners, pared with those that were never published (Sterling, 1959). This
such as the Coping Koala program, or derivatives, such as the Cool issue has become known as the “File Drawer Problem” (Rosenthal,

Figure 1. Flow chart of study inclusion. See the online article for the color version of this figure.
META-ANALYSIS OF COOL KIDS INTERVENTION 109

1979), and refers to the well-supported notion that the studies Parent-Report of Anxiety
capable of being retrieved and subsequently making it into a
Spence Children’s Anxiety Scale—Parent Report (SCAS-P;
meta-analysis may not likely be a random sample of all studies
Nauta et al., 2004). The parent-report form is considered to be
actually conducted to explore a particular content area (Rosenthal,
identical to the child self-report version, excepting that it is the
1993). The result of this “file drawer problem” is the emergence of
parental perspective of youth anxiety that is queried.
publication bias, whereby smaller studies which have insufficient
Child Behavior Checklist (CBCL; Achenbach & Edelbrock,
power to detect an effect or are deemed less important are omitted
1991). A 118 item scale evaluating particular child behaviors
and not included in the calculation of a mean effect size.
from the caregiver perspective. As the present meta-analysis was
In the present meta-analysis, the file-drawer problem was ad-
focused on anxiety reduction, only the Internalizing dimensional
dressed first by not restricting studies to only those evaluations
score was utilized—indeed, this was consistent with many of the
which have been published and second through the calculation of studies that implemented this measure.
Orwin’s (1983) adaptation to the “Fail-Safe N”, which reflects the Strengths and Difficulties Questionnaire—Parent Report
exact number of studies needed to shift a significant overall p (SDQ-P; Goodman, Meltzer, & Bailey, 1998). This measure is
value beyond a predetermined critical value into the range of comprised of 25 items and has demonstrated sound psychometrics
nonsignificance (Rosenthal, 1979). (Goodman, 2001; Goodman & Scott, 1999). Given the focus of the
Cool Kids family of interventions on anxiety, only scores from the
Emotional Symptoms Subscale were used in the present review to
Data Abstraction
reflect measurement of internalizing symptomatology.
All variables of interest were captured using a codebook devel-
oped by the article author via an iterative process, and then Youth-Report of Automatic Thoughts: Children’s
transposed into an SPSS file; the codebook is available upon Automatic Thoughts Scale (CATS; Schniering &
request to the article author. Quantitative data from measures to be Rapee, 2002)
analyzed in this review were entered into a Microsoft Excel
(Microsoft Corp., Redmond, WA) database, with algorithms pro- A secondary analysis of this review sought to examine whether
grammed in to calculate effect sizes (ESs). When data necessary the Cool Kids program could significantly alter patterns of auto-
for the computation of ESs or related variables of interest were not matic thoughts. This measure has demonstrated good discriminant
presented in manuscripts, an effort was made to obtain the needed validity for each of its subscales across youth disorders, as well as
information directly from study authors. Consistent with the study good convergent validity with related anxiety scales (Schniering &
selection criteria described above, if missing quantitative data for Lyneham, 2007).
effect sizes could not be obtained through communication with
authors, that study was excluded. Quantitative Data Synthesis
It was often the case that individual studies utilized and reported
on more than one measure for the construct of anxiety. However,
Measures
treating multiple measures of a unitary construct as distinct entities
With the exception of the FSSC-R (see McCathie & Spence, would violate assumptions of independence that underlie the sta-
1991; Muris et al., 2002), all measures described on below are tistical process of meta-analysis (Rosenthal, 1984). Following the
considered to be assessing trait- (as opposed to state-) level vari- recommendations of Lipsey and Wilson (2000) and consistent with
ables. the approach taken by authors of recently published high quality
meta-analyses (e.g., Stewart & Chambless, 2009), to address this
issue, multiple effect sizes for a particular construct within indi-
Youth Self-Report of Anxiety vidual studies were averaged. This was done prior to synthesis
Spence Children’s Anxiety Scale (SCAS; Spence, 1998). By with effect sizes from other studies so as to ensure that each study
far, the most commonly used measure across studies evaluating the would only contribute one single effect of anxiety for each study.
Cool Kids program, Spence (1998) has found this measure to
demonstrate strong psychometric properties, with a coefficient Effect Size
alpha of 0.92, a 6-month test–retest reliability of 0.60, and it The present meta-analysis utilized two different forms of effect
correlates well with other measures of anxiety. size to investigate the aggregated success of the acquired collec-
Revised Children’s Manifest Anxiety Scale (RCMAS; tion of Cool Kids studies. The first is what has been referred to as
Reynolds & Richmond, 1978). With 37 items that assess the standardized mean difference (SMD; Lipsey & Wilson, 2000)
chronic or trait anxiety, the RCMAS has been found to have good and is the analytical approach most frequently employed to eval-
reliability (Reynolds & Paget, 1983) and reasonable construct uate intervention outcomes as compared with control groups in
validity (Reynolds, 1982). those studies that implemented the latter. As a number of studies
Fear Survey Schedule for Children—Revised (FSSC-R; did use control groups, this review sought to make such compar-
Ollendick, 1983). The FSSC-R comprises 80 items (each of isons. Additionally, the standardized mean gain (SMG; Becker,
which are responded to on a 3-point scale) and demonstrates good 1988) effect size was also applied; this strategy explores changes
test–retest reliability and internal consistency (Ollendick, Matson, in continuous measures of constructs over time (e.g., baseline to
& Helsel, 1985). posttreatment). This author believes that the SMG makes a unique
110 MYCHAILYSZYN

contribution in the following manner: it allows for control groups studies share a common effect size was rejected and it was con-
to be taken into account by comparing a summary effect size for cluded that the true effects vary according to child-report (Q ⫽
intervention groups with one for control groups to determine 90.28, p ⬍ .001) as well as according to parent-report (Q ⫽
whether the former is statistically significantly greater than the 128.80, p ⬍ .001). The homogeneity results thus support the a
latter. In this way, findings are not limited to knowing only whether priori decision to conduct the meta-analysis according to a random
intervention groups have lower scores than control groups at a sin- effects model.
gular posttreatment timepoint. Rather, use of SMG allows for the
determination of whether an intervention group truly yields statisti-
Quantitative Data Synthesis
cally significantly greater change in scores over time as compared
with a control group, which takes baseline scores into account. By Standardized mean difference effect size. For the 11 studies
conducting both SMD and SMG analyses, it is hoped that the most evaluating the Cool Kids program that utilized control groups, the
comprehensive picture of outcomes will be provided. Analyses were aggregated effect size (Hedge’s g) comparing intervention groups
completed following procedures outlined by Borenstein, Hedges, against control groups (e.g., SMD) was significant at 0.54 (95% CI
Higgins, and Rothstein (2009), developers of the software program [0.19, 0.88], p ⬍ .01) in terms of decreases of child-reported
Comprehensive Meta-Analysis, which has been utilized in other anxiety-related symptoms. Results were similarly significant ac-
recent metaanalytical investigations published in top-tier journals cording to parent-report, though even more pronounced; specifi-
(e.g., Brunwasser, Gillham, & Kim, 2009; Hofmann, Sawyer, Witt, cally, the aggregated effect size (Hedges g) comparing intervention
& Oh, 2010). Additional analyses were conducted using the SPSS groups to control groups yielded a value of 0.84 (95% CI [0.45,
Version 23.0 for Windows statistical software package (SPSS, 1.23], p ⬍ .001). Thus, analysis according to postintervention
Inc., Chicago, IL). scores provide support for the Cool Kids program according to
both child- and parent-report.
Results Standardized mean gain effect size. For the 16 studies in
total evaluating the Cool Kids program that had baseline and
posttreatment data, the summary pre–post (e.g., SMG) effect
Study Characteristics size estimate (Hedge’s g) for those youth receiving the inter-
A total of 16 studies evaluating the Cool Kids program were vention was significant at 0.65 (95% CI [0.50, 0.79], p ⬍ .001)
identified using the search criteria and inclusions/exclusion criteria for reducing anxious symptomatology according to child-report
described above. A total of 1579 youth were involved in these measures (see Table 1). From the studies acquired, 11 utilized
investigations, and they ranged from 7–16 years in age, though control groups of various designs (e.g., waitlist, supportive
most were in the range of middle childhood (see Table 1). Partic- attention, etc.), for which the summary pre–post effect size
ipant attrition can pose a challenge to meta-analysis of data when estimate was significant at 0.35 (95% CI [0.19, 0.51], p ⬍ .001)
different sample sizes are reported at different timepoints; fortu- in terms of a decrease in anxiety symptoms over time. As can
nately, in the present review, only one study (Sciberras et al., be seen from the aggregated effect sizes and accompanying
2015) reported differential sample sizes at baseline and postinter- confidence intervals, individuals receiving the Cool Kids inter-
vention, and this was only a drop in 1 individual. Eleven of the 16 vention demonstrated statistically significant decreases in anx-
studies utilized control groups, which were mostly waitlist con- ious symptomatology from baseline to the end of the interven-
trols. All except two of the studies were at the intervention level of tion. While those in control groups similarly demonstrated
treatment, as enrolled youth underwent diagnostic interviews and significant reductions in anxiety, direct comparison of these
were found to meet criteria for one or more anxiety disorders; the summary effect sizes illustrates a significance between the two
remaining two (McLoone & Rapee, 2012; Mifsud & Rapee, 2005) (Z ⫽ 2.70, p ⬍ .01) with intervention groups demonstrating
fell into the classification of “indicated” prevention— both were statistically significantly greater reductions in anxiety from
school-based studies where screenings with questionnaires led to baseline-to-postintervention than controls.
identification of youth whose scores reflected elevated anxiety; Amongst the studies included in the present review, all also
such studies might also be deemed ‘early intervention,’ as such utilized one or more measures of parent report. Thus, in these 16
symptom levels often reflect subclinical levels of disorder al- studies, according to parent report, the summary pre–post (e.g.,
though it is likely that other enrolled youth would meet sufficient SMG) effect size estimate (Hedge’s g) for youth receiving the
criteria for disorder if administered a diagnostic interview. Across Cool Kids program was fairly consistent with that of child-report,
studies, the program was delivered in multiple modalities (e.g., in being significant at 0.84 (95% CI [0.66, 1.02], p ⬍ .001) for
clinic-based group therapy, via CD-ROM, Bibliotherapy) and was reducing anxious symptomatology. As above, 11 of these studies
implemented in different ways (e.g., by psychologists, graduate employed control groups, which produced a nonsignificant pre–
students under psychologist supervision, by parents, or via com- post effect size estimate of 0.17 (95% CI [⫺0.01, 0.38], p ⬎ .05)
puter program). for improving anxiety symptoms. A direct comparison between the
conditions reveals that youth receiving the Cool Kids intervention
experienced significant greater reductions (Z ⫽ 4.84, p ⬍ .001) in
Effect Size Distribution: Homogeneity Analysis
anxiety according to parent ratings than did youth in control
Statistical tests utilizing the Q-statistic (Borenstein et al., 2009) groups.
were conducted. The Q-statistic evaluates the null hypothesis that For the calculation of a fail-safe N, a criterion effect size of 0.20
all studies share a common effect size. For the collection of studies was selected as the level at which results would no longer be
reviewed, from the SMG perspective, the null hypothesis that all considered meaningful, as this represents what Cohen’s standards
META-ANALYSIS OF COOL KIDS INTERVENTION 111

Table 1
Characteristics of Studies

SMG
Number of Nature of control effect size
Study Country N Mean age (years) sessions group Measures analyzed (g)

Arendt, Thastum, and Denmark 109 11.78 10 Waitlist SCAS-C C ⫽ 1.069


Hougaard (2015) SCAS-P P ⫽ 1.166
Barrett, Dadds, and Rapee Australia 79 mnr (7–14 yrs) 12 Waitlist RCMAS C ⫽ .607
(1996) FSSC-R P ⫽ 1.231
CBCL
Chalfant, Rapee, and Carroll Australia 47 10.80 12 Waitlist RCMAS C ⫽ 3.053
(2007) SCAS-C P ⫽ 2.824
SCAS-P
SDQ-P
CATS
Cunningham et al. (2009) Australia 5 mnr (14–16 yrs) 8 No control SCAS-C C ⫽ ⫺.513
SCAS-P P ⫽ .139
CATS
Hudson et al. (2009) Australia 112 10.20 10 Placebo therapy SCAS-C C ⫽ 3.237
SCAS-P P ⫽ 1.295
SDQ-C
SDQ-P
Hudson et al. (2014) Australia 209 9.43 10 No control SCAS-C C ⫽ .700
SCAS-P P ⫽ .922
Jónsson et al. (2015) Denmark 87 11.18 10 No controla SCAS-C C ⫽ .477
SCAS-P P ⫽ .793
Lundkvist-Houndoumadi and Denmark 6 9.00 10 No control SCAS-C C ⫽ .171
Thastum (2013) SCAS-P P ⫽ .214
Lyneham and Rapee (2006) Australia 100 9.42 12 Waitlist RCMAS C ⫽ .757
SCAS-C P ⫽ 1.114
SCAS-P
CBCL
CATS
McLoone and Rapee (2012) Australia 152 9.11 10 Waitlist SCAS-C C ⫽ .413
SCAS-P P ⫽ .369
CATS
Mifsud and Rapee (2005) Australia 91 9.50 8 Waitlist SCAS-C C ⫽ .364
SCAS-P P ⫽ .435
CATS
Rapee (2000) Australia 95 10.47 9 Waitlist RCMAS C ⫽ .749
FSSC-R P ⫽ 1.077
CBCL
Rapee (2003) Australia 165 10.80 9 No control RCMAS C ⫽ .834
FSSC-R P ⫽ .525
CBCL
Rapee, Abbott, and Lyneham Australia 267 9.50 9 Waitlist SCAS-C C ⫽ .358
(2006) SCAS-P P ⫽ .621
CBCL
CATS
Sciberras et al. (2015) Australia 12 11.0 20 Treatment as SCAS-C C ⫽ .789
usual SCAS-P P ⫽ .617
SDQ-P
Wuthrich et al. (2012) Australia 43 15.17 8 Waitlist SCAS-C C ⫽ .803
SCAS-P P ⫽ .660
SDQ-P
CATS
Note. SMG ⫽ standardized mean gain; A “—” indicates that data were not reported or could not be obtained through communication with the authors;
“mnr” ⫽ mean not reported; “C” ⫽ Child-report measures; “P” ⫽ Parent-report measures.
a
In this study, the comparison group comprised individuals already represented in other studies included in this meta-analysis; they were thus excluded
to prevent a violation of the assumption of independence in meta-analysis.

for effect size interpretation suggest are small effect sizes (Cohen, Parent-report led to even more robust results, as 53 studies was
1988). Using this value, and based on child-report, results indicate obtained as the Fail-Safe N value. These findings therefore suggest
that 35 additional investigations of the Cool Kids program with an that the obtained summary effect sizes are relatively robust, would
effect size of zero would have to remain unidentified (“in the file not be considerably altered by presence of a few unidentified
drawer”) to reduce the summary effect size for anxiety interven- studies reaching null effects, and thus are an accurate representa-
tions from 0.64 to 0.20 according to child report of symptoms. tion of the research base.
112 MYCHAILYSZYN

Outcomes Over Time reduce the obtained summary effect sizes to a criterion level of 0.20
(e.g., a “small” effect size according to Cohen’s standards). As such,
As intervention trials often deliver the program to control because the present review’s rigorous study identification efforts only
groups following the main evaluation, the SMD effect size be- revealed 16 published studies of this particular intervention package,
comes less applicable for follow-up analysis as there is frequently the present summary effects can be interpreted as robust insofar as it
no longer a control group to compare to. As such, the SMG effect is unlikely that such a number of additional unpublished studies all
size was focused on here for analyzing maintenance of gains over with an effect size of zero actually exist somewhere ‘in file drawers.’
time. There were seven studies that assessed outcomes 3 months The extant literature contains a number of examples of reviews of
after the end of the Cool Kids intervention. These trials showed not specific intervention programs. Brunwasser and colleagues (2009)
only a maintenance, but an extension of gains, with a significant reviewed the Penn Resiliency Program (PRP). They reported evi-
mean SMG effect size from baseline to 3-month follow-up of 0.80 dence suggesting that PRP significantly reduces depressive symp-
(95% CI [0.48, 1.11], p ⬍ .001). A similar trend was identified toms. Briesch et al. (2010) report that findings on the Friends for Life
when looking at longer-term maintenance. There were 6 studies program suggest that there is promise of its use in school-based
that reported outcomes at 12 months, and for these investigations, settings at both the universal and target intervention levels for reduc-
there was a significant mean SMG effect size of 1.07 (95% CI ing anxious symptomatology. Additionally, Cuijpers and colleagues
[0.77, 1.37], p ⬍ .001). (2011) meta-analyzed interpersonal therapy for depression (IPT) and
concluded that it efficaciously treats depression, either as a stand-
Secondary Analyses alone treatment or in combination with medication. The meta-analytic
results presented here fit well within this context, demonstrating initial
Intervention effects on related constructs. This meta- evidence that the Cool Kids program leads to meaningful reductions
analysis also sought to determine whether the Cool Kids program’s in youth anxiety according to parent-report by either (e.g., SMG or
targeting of anxiety led to improvements in related constructs. The SMD) framework, as well as by child-report when considering an
range of associated variables assessed was limited, with only one SMD approach.
construct being evaluated and reported in more than a couple of the The current findings reflect an important contribution to the
studies. Data on this construct is reported below. existing literature, especially in the present day when selection of
Automatic thoughts. Seven of the included studies examined treatment protocols it to be ethically guided by standards of
changes in the presence of unwanted cognitions by administering evidence-based practice. This review summarizes the available
the Children’s Automatic Thoughts Scale (Schniering & Rapee, research on the Cool Kids program, a well-known cognitive–
2002). The mean pre–post (e.g., SMG) effect size estimate for behavioral intervention, and results from this meta-analysis aggre-
those receiving the Cool Kids intervention was 0.56 (95% CI [0.32, gate and quantify its overall effects as compared with control
0.80], p ⬍ .001). Of these studies, 6 out of 7 implemented control groups. Along with the above-referenced analyses that consider
groups, for which the summary pre–post effect size estimate was publication bias (e.g., Fail-Safe N calculations), the present review
0.21 (95% CI [0.01, 0.41], p ⬍ .05). A comparison of aggregated indicates that the combined results of all Cool Kids interventions
effect size estimates indicates that those receiving the Cool Kids are consistent with substantial reductions in anxiety—as well as
program demonstrated statistically significantly greater improve- improvements in dysfunctional automatic thoughts—for youth,
ments in the presence of automatic thoughts than did those in and that this program should be considered a viable option for
control groups (Z ⫽ 2.19, p ⬍ .05). family based group-therapy treatment of youth anxiety disorders.
As indicated above, 6 of the available studies in the current Preliminary findings would suggest that this program can be
collection of studies collected self-report data from both interven- implemented in schools for those identified as ‘at-risk’ for anxiety
tion and available control groups in terms of Automatic thoughts. disorders. However, as it has not yet been tested as a universal
For those 6 studies, the aggregated effect size (Hedge’s g) com- intervention, it is not yet certain whether Cool Kids can be suc-
paring intervention groups against control groups (e.g., SMD) was cessful in this modality. In any event, given the potential negative
significant at 0.94 (95% CI [0.28, 1.59], p ⬍ .01) in terms of sequelae of youth anxiety, this author would endorse more regular/
decreases in the presence and severity of automatic thoughts standardized screenings for anxiety and other psychological diffi-
related to anxiety. culties within the context of school mental health services, in
hopes that those who are experiencing— or just beginning to
exhibit— behavioral and emotional problems can be served appro-
Discussion
priately according to their developmental level.
The present meta-analysis yielded general support for the primary
hypothesis: For the 16 identified studies implementing applications of
Limitations
the Cool Kids program, mean change (SMG) effect sizes were statis-
tically significantly for intervention groups, which outperformed con- The present review strove for comprehensiveness in terms of re-
trol groups according to both child- and parent-report measures. In a viewing the available literature on the Cool Kids program. As such,
similar fashion, Cool Kids outperformed control groups according to studies were included even if they did not utilize control groups.
both child- and parent-report measures when utilizing a standardized Although this was an a priori intended goal of the project, the author
mean different effect size. According to effect sizes based on both also acknowledges that noncontrolled studies possess less method-
child- and parent-report, fail-safe N calculations indicated that 35–53 ological rigor; however, as there were only 5 studies without control
additional investigations of the Cool Kids program—all with effect groups (as operationally defined for this review), and as these results
sizes of zero—would have to remain unidentified “in file drawers” to are aggregated along with the rest while being weighted according to
META-ANALYSIS OF COOL KIDS INTERVENTION 113

sample size, this helps to buffer against the existence of any outlier Résumé
results unduly influencing overall conclusions.
Additionally, in the present review, parent-report was restricted Réaliser une méta-analyse visant à faire le sommaire de la recher-
to data provided by mothers. This decision was made based on the che actuelle sur le programme Cool Kids, une intervention
sparseness of father-report data available across studies. Indeed, cognitivo-comportementale pour les troubles anxieux chez les
even in studies where input from both parents was actively sought jeunes, et évaluer son efficacité globale quant à la symptomatolo-
out, difficulties were often encountered. For instance, Rapee gie anxieuse. Une recherche dans les bases de données en ligne, le
(2000) noted that “Because relatively few fathers returned data, dépouillement des listes de références et des échanges avec des
inclusion of their questionnaires in this analysis would have un- prestataires et des concepteurs du programme, ont permis de cerner
duly reduced total numbers” (p. 126). Additionally, Lyneham and 16 études ayant analysé les effets du programme Cool Kids lui-
Rapee (2006) reported that “father’s data were not available in même (N ⫽ 1579), de ses ancêtres et de ses dérivés. Les analyses
26% of the sample” (p. 1293). As such, because the convention in se sont centrées sur les réponses des enfants et des parents au sujet
other included studies (e.g., Hudson et al., 2009) was to gather data de l’anxiété, l’ampleur des effets ayant été combinée selon un
only from mothers, the present review focused on mother-report. modèle à effets aléatoires et calculée en tant que différence entre
This was admittedly discouraging, and unfortunately is consistent les mesures de post-traitement des groupes ayant eu des interven-
with prior research citing a lack of attention paid to the role of tions et celles des groupes témoins (différence des moyennes
fathers in treatment for youth internalizing disorders, particularly standardisées), de même qu’en tenant compte des changements
anxiety disorders (Bögels & Phares, 2008; Podell & Kendall, dans les scores entre deux temps de mesure (gain moyen stan-
2011). As such, an exhortation to reverse this trend and build a dardisé). Les analyses ont révélé une amélioration supérieure chez
greater understanding of fathers’ roles should be considered as a les jeunes bénéficiant des interventions du programme Cool Kids,
recommendation for future research. comparativement aux groupes témoins, selon les analyses de la
Lastly, too few studies in this collection included teacher-report différence des moyennes standardisées, pour les réponses à la fois
of youth anxiety. This is discouraging, as teachers represent one of des enfants et des parents, et selon les analyses du gain moyen
the most consistent adult points of contact that children and ado- standardisé, pour les réponses des parents, mais non pour celles
lescents have each day for 9 –10 months of the year or more. It des enfants, en dépit d’une ampleur des effets combinée quasi
would be valuable for future research on the Cool Kids program to identique; cette différence était attribuable à de plus grands gains
more reliably seek out teacher perceptions of how students are rapportés par les jeunes de groupes témoins; des analyses secon-
getting along in the classroom, as this would lend an added level daires suggèrent également une amélioration supérieure sur le plan
of ecological validity in terms of the degree to which students des pensées automatiques parmi les participants au programme.
experience improved emotional functioning in one of the most Cette intervention a été mise en vigueur selon différentes formules,
central environmental settings of their daily lives. elle est prometteuse et, dans le contexte actuel de la pratique axée
sur les preuves, elle peut être perçue comme ayant une solide base
empirique.
Future Directions: “Cool Little Kids”
Mots-clés : anxiété, jeunes, Cool Kids, méta-analyse, revue
In seeking to downward extend the benefits of the Cool Kids
systématique.
program, Rapee and colleagues have sought to apply the interven-
tion’s success to an even younger cohort of individuals at risk for
struggles with anxiety—a program known as Cool Little Kids, which References
is an intervention delivered to parents of preschool-age youth, rather References marked with an asterisk (ⴱ) indicate studies included in the
than the children themselves. Based on existing research that with- meta-analysis.
drawn and inhibited temperament is known to be the greatest risk
factor for anxiety disorders later in youth, it would be important to Abramson, L. Y., Alloy, L. B., & Metalsky, G. I. (1989). Hopelessness
determine whether it is possible to alter this developmental trajectory depression: A theory-based subtype of depression. Psychological Re-
view, 96, 358 –372. http://dx.doi.org/10.1037/0033-295X.96.2.358
through prevention efforts. “In a recent systematic review of early
Achenbach, T. M., & Edelbrock, C. S. (1991). Manual for the Child
interventions to improve social, emotional and behavioral outcomes, Behavior Checklist and Profile. Burlington, VT: University of Vermont.
Bayer and colleagues (2009) identified Cool Little Kids as the only Albano, A. M., Chorpita, B. F., & Barlow, D. H. (2003). Childhood anxiety
preschool age prevention program to successfully prevent anxiety disorders. In E. J. Mash & R. A. Barkley (Eds.), Child psychopathology
disorders” (Beatson et al., 2014, p. 651). Two randomized controlled (2nd ed., pp. 279 –329). New York, NY: Guilford Press.

trials have demonstrated the of this program thus far (Kennedy, Arendt, K., Thastum, M., & Hougaard, E. (2015). Efficacy of a Danish
Rapee, & Edwards, 2009; Rapee, Kennedy, Ingram, Edwards, & version of the Cool Kids program: A randomized wait-list controlled
Sweeney, 2010), and a large-scale new population-based trial (Bayer trial. Acta Psychiatria Scandinavica, 1–13.

et al., 2011) of the Cool Little Kids program was recently completed, Barrett, P. M., Dadds, M. R., & Rapee, R. M. (1996). Family treatment of
with data to be published in the near future. Thus, research of the childhood anxiety: A controlled trial. Journal of Consulting and Clinical
Psychology, 64, 333–342. http://dx.doi.org/10.1037/0022-006X.64.2
overall family of Cool Kids-based interventions continues to grow. It
.333
has been developmentally translated for adolescents via computer- Bayer, J., Hiscock, H., Scalzo, K., Mathers, M., McDonald, M., Morris, A.,
based technology, and for preschoolers via parent-based intervention. . . . Wake, M. (2009). Systematic review of preventive interventions for
Considering the promising results thus far, future researchers are children’s mental health: What would work in Australian contexts?
encouraged to continue exploring applications and to continue eval- Australian and New Zealand Journal of Psychiatry, 43, 695–710. http://
uating the efficacy and effectiveness of the program in new contexts. dx.doi.org/10.1080/00048670903001893
114 MYCHAILYSZYN

Bayer, J. K., Rapee, R. M., Hiscock, H., Ukoumunne, O. C., Mihalopoulos, Goodman, R. (2001). Psychometric properties of the strengths and diffi-
C., Clifford, S., & Wake, M. (2011). The Cool Little Kids randomised culties questionnaire. Journal of the American Academy of Child &
controlled trial: Population-level early prevention for anxiety disorders. Adolescent Psychiatry, 40, 1337–1345. http://dx.doi.org/10.1097/
BMC Public Health, 11, 11. http://dx.doi.org/10.1186/1471-2458-11-11 00004583-200111000-00015
Beatson, R. M., Bayer, J. K., Perry, A., Mathers, M., Hiscock, H., Wake, Goodman, R., Meltzer, H., & Bailey, V. (1998). The Strengths and Diffi-
M., . . . Rapee, R. M. (2014). Community screening for preschool child culties Questionnaire: A pilot study on the validity of the self-report
inhibition to offer the ‘Cool Little Kids’ anxiety prevention programme. version. European Child & Adolescent Psychiatry, 7, 125–130. http://
Infant and Child Development, 23, 650 – 661. http://dx.doi.org/10.1002/ dx.doi.org/10.1007/s007870050057
icd.1863 Goodman, R., & Scott, S. (1999). Comparing the Strengths and Difficulties
Becker, B. J. (1988). Synthesizing standardized mean-change measures. Questionnaire and the Child Behavior Checklist: Is small beautiful?
British Journal of Mathematical and Statistical Psychology, 41, 257– Journal of Abnormal Child Psychology, 27, 17–24. http://dx.doi.org/10
278. http://dx.doi.org/10.1111/j.2044-8317.1988.tb00901.x .1023/A:1022658222914
Bögels, S., & Phares, V. (2008). Fathers’ role in the etiology, prevention Hofmann, S. G., Sawyer, A. T., Witt, A. A., & Oh, D. (2010). The effect
and treatment of child anxiety: A review and new model. Clinical of mindfulness-based therapy on anxiety and depression: A meta-
Psychology Review, 28, 539 –558. http://dx.doi.org/10.1016/j.cpr.2007 analytic review. Journal of Consulting and Clinical Psychology, 78,
.07.011 169 –183. http://dx.doi.org/10.1037/a0018555

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Hudson, J. L., Newall, C., Rapee, R. M., Lyneham, H. J., Schniering,
Introduction to meta-analysis. West Sussex, UK: Wiley. http://dx.doi C. C., Wuthrich, V. M., . . . Gar, N. S. (2014). The impact of brief
.org/10.1002/9780470743386 parental anxiety management on child anxiety treatment outcomes: A
Briesch, A. M., Hagermoser Sanetti, L. M., & Briesch, J. M. (2010). controlled trial. Journal of Clinical Child and Adolescent Psychology,
Reducing the prevalence of anxiety in children and adolescents: An 43, 370 –380. http://dx.doi.org/10.1080/15374416.2013.807734

evaluation of the FRIENDS for Life Program. School Mental Health, 2, Hudson, J. L., Rapee, R. M., Deveney, C., Schniering, C. A., Lyneham,
155–165. http://dx.doi.org/10.1007/s12310-010-9042-5 H. J., & Bovopoulos, N. (2009). Cognitive-behavioral treatment versus
Brunwasser, S. M., Gillham, J. E., & Kim, E. S. (2009). A meta-analytic an active control for children and adolescents with anxiety disorders:
A randomized trial. Journal of the American Academy of Child &
review of the Penn Resiliency Program’s effect on depressive symptoms.
Adolescent Psychiatry, 48, 533–544. http://dx.doi.org/10.1097/CHI
Journal of Consulting and Clinical Psychology, 77, 1042–1054. http://
.0b013e31819c2401
dx.doi.org/10.1037/a0017671.supp ⴱ
Jónsson, H., Thastum, M., Arendt, K., & Juul-Sørensen, M. (2015). Group
Cartwright-Hatton, S., McNicol, K., & Doubleday, E. (2006). Anxiety in a
cognitive behavioural treatment of youth anxiety in community based
neglected population: Prevalence of anxiety disorders in pre-adolescent
clinical practice: Clinical significance and benchmarking against effi-
children. Clinical Psychology Review, 26, 817– 833. http://dx.doi.org/10
cacy. Journal of Anxiety Disorders, 35, 9 –18. http://dx.doi.org/10.1016/
.1016/j.cpr.2005.12.002
ⴱ j.janxdis.2015.06.009
Chalfant, A. M., Rapee, R., & Carroll, L. (2007). Treating anxiety disor-
Kendall, P. C. (1994). Treating anxiety disorders in children: Results of a
ders in children with high functioning autism spectrum disorders: A
randomized clinical trial. Journal of Consulting and Clinical Psychol-
controlled trial. Journal of Autism and Developmental Disorders, 37,
ogy, 62, 100 –110. http://dx.doi.org/10.1037/0022-006X.62.1.100
1842–1857. http://dx.doi.org/10.1007/s10803-006-0318-4
Kendall, P. C., Brady, E. U., & Verduin, T. L. (2001). Comorbidity in
Chavira, D. A., Stein, M. B., Bailey, K., & Stein, M. T. (2004). Child
childhood anxiety disorders and treatment outcome. Journal of the
anxiety in primary care: Prevalent but untreated. Depression and Anxi-
American Academy of Child & Adolescent Psychiatry, 40, 787–794.
ety, 20, 155–164. http://dx.doi.org/10.1002/da.20039
http://dx.doi.org/10.1097/00004583-200107000-00013
Cohen, J. (1988). Statistical power analysis for the behavioral sciences Kendall, P. C., Safford, S., Flannery-Schroeder, E., & Webb, A. (2004).
(2nd ed.). Hillsdale, NJ: Erlbaum. Child anxiety treatment: Outcomes in adolescence and impact on sub-
Costello, E. J., Egger, H., & Angold, A. (2005). 10-year research update stance use and depression at 7.4-year follow-up. Journal of Consulting
review: The epidemiology of child and adolescent psychiatric disorders: and Clinical Psychology, 72, 276 –287. http://dx.doi.org/10.1037/0022-
I. Methods and public health burden. Journal of the American Academy 006X.72.2.276
of Child & Adolescent Psychiatry, 44, 972–986. http://dx.doi.org/10 Kennedy, S. J., Rapee, R. M., & Edwards, S. L. (2009). A selective
.1097/01.chi.0000172552.41596.6f intervention program for inhibited preschool-aged children of parents
Cuijpers, P., Geraedts, A. S., van Oppen, P., Andersson, G., Markowitz, with an anxiety disorder: Effects on current anxiety disorders and
J. C., & van Straten, A. (2011). Interpersonal psychotherapy for depres- temperament. Journal of the American Academy of Child & Adolescent
sion: A meta-analysis. The American Journal of Psychiatry, 168, 581– Psychiatry, 48, 602– 609. http://dx.doi.org/10.1097/CHI.0b013e31
592. http://dx.doi.org/10.1176/appi.ajp.2010.10101411 819f6fa9
Cunningham, M. (2008). Overview of design approaches in the Cool Teens Lipsey, M. W., & Wilson, D. B. (2000). Applied Social Research Methods
CD and other computer programs for adolescent anxiety. E-Journal of Series: Vol. 49. Practical meta-analysis. Thousand Oaks, CA: Sage.
Applied Psychology, 4, 6 –11. http://dx.doi.org/10.7790/ejap.v4i2.116 ⴱ
Lundkvist-Houndoumadi, I., & Thastum, M. (2013). A “Cool Kids”
Cunningham, M., Rapee, R., & Lyneham, H. (2007). Overview of the Cool cognitive-behavioral therapy group for youth with anxiety disorders: Pt.
Teens CD-ROM for anxiety disorders in adolescents. The Behavior 2, analysis of the process and outcome of responders versus nonre-
Therapist, 30, 15–19. sponders. Pragmatic Case Studies in Psychotherapy, 9, 179 –274.
Cunningham, M., & Wuthrich, V. (2007). The Cool Teens CD-ROM ⴱ
Lyneham, H. J., & Rapee, R. M. (2006). Evaluation of therapist-supported
program: An anxiety management program for young people. Journal of parent-implemented CBT for anxiety disorders in rural children. Behav-
Family Studies, 13, 104 –108. iour Research and Therapy, 44, 1287–1300. http://dx.doi.org/10.1016/j

Cunningham, M. J., Wuthrich, V. M., Rapee, R. M., Lyneham, H. J., .brat.2005.09.009
Schniering, C. A., & Hudson, J. L. (2009). The Cool Teens CD-ROM for Manassis, K., & Monga, S. (2001). A therapeutic approach to children and
anxiety disorders in adolescents: A pilot case series. European Child & adolescents with anxiety disorders and associated comorbid conditions.
Adolescent Psychiatry, 18, 125–129. http://dx.doi.org/10.1007/s00787- Journal of the American Academy of Child & Adolescent Psychiatry, 40,
008-0703-y 115–117. http://dx.doi.org/10.1097/00004583-200101000-00024
META-ANALYSIS OF COOL KIDS INTERVENTION 115

Mathers, C. D., & Loncar, D. (2006). Projections of global mortality and Reynolds, C. R. (1982). Convergent and divergent validity of the Revised
burden of disease from 2002 to 2030. PLoS Medicine, 3, e442. http:// Children’s Manifest Anxiety Scale. Educational and Psychological
dx.doi.org/10.1371/journal.pmed.0030442 Measurement, 42, 1205–1212. http://dx.doi.org/10.1177/0013164
McCathie, H., & Spence, S. H. (1991). What is the revised Fear Survey 48204200429
Schedule for Children measuring? Behaviour Research and Therapy, 29, Reynolds, C. R., & Paget, K. D. (1983). National normative and reliability
495–502. http://dx.doi.org/10.1016/0005-7967(91)90134-O data for the Revised Children’s Manifest Anxiety Scale. School Psy-

McLoone, J. K., & Rapee, R. M. (2012). Comparison of an anxiety chology Review, 12, 324 –336.
management program for children implemented at home and school: Reynolds, C. R., & Richmond, B. O. (1978). What I think and feel: A
Lessons learned. School Mental Health, 4, 231–242. http://dx.doi.org/ revised measure of children’s manifest anxiety. Journal of Abnormal
10.1007/s12310-012-9088-7 Child Psychology, 6, 271–280. http://dx.doi.org/10.1007/BF00919131
Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Rosenthal, R. (1979). The “file drawer problem” and tolerance for null
Cui, L., . . . Swendsen, J. (2010). Lifetime prevalence of mental disor- results. Psychological Bulletin, 86, 638 – 641. http://dx.doi.org/10.1037/
ders in U.S. adolescents: Results from the National Comorbidity Survey 0033-2909.86.3.638
Replication—Adolescent Supplement (NCS-A). Journal of the Ameri- Rosenthal, R. (1984). Meta-analytic procedures for social research. Ap-
can Academy of Child & Adolescent Psychiatry, 49, 980 –989. http://dx plied Social Research Methods Series (Vol. 6). Beverly Hills, CA: Sage
.doi.org/10.1016/j.jaac.2010.05.017 Publications.

Mifsud, C., & Rapee, R. M. (2005). Early intervention for childhood Rosenthal, R. (1993). Meta-analytic procedures for social research. New-
anxiety in a school setting: Outcomes for an economically disadvantaged bury Park, CA: Sage.
population. Journal of the American Academy of Child & Adolescent Schniering, C. A., & Lyneham, H. J. (2007). The Children’s Automatic
Psychiatry, 44, 996 –1004. http://dx.doi.org/10.1097/01.chi.0000173294 Thoughts Scale in a clinical sample: Psychometric properties and clin-
.13441.87 ical utility. Behaviour Research and Therapy, 45, 1931–1940. http://dx
Muris, P., Merckelbach, H., Ollendick, T. H., King, N. J., Meesters, C., & .doi.org/10.1016/j.brat.2006.09.009
van Kessel, C. (2002). What is the Revised Fear Survey Schedule for Schniering, C. A., & Rapee, R. M. (2002). Development and validation of
Children measuring? Behaviour Research and Therapy, 40, 1317–1326. a measure of children’s automatic thoughts: The children’s automatic
http://dx.doi.org/10.1016/S0005-7967(02)00007-4 thoughts scale. Behaviour Research and Therapy, 40, 1091–1109. http://
Nauta, M. H., Scholing, A., Rapee, R. M., Abbott, M., Spence, S. H., & dx.doi.org/10.1016/S0005-7967(02)00022-0
Waters, A. (2004). A parent-report measure of children’s anxiety: Psy- Sciberras, E., Mulraney, M., Anderson, V., Rapee, R. M., Nicholson, J. M.,
chometric properties and comparison with child-report in a clinic and Efron, D., . . . Hiscock, H. (2015). Managing anxiety in children with
normal sample. Behaviour Research and Therapy, 42, 813– 839. http:// ADHD using cognitive-behavioral therapy: A pilot randomized con-
dx.doi.org/10.1016/S0005-7967(03)00200-6 trolled trial. Journal of Attention Disorders. Advance online publication.
Ollendick, T. H. (1983). Reliability and validity of the Revised Fear http://dx.doi.org/10.1177/1087054715584054
Surgery Schedule for Children (FSSC-R). Behaviour Research and Spence, S. H. (1998). A measure of anxiety symptoms among children.
Therapy, 21, 685– 692. http://dx.doi.org/10.1016/0005-7967(83)90087-6 Behaviour Research and Therapy, 36, 545–566. http://dx.doi.org/10
Ollendick, T. H., Matson, J. L., & Helsel, W. J. (1985). Fears in children .1016/S0005-7967(98)00034-5
and adolescents: Normative data. Behaviour Research and Therapy, 23, Sterling, T. D. (1959). Publication decisions and their possible effects on
465– 467. http://dx.doi.org/10.1016/0005-7967(85)90174-3 inferences drawn from tests of significance—Or vice versa. Journal of
Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal the American Statistical Association, 54, 30 –34.
of Educational Statistics, 8, 157–159. http://dx.doi.org/10.2307/1164923 Stewart, R. E., & Chambless, D. L. (2009). Cognitive-behavioral therapy
Podell, J. L., & Kendall, P. C. (2011). Mothers and fathers in family for adult anxiety disorders in clinical practice: A meta-analysis of
cognitive-behavioral therapy for anxious youth. Journal of Child and effectiveness studies. Journal of Consulting and Clinical Psychology,
Family Studies, 20, 182–195. http://dx.doi.org/10.1007/s10826-010- 77, 595– 606. http://dx.doi.org/10.1037/a0016032.supp
9420-5 United States Congress, Office of Technology Assessment. (1986). Chil-
ⴱ dren’s mental health: Problems and services. OTA-H-33. Washington,
Rapee, R. M. (2000). Group treatment of children with anxiety disorder:
Outcome and predictors of treatment response. Australian Journal of DC: U.S. Government Printing Office.
Psychology, 52, 125–129. http://dx.doi.org/10.1080/000495300082 Vikan, A. (1985). Psychiatric epidemiology in a sample of 1510 ten-year-
55379 old children—I. Prevalence. Child Psychology & Psychiatry & Allied
ⴱ Disciplines, 26, 55–75. http://dx.doi.org/10.1111/j.1469-7610.1985
Rapee, R. M. (2003). The influence of comorbidity on treatment outcome
for children and adolescents with anxiety disorders. Behaviour Research .tb01628.x
and Therapy, 41, 105–112. http://dx.doi.org/10.1016/S0005-7967 Woodward, L. J., & Fergusson, D. M. (2001). Life course outcomes of
(02)00049-9 young people with anxiety disorders in adolescence. Journal of the
ⴱ American Academy of Child & Adolescent Psychiatry, 40, 1086 –1093.
Rapee, R. M., Abbott, M. J., & Lyneham, H. J. (2006). Bibliotherapy for
children with anxiety disorders using written materials for parents: A http://dx.doi.org/10.1097/00004583-200109000-00018

randomized controlled trial. Journal of Consulting and Clinical Psychol- Wuthrich, V. M., Rapee, R. M., Cunningham, M. J., Lyneham, H. J.,
ogy, 74, 436 – 444. http://dx.doi.org/10.1037/0022-006X.74.3.436 Hudson, J. L., & Schniering, C. A. (2012). A randomized controlled trial
Rapee, R. M., Kennedy, S. J., Ingram, M., Edwards, S. L., & Sweeney, L. of the Cool Teens CD-ROM computerized program for adolescent
(2010). Altering the trajectory of anxiety in at-risk young children. The anxiety. Journal of the American Academy of Child & Adolescent
American Journal of Psychiatry, 167, 1518 –1525. http://dx.doi.org/10 Psychiatry, 51, 261–270. http://dx.doi.org/10.1016/j.jaac.2011.12.002
.1176/appi.ajp.2010.09111619
Rapee, R. M., Wignall, A., & Hudson, J. L., & Schniering, C. A. (2000). Received May 2, 2016
Treating anxious children: An evidence based approach. Oakland, CA: Revision received September 16, 2016
New Harbinger. Accepted December 8, 2016 䡲

You might also like