Download as pdf or txt
Download as pdf or txt
You are on page 1of 17

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/318064094

Organizational skills training for children with ADHD

Article  in  European Psychiatry · April 2017


DOI: 10.1016/j.eurpsy.2017.01.1924

CITATIONS READS

0 955

3 authors, including:

Denis Sukhodolsky Søren Dalsgaard


Yale University Aarhus University
111 PUBLICATIONS   3,306 CITATIONS    106 PUBLICATIONS   2,292 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

RDoC and Autism View project

Children with ADHD and target shootingsport View project

All content following this page was uploaded by Denis Sukhodolsky on 11 August 2017.

The user has requested enhancement of the downloaded file.


Clinical Psychology Review 52 (2017) 108–123

Contents lists available at ScienceDirect

Clinical Psychology Review

journal homepage: www.elsevier.com/locate/clinpsychrev

Review

Meta-analysis of organizational skills interventions for children and


adolescents with Attention-Deficit/Hyperactivity Disorder
Aida Bikic a,b,⁎,1, Brian Reichow a,c, Spencer A. McCauley a, Karim Ibrahim a, Denis G. Sukhodolsky a,⁎⁎
a
Child Study Center, Yale School of Medicine, 230 South Frontage Road, 06511 New Haven, Yale University, USA
b
Institute of Clinical Research, University of Southern Denmark, Winsløwparken 19, Odense, Denmark
c
Anita Zucker Center for Excellence in Early Childhood Studies, University of Florida, 1345 Norman Hall 618 SW 12th Street, Gainesville, USA

H I G H L I G H T S

• Organizational skills interventions have positive effects on outcomes related to ADHD.


• Moderate improvements in organizational skills of children with ADHD rated by teachers
• Large improvements in organizational skills of children with ADHD rated by parents
• Modest improvements on the ratings of symptoms of inattention and academic performance
• The review notes methodological limitations of the organizational skills training trials

a r t i c l e i n f o a b s t r a c t

Article history: Background: In addition to problems with attention and hyperactivity, children with ADHD present with poor or-
Received 1 December 2015 ganizational skills required for managing time and materials in academic projects. Organizational skills training
Received in revised form 26 December 2016 (OST) has been increasingly used to address these deficits. We conducted a systematic review and meta-analysis
Accepted 27 December 2016 of OST in children with ADHD.
Available online 29 December 2016
Objectives: The objective of this study was to systematically review the evidence of the effects of OST for children
with ADHD for organizational skills, attention, and academic performance.
Keywords:
ADHD
Methods: We searched 3 electronic databases to locate randomized controlled trials published in English in peer-
Organizational skills training reviewed journals comparing OST with parent education, treatment-as-usual, or waitlist control conditions.
Behavioral treatment Standardized mean difference effect sizes from the studies were statistically combined using a random-effects
Time management meta-analyses across six outcomes: teacher- and parent-rated organizational skills, teacher- and parent-rated in-
Academic interventions attention, teacher-rated academic performance, and Grade Point Average (GPA). Risk of bias was assessed for
randomization, allocation concealment, blinding of participants and treatment personnel, blinding of outcome
assessors, incomplete outcome data, and selective outcome reporting.
Results: Twelve studies involving 1054 children (576 treatment, 478 control) were included in the meta-analyses.
Weighted mean effect sizes for teacher- and parent-rated outcome measures of organizational skills were g =
0.54 (95% CI 0.17 to 0.91) and g = 0.83 (95% CI 0.32 to 1.34), respectively. Weighted mean effect sizes of teacher-
and parent-rated symptoms of inattention were g = 0.26 (95% CI 0.01 to 0.52) and g = 0.56 (95% CI 0.38 to 0.74),
respectively. Weighted standardized mean effect size for teacher-rated academic performance and GPA were
g = 0.33 (95% CI 0.14 to 0.51) and g = 0.29 (95% CI 0.07 to 0.51), respectively.
Conclusions: OST leads to moderate improvements in organizational skills of children with ADHD as rated by
teachers and large improvements as rated by parents. More modest improvements were observed on the ratings
of symptoms of inattention and academic performance.
Protocol registration: PROSPERO (CRD42015019261).
© 2016 Elsevier Ltd. All rights reserved.

Abbreviations: AAPC, Adolescent academic problems checklist; ADHD, Attention-Deficit/Hyperactivity Disorder; APRS, Academic Performance Rating Scale; CPS, Classroom
Performance Survey; CSI, Child Symptom Inventory; COSS, Children's Organizational Skills Scale; DBD, Disruptive Behavior Disorders Rating Scale; HPC, Homework Problem Checklist;
OST, Organizational skills training; TAU, Treatment as usual.
⁎ Correspondence to: A. Bikic, Kresten Phillipsens Vej 15, 6200 Aabenraa, Denmark.
⁎⁎ Correspondence to: D.G. Sukhodolsky, Yale Child Study Center, 230 South Frontage Road, New Haven CT 06520, USA.
E-mail addresses: aida.bikic@rsyd.dk (A. Bikic), denis.sukhodolsky@yale.edu (D.G. Sukhodolsky).
1
Department of Child and Adolescent Mental Health, Kresten Phillipsens Vej 15, 6200 Aabenraa, Region of Southern Denmark, Denmark.

http://dx.doi.org/10.1016/j.cpr.2016.12.004
0272-7358/© 2016 Elsevier Ltd. All rights reserved.
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 109

Contents

1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
2. Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
2.1. Search strategy to identify studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
2.2. Selection of studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
2.3. Interventions included in meta-analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
2.4. Variable definition and coding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
2.5. Outcome measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
2.6. Effect size estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
2.7. Meta-analytic procedures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
3. Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
3.1. Study selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
3.2. Description of studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
3.3. Risk of bias . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
3.4. Meta-analytic results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
3.4.1. Teacher-reported organizational skills . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
3.4.2. Parent-reported organizational skills . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
3.4.3. Teacher-reported inattention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
3.4.4. Parent-reported inattention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
3.4.5. Teacher-rated academic performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
3.4.6. Student's Grade Point Average (GPA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
3.4.7. Outcomes not included in meta-analyses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
4. Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
4.1. Differences across studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
4.2. Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
5. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Roles of each author . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Conflict of interest . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Funding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Appendix A. Supplementary data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121

1. Introduction et al., 2012; Langberg et al., 2010), and persist into adulthood (Barkley &
Fischer, 2011). Poor organizational skills are also associated with aca-
Attention-Deficit/Hyperactivity Disorder (ADHD) is a common demic underachievement, as well as psychosocial, occupational, and
neurodevelopmental disorder that affects approximately 5% of children economic difficulties (Kent et al., 2011; Massetti et al., 2008; Murphy,
in the general population (Polanczyk, de Lima, Horta, Biederman, & 2002; Murphy, Barkley, & Bush, 2002). Even in gifted students with
Rohde, 2007). The etiology of ADHD is still undetermined but may in- ADHD, organizational skills deficits were shown to hinder academic
volve a complex interaction between multiple genes and environmental performance (Leroux & Levitt-Perlman, 2000). Thus, due to their chron-
risk factors (Faraone, 2000). Children with ADHD have been shown to ic course and adverse consequences, organizational skills have become a
be more prone to drop out of school (Kent et al., 2011) and to be more focus of treatment and clinical research in children with ADHD.
susceptible to developing other psychiatric disorders, substance abuse, Although OST targets a specific set of organizational skills, symptoms
criminality, and adverse health events (Dalsgaard, Mortensen, of inattention are also an important outcome in OST treatment studies.
Frydenberg, & Thomsen, 2002, 2013; Dalsgaard, Ostergaard, Leckman, Most children with ADHD exhibit a range of neurocognitive deficits in
Mortensen, & Pedersen, 2015; Maibing et al., 2015). Thus, developing the domains of sustained attention, working memory, and cognitive
effective treatments for ADHD is an important public health priority. control (Diamond, 2013; Nigg, 2005; Willcutt et al., 2005). It is likely
Besides ADHD symptoms, children with ADHD also show a range that organizational skills such as task planning and materials manage-
of attention and executive functions deficits (Willcutt, Doyle, Nigg, ment also rely on the same executive functions that are impaired in
Faraone, & Pennington, 2005). As defined by the Diagnostic and Statisti- ADHD. Indeed, it has been noted that organizational problems may be
cal Manual of Mental Disorders, 5th Edition (DSM-5) (American associated with skill deficits (not having the skill) and performance def-
Psychiatric Association, 2013), four out of the nine ADHD symptoms of icits (not having sufficient motivation to perform the skill) as well as
inattention relate directly to problems with organization and planning with the neurocognitive functions that may underlie specific organiza-
(i.e., loses things, is forgetful, has difficulties organizing tasks, and fails tional skills (Abikoff et al., 2013). Given that acquisition and practice
to finish tasks). These symptoms have been linked to poor academic of a new behavior can influence neural development via mechanisms
performance in children with ADHD (Nigg, 2005; Willcutt et al., 2005). of neuroplasticity (Rapoport & Gogtay, 2008; Skoe & Kraus, 2012), it is
The topic of organizational skills in children with ADHD has emerged possible that OST can engage the reciprocal associations of organiza-
as an area of research and clinical focus because of its potential impact tional skills with ADHD symptoms and neurocognitive functions. For
on academic success as children with ADHD also have problems manag- example, as children learn and practice organizational skills during
ing school materials and meeting deadlines. Organizational skills OST they also engage and exercise neurocognitive functions (such as
deficits often multiply with the increase of task demands (Booster, sustained attention and cognitive control). This practice of executive
Dupaul, Eiraldi, & Power, 2012; Langberg et al., 2010). In addition, prob- functions may in turn translate into reduction of ADHD symptoms of in-
lems such as procrastination and failure to plan, prioritize, and organize attention. Other mechanisms of change in inattention may be engaged
academic tasks tend to increase from childhood to adolescence (Booster in multi-component OST interventions that include elements such as
110 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

daily report cards and study skills training, which can also contribute to activities. All OST programs also included parenting components, al-
the improvement of ADHD symptoms (Owens et al., 2012). Parent though of varying duration, aimed at improving the quality of parental
training in the multi-component programs may lead to contingent re- monitoring, prompting, and rewarding of their child's initiation as
wards for staying on task during homework and activities of daily living, well as performance on homework and other school-related tasks.
which might improve attention (Haack, Villodas, McBurnett, Hinshaw, Many programs set specific organization criteria for binders, bookbags,
& Pfiffner, 2016). Of course, these are assumptions that will need to be and other materials, which are used to focus goals for the training
tested in individual randomized controlled trials by collecting data on (Abikoff et al., 2013; Evans et al., 2016; Langberg, Epstein,
organizational skills, inattention, and executive function at multiple Urbanowicz, Simon, & Graham, 2008b; Langberg et al., 2012). Several
time points in order to examine if change in ADHD symptoms is studies included in this meta-analysis utilized OST as part of multi-
mediated by change in OST skills and/or change in executive functions. component interventions that addressed other treatment targets such
Evaluating the effects of OST on symptoms of inattention in this meta- social skills and daily living skills (Pfiffner et al., 2007; Pfiffner et al.,
analysis is the first step to confirming (or disconfirming) that OST 2014) and family functioning (Power et al., 2012; Sibley, 2016).
can change these symptoms so that future studies can test the With the increasing recognition of organizational skills as a separate
neurocognitive and neural mechanisms of these effects. treatment target in children with ADHD, we were interested in estimat-
Regarding available treatments, stimulant medication is the first- ing the effects of OST across well-designed randomized controlled stud-
line treatment for ADHD, although 20 to 30% of patients do not respond ies. To our knowledge, two qualitative reviews (Langberg et al., 2008a;
to medication and the long-term effects of treatment with stimulants Storer, Evans, & Langberg, 2014) have addressed this topic so far and,
are relatively unknown (Molina et al., 2009; Storebo et al., 2015; to date, no quantitative reviews of organizational skills interventions
Swanson & Volkow, 2009). While medication does improve symptoms have been conducted. Thus, the purpose of this meta-analysis is to eval-
of inattention and hyperactivity, it has a modest effect on uate the effects of OST on three domains of outcomes: organizational
neurocognitive tasks of executive functions (Coghill, Rhodes, & skills, symptoms of inattention and academic performance. Our primary
Matthews, 2007; Pietrzak, Mollica, Maruff, & Snyder, 2006) and only outcome domain includes ratings of the child's organizational skills de-
one study to date has investigated the effects of ADHD medication on fined as their ability to (a) organize their books, papers, backpacks and
organizational skills, showing modest improvements that did not nor- other materials required for school-work, and (b) keep track of sched-
malize organizational deficits (Abikoff et al., 2009). Non-pharmacologi- ules and time required for homework and other academic tasks as
cal treatments for ADHD and associated behavioral difficulties include rated by teachers and parents. Our secondary outcome includes the
parent training, classroom management, social skills training and, effects of OST on measures of inattention. Our rationale for including
more recently, computerized cognitive training. These non-pharmaco- inattention in this meta-analysis was two-fold: First, inattention was
logical interventions are helpful for reducing hyperactivity and behav- one of the main outcomes reported in the majority of studies, and sec-
ioral problems such as noncompliance but have limited impact on ond, inattention and organizational skills may be subserved by related
inattention and organizational skills deficits (Pelham & Fabiano, neurocognitive functions. Our third outcome domain examines the ef-
2008). However, a notable exception is a training program of teaching fects of OST on children's academic performance. Because different
parents and teachers the strategies to increase children's motivation raters contribute unique and complementary information about the
with incentives for performing tasks that require organizational skill child's behavior, we conducted separate analyses of parent- and teach-
(such as homework) without directly teaching organizational skills er-ratings within these three domains.
to the children (Abikoff et al., 2013). Thus, over the past decade,
organizational skills training (OST) has emerged as a category of behav- 2. Method
ioral interventions with a common focus on teaching children how to
organize both materials (e.g., contents of the child's backpack) and The protocol of methods for this meta-analysis was registered a
time (e.g., how to pace a project that is due next week) (Langberg, priori with PROSPERO (CRD42015019261).
Epstein, & Graham, 2008a).
This meta-analysis is concerned with behavioral treatments for chil- 2.1. Search strategy to identify studies
dren and adolescents focused on improving organizational skills that
are required for managing time, materials, and projects within age-ap- We searched the electronic databases of Medline (1946 to April
propriate academic and daily living tasks. We included studies conduct- Week 3 2016), PsycINFO (1967 to April Week 3 2016), and the Cochrane
ed in children and adolescents but for the sake of brevity we use the Central Register of Controlled Trials (Issue 4 of 12, April 2016), EMBASE
term children in the paper. Specific organizational skills taught during (1974 to April 2016) for relevant trials using the following search terms:
OST include homework management techniques and classroom prepa- “attention deficit and disruptive behavior disorders” or “attention defi-
rations (e.g., learning to use checklists and time planners, discarding un- cit disorder with hyperactivity”, “ADHD”, “Attention Deficit Disorder”,
necessary papers) (Abikoff et al., 2013; Langberg, Epstein, Becker, “organization*” or “academic* skill* or train*”, or “performance”, “profi-
Girio-Herrera, & Vaughn, 2012; Langberg et al., 2008a; Molina et al., ciency” or “function (-ing)”, “time management”. In addition, we
2008; Pfiffner et al., 2014). As a key component of OST programs, chil- screened relevant reviews and papers on this topic and hand-searched
dren are first taught what it means to be organized and to plan ahead. the reference lists for additional relevant publications. We also
The organizational skills are taught using behavioral techniques includ- contacted all authors of the included studies and asked if they had addi-
ing modeling, rehearsal, and contingency management. A defining fea- tional papers in press.
ture of OST programs is the focus on organizational skills, where
children and their parents learn concrete skills necessary to keep orga- 2.2. Selection of studies
nized in the context of age-appropriate academic tasks. Parents are also
involved in the treatment and their role is to prompt, praise, and reward Two authors independently evaluated the title and abstract of stud-
their child's learning and performance of specific skills with the intent to ies to determine if the inclusion criteria were fulfilled. Inclusion criteria
reinforce desirable behaviors and to promote generalization of skills to for this meta-analysis were: (1) a diagnosis of ADHD according to the
multiple contexts. Our literature search produced a number of interven- DSM edition that was current at the time of data collection; (2) random-
tions with a relative difference in emphasis on specific treatment targets ized trials with quantitative outcome measures; (3) compared a group
such as organization of materials or steps in the process of successful of patients receiving organizational skills intervention with a group in
homework completion. However, all approaches shared the overarch- a control condition (e.g., parent education, waitlist, Treatment-as-
ing goal of teaching specific skills for managing academic tasks and Usual (TAU)); (4) included at least one measure of inattention,
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 111

organizational skills, and/or academic performance; and (5) an age Measures of parent- and teacher-rated organizational skills in-
range of 5–18 years. Because studies without random assignment cluded the Children's Organizational Skills Scale (COSS) (Abikoff &
have been shown to have higher levels of bias (Sterne, Egger, & Gallagher, 2009) and the Homework Problem Checklist (HPC)-Mate-
Moher, 2008) and it is unclear at this time if inclusion of non-random- rials Management Scale (Anesko, Schoiock, Ramirez, & Levine, 1987).
ized studies reduces bias, we did not consider open trials, quasi-exper- The HPC has two subscales: (1) Homework Completion (also called
imental design studies, case studies, or single-case designs. the Inattention/Avoidance Scale) and (2) Homework Materials Man-
agement (also called Poor Productivity and Non-adherence to Rules-
2.3. Interventions included in meta-analysis Scale). We prioritized the COSS-total score, if reported. When the
COSS-Total was not reported, we used the COSS-Organized Actions
For the purpose of this meta-analysis, we searched for psychosocial subscale since it had the highest correlation of the three subscales
or behavioral interventions aimed at improving organizational skills. with the COSS total score. When the COSS was not reported, we
Organizational skills were defined broadly to include organization of used the HPC-total or HPC-Materials Management/Poor Productivity
materials (e.g., school materials that need to be brought back home), scale. The Homework performance questionnaire (HPQ) (Power
time (e.g., planning and scheduling of assignments due by the end of et al., 2015) was also included.
the week), and tasks (e.g., items needed for today's homework project). Measures of parent- and teacher-rated inattention included the Dis-
Psychosocial or behavioral treatments included activities such as teach- ruptive Behavior Disorders (DBD) Rating Scale inattention subscale
ing, modeling, and feedback to build new skills or improve performance (Pelham, Gnagy, Greenslade, & Milich, 1992), the Child Symptom Inven-
of existing skills such as organizing notes in a binder. We only included tory (CSI) inattention subscale (Gadow & Sprafkin, 1994), the Vander-
treatments delivered by humans in face-to-face interaction. However, bilt ADHD Diagnostic Parent Rating Scale inattention subscale
we acknowledge that the development of alternative methods to (Wolraich, Feurer, Hannah, Baumgaertel, & Pinnock, 1998), the HPC in-
teach organizational skills may be developed in the future including in- attention subscale (Anesko et al., 1987), and the MTA Swanson, Nolan,
structional videos, OST apps and robot-assisted interventions. We also and Pelham Questionnaire-IV (SNAP-IV) inattention subscale
included several studies of multicomponent interventions that explicit- (Swanson et al., 2001). In studies that did not provide separate inatten-
ly addressed organizational skills as the main component. However, we tion outcomes we choose to use HPC Factor I score as a proxy for inat-
did not include studies of academic interventions such as tutoring that tention because the two HPC factors have shown moderate to high
aim to improve academic skills or knowledge in specific academic correlation with the Behavior Assessment Scale for Children inattention
areas (e.g., reading or math tutoring). We also did not consider inter- subscale (BASC-I). The correlation is 0.67 between Factor I (Inattention/
ventions such as parent management training or cognitive behavioral Avoidance of homework) and parent-rated BASC-Inattention and 0.61
therapy, which are often used in children with ADHD for associated between Factor II and parent-rated BASC-Inattention (Power, Werba,
symptoms of noncompliance, because these interventions do not Watkins, Angelucci, & Eiraldi, 2006).
teach organizational skills. Measures of teacher rated academic performance included the
Academic Performance Rating Scale (APRS) (DuPaul, Rapport, &
Perriello, 1991), Classroom Performance Survey (CPS) (Brady, Evans,
2.4. Variable definition and coding Berlin, Bunford, & Kerns, 2012), or Academic Competence Evaluation
Scale (DiPema & Elliott, 2000).
Two authors extracted data from the included studies independently We found no studies that used parent-rated measures of academic
and resolved any discrepancies through resolution or a third party if performance. We have included GPA as an additional estimate of aca-
needed. The following variables were extracted: number of sessions, demic performance. Five studies provided GPA data (Evans, Schultz, &
study duration in weeks, parental inclusion in treatment procedures, DeMars, 2014; Evans, Schultz, Demars, & Davis, 2011; Langberg et al.,
format of OST (group or individual), type of control condition, sample 2012; Sibley et al., 2013; Sibley et al., 2014b; Sibley et al., 2016).
size, mean pretreatment age, mean pretreatment IQ, outcome measure
used, type of data analysis used in study (completer or intention to
treat), and risk of bias. Thus, we coded 11 variables in total. We also ex- 2.6. Effect size estimation
tracted study-level risk of bias using the Cochrane Risk of Bias method-
ology (Higgins & Altman, 2008). We estimated the difference between treatment and control groups
for primary and secondary outcomes for each study by calculating the
2.5. Outcome measures standardized mean difference effect size (ES), Hedges' g (Hedges &
Olkin, 1985). The ES estimate was calculated from the post-treatment
As noted above, the primary domains of treatment outcomes were scores and standard deviations provided in each study report, or by es-
selected a priori. The primary outcome for this review was parent- timating the standardized mean difference using the reported F- or p-
and teacher-rated organizational skills. We also examined parent- and value transformations in the Comprehensive Meta-Analysis 2 software
teacher-rated inattention as the second domain of interest and academ- program (CMA2). For studies reporting multiple measures within one
ic performance as the third domain. Parent and teacher ratings were an- of our primary or secondary outcomes, we prioritized a measure that
alyzed separately within each domain. We also averaged data on Grade had a total score of the outcome and if a total score was not available,
Point Average (GPA) across studies. To address unit of analysis issues we we used a subscale that contained items that had the strongest correla-
selected one parent and teacher measure for the domain in each study. tion to an overall measure of the outcome. When a study reported both
To reduce bias, we set an a priori hierarchy for the selection of a measure parent-reported and teacher-reported outcomes, we calculated these
from a study with multiple measures for one outcome. The hierarchy in- outcomes separately for this review.
dicated that we would prioritize a standardized measure over an un- We also used CMA2 to calculate ES for (a) five studies (Evans et al.,
standardized measure or study-derived measure and that we would 2016; Mautone et al., 2012; Pfiffner et al., 2014; Power et al., 2012;
select a measure reporting a total score over a subscale; if more than Sibley et al., 2016) that reported follow-up data for both the treatment
one measure met both of these criteria, we selected the measure that and comparison conditions, (b) outcomes from the Molina et al.
has been used most frequently in the research literature (determined (2008) and Pfiffner et al. (2007) studies that were not included in our
by comparing the number of citations for each measure in Google Schol- meta-analyses, and (c) three studies reporting observational measures
ar). When a total score was not available, we selected a subscale with of organizational skills (Langberg et al., 2008b; Sibley et al., 2013;
the highest correlation to other measures of the construct. Sibley et al., 2016).
112 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

2.7. Meta-analytic procedures (Pfiffner et al., 2007; Pfiffner et al., 2014). Six trials focused on children
in elementary school (Abikoff et al., 2013; Evans et al., 2011; Mautone et
We combined results for the studies using a random effects meta- al., 2012; Pfiffner et al., 2007; Pfiffner et al., 2014; Power et al., 2012), six
analysis with an inverse-variance weighted mean ES using the post- on middle school pupils (Evans et al., 2016; Langberg et al., 2008b;
treatment data. We conducted separate meta-analyses for parent- and Langberg et al., 2012; Molina et al., 2008; Sibley et al., 2013; Sibley et
teacher-reported organizational skills and attention. We did not con- al., 2016) and two on high school students (Evans et al., 2014; Sibley,
duct a meta-analysis on the data from the follow-up time point due to Altszuler, Morrow, & Merrill, 2014a). Most of the interventions in the
a small sample of studies that collected follow-up data and differences studies were delivered in group format and two studies conducted indi-
in the length of follow-up. A random effects model was used for the vidual interventions with one-to-one sessions (Abikoff et al., 2013;
meta-analysis because there was evidence of considerable differences Langberg et al., 2012) or a combination of both group and individual for-
between the trials (e.g., use of different treatment manuals, use of differ- mats (Evans et al., 2011; Evans et al., 2016; Langberg et al., 2008b;
ent outcome measures). We estimated heterogeneity using the Q-statis- Molina et al., 2008). The majority of studies reported high rates of ad-
tic and I2 (Heudo-Medina, Sanchez-Meca, Marin-Marinez, & Botella, herence above 80%.
2006; Higgins & Thompson, 2002), which estimates the proportion of Although all studies included organizational skills as the main or one
between-studies variance. Our final meta-analytic consideration was of the main treatment targets, there were differences among specific el-
publication bias. Publication and related biases are often a problem ements of the multicomponent OST interventions. Two OST approaches
when conducting research syntheses (Rothstein, Sutton, & Borenstein, were focused primarily on teaching organizational skills to children and
2005). A funnel plot is often used to detect publication bias, which can contained relatively few adjunctive therapeutic strategies. Thus, Abikoff
be analyzed visually; however, analysis of funnel plots with a small and colleagues (Abikoff et al., 2013; Gallagher, Abikoff, & Spira, 2014)
number of studies (i.e., b10 studies) is not recommended due to the sig- utilized a skills-building approach where organization of materials,
nificant effects additional studies might have (Sterne, Becker, & Egger, time management, and planning skills were broken down into sets of
2005; Sterne et al., 2008). Therefore, we were only able to examine steps and taught to children in a systematic manner in the format of
the presence of publication bias for one outcome, parent-rated atten- 20 individual, twice-per week sessions. Parents and teachers were in-
tion, which was done using visual analysis of a funnel plot and the formed about the skills taught to their children and trained to prompt,
Trim and Fill method (Duval & Tweedie, 2000). praise, and reward the use of these skills. A similar skills-based ap-
proach, the Homework, Organization and Planning Skills (HOPS) inter-
3. Results vention, was developed by Langberg and colleagues (Langberg, 2011;
Langberg et al., 2008b; Langberg et al., 2012) and tested as an 8-week
3.1. Study selection afterschool program. The core elements of the HOPS included using or-
ganizational checklists with operationalized criteria for binders,
We located 1071 studies in our search. Fourteen studies (Abikoff et bookbags, and lockers, and homework trackers that were initialed by
al., 2013; Evans et al., 2016; Evans et al., 2011; Evans et al., 2014; teachers and checked by the program counselors on a regular basis.
Langberg et al., 2012; Langberg et al., 2008b; Mautone et al., 2012; The key elements of the HOPS approach were utilized in a multicompo-
Molina et al., 2008; Pfiffner et al., 2014; Pfiffner et al., 2007; Power et nent intervention named the Challenging Horizons Program (CHP),
al., 2012; Sibley et al., 2014b; Sibley et al., 2016; Sibley et al., 2013) which integrated OST with educational, social, and recreational activi-
met our inclusion criteria. Table 1 shows characteristics of the 14 includ- ties at home and in school (Evans et al., 2011; Evans et al., 2014;
ed studies. Twelve studies (Abikoff et al., 2013; Evans et al., 2011; Evans Evans et al., 2016; Molina et al., 2008). In the largest study to date, the
et al., 2014; Evans et al., 2016; Langberg et al., 2008b; Langberg et al., CHP was tested as an afterschool program conducted twice per week
2012; Mautone et al., 2012; Pfiffner et al., 2014; Power et al., 2012; for 2 h and 15 min per day from September through May (Evans et al.,
Sibley et al., 2013; Sibley et al., 2014b; Sibley et al., 2016) involving 2016). The program was delivered by trained undergraduate students
1054 children (576 treatment, 478 control) contained outcome data who served as counselors and taught children how to organize their
for at least one of our primary or secondary outcomes and were includ- binders, bookbags, and lockers using specified criteria. The CHP also in-
ed in the meta-analytic syntheses. Two studies (Molina et al., 2008; cluded training children in study skills such as note taking, summariz-
Pfiffner et al., 2007) met our inclusion criteria but did not contribute ing, and writing, as well as three meetings with the parents that
data to the meta-analyses due to their reporting methods. Molina et provided information about the CHP intervention. Pfiffner and col-
al. (2008) reported the total score for the BASC-I but did not report leagues (Pfiffner et al., 2007; Pfiffner et al., 2014) developed a novel psy-
the attention problems subscale and reported percentage of passing chosocial treatment, Child Life and Attention Skills (CLAS), which
grades but not GPA. Pfiffner et al. (2007) reported combined parent- included three components: group parent training, teacher consultation
and teacher-reported measures of organizational skills and attention with daily report card, and child training in organizational skills and so-
and therefore was not included in the meta-analysis because we ana- cial skills. The program combined teaching organizational skills to chil-
lyzed our data separately based on parent or teacher report. Table 2 dren directly with a coordinated system of rewards for behavior change
shows the outcome measures and the results for the 12 studies included across school and home settings. The CLAS program also included use of
in the meta-analyses and the two studies included in the qualitative re- instructional scaffolding, prompts, and guidance in task completion to
view but not in the meta-analyses. address executive dysfunction of the inattentive type of ADHD such as
A PRISMA (Moher, Liberati, Tetzlaff, & Altman, 2009) flow diagram sluggishness and alertness problems (McBurnett, Pfiffner, & Frick,
of study selection is shown in Fig. 1. 2001). Power and colleagues (Mautone et al., 2012; Power et al.,
2012) developed a program, Family-School Success (FSS), focused on
3.2. Description of studies promoting family involvement in education and promoting collabora-
tive family-school problem solving. Children were taught organizational
The majority of the 14 selected studies included children with both skills such as time management for homework completion and estab-
combined and inattentive ADHD subtypes (Abikoff et al., 2013; Evans lishing homework routines, although no direct training in material
et al., 2014; Evans et al., 2016; Langberg et al., 2008b; Langberg et al., management was provided. Consistent with the FSS emphasis on par-
2012; Molina et al., 2008; Power et al., 2012; Sibley et al., 2013; Sibley enting, a recent study reported that improvements in inattention after
et al., 2014b; Sibley et al., 2016). Only two studies included all three FSS were mediated by reduction in negative parenting practices
ADHD subtypes (Evans et al., 2011; Mautone et al., 2012), while one (Booster, Mautone, Nissley-Tsiopinis, Van Dyke, & Power, 2016). Sibley
group of researchers focused exclusively on the inattentive subtype and colleagues (Sibley et al., 2013; Sibley et al., 2014b; Sibley et al.,
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 113

Table 1
Clinical trials of organizational skills training for children and adolescents with ADHD.

Study Participants n; age; Number of sessions and format Treatment duration Location
%boys; %medication (group vs. individual) (weeks)

Mautone et al. (2012) n = 61 6 parent group meetings + 6 child group 12 Clinic + 2 sessions
Age: kindergarten and first gradea sessions + 4 individualized family therapy at school
% boys: 57 (3 for parents and child; 1 for parents
only) + 2 family-school consultations
% on medication: 25
Abikoff et al. (2013) n = 97 20 child individual sessions (including 10 to 12 Clinic
Age range 8–11 the parent some of the time)
% boys: 64
% on medication: 36
Pfiffner et al. (2007) n = 69 12–15 child group + 12–15 parent group 12 School
Age range 7–11 sessions + 5 family sessions with teacher
% boys: 66%;
Elementary
% on medication: 2.9%
school
Pfiffner et al. (2014) n = 125 10 child group sessions + 10 parent group 10 to 13 Both
Age range 7 to 11 sessions + 5 family-teacher sessions
% boys: 55
% on medication: 5.7
Power et al. (2012) n = 199 6 parent group sessions, 6 child group 12 Clinic
Age: grades 2–6c sessions + 4 family sessions +
% boys: 68% 2 family-teacher sessions
% on medication 42.5
Evans et al. (2011) n = 49 40 child individual and child group 20 Both
Mean age:11(10−13) sessions + 3 family sessions
% boys: 71
% on medication: 67
Langberg et al. (2008b) n = 37 16 child individual and group 8 School
Age range 9–14 sessions + 2 parent group sessions
% boys: 83
% on medication: 43
Langberg et al. (2012) n = 47 16 child individual + 2 parent 11 School
Age range 11–14 group sessions
% boys: 76
% on medication: 69
Sibley et al. (2013) n = 36 8–11 family sessions + 4 parent group 6 Clinic
Age range: 11–15 sessions + 1 family-teacher session
% boys 72
% on medication: 38.9%
Middle school
Evans et al. (2016) n = 216 53 sessions child group and individual 32 School
Mean age: 12.1 sessions offered (31.9 average attended) + 3
% boys: 74 parent meetings
% on medication: 44.6
Molina et al. (2008) n = 23 20 child individual and group sessions + 3 10 School
Age: grade 6–8b parent group sessions
% boys: 75%
% on medication: 43%
Sibley et al. (2016) n = 128 10 family sessions with parent and child + 4 10 Clinic
Mean age: 12.7 (11–15) parent group sessions
% boys: 65
% on medication: 34.4%
Evans et al. (2014) n = 36 10 child group + 10 parent group + 27 child 26 School
Mean age: 15 (13–17) individual sessions
% boys: 83
% on medication: 50
High school
Sibley et al. (2014b) n = 23 8 child and 8 parent group sessions 8 Clinice
Age: grades 9–12d (some of the time together)
% boys 70
% on medication: 60.9%

Note: The age was not reported in many studies, but only grades.
a
Corresponds to age 5–6.
b
Corresponds to age 12–14.
c
Corresponds to age 7–12.
d
Corresponds to age 15–18.
e
Personal communication with Dr. Sibley.

2016) developed an OST treatment for adolescents, Supporting 3.3. Risk of bias
Teens'Autonomy Daily (STAND), which enhanced standard OST tech-
niques with motivational interviewing to address motivational prob- We assessed study level risk of bias using the Cochrane Risk of Bias
lems common in ADHD that tend to increase in adolescence (Toplak, tool (Higgins & Altman, 2008). As shown in Supplemental Fig. 1, there
Jain, & Tannock, 2005). Another distinctive characteristic of the STAND was high risk of bias for performance bias (i.e., blinding of participants
approach is that the treatment is conducted in the format of family ther- and personnel) and detection bias (blinding of outcome assessment).
apy attended by parent and teen (Sibley, 2016; Sibley et al., 2016). These high risks of bias are not uncommon in psychosocial
114 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

Table 2
Differences between treatment and comparison groups at post-treatment and follow-up.

Study Sample size Control Intent to Measures Differences between groups at post-treatment
condition treat and follow-up, where applicable

Mautone et al. n = 61; (t = 29, Parent Yes (a) Parent-rated attention – MTA Swanson, Nolan, and (a) g = 0.42 (95% CI −0.18 to 1.02),
(2012)a c = 32) education Pelham Questionnaire-IV - Inattention scale; (b) 2-month follow-up – g = 0.28 (95% CI −0.33 to
teacher-rated attention – MTA Swanson, Nolan, and Pelham 0.89)
Questionnaire-IV - Inattention scale; (c) teacher-rated (b) g = 0.33 (95% CI −0.23 to 0.89),
academics – Academic Competence Evaluation Scales – 2-month follow-up – g = 0.33 (95% CI −0.26 to
Academic enablers scale. 0.92)
(c) g = 0.50 (95% CI −0.07 to 1.07),
2-month follow-up – g = 0.23 (95% CI −0.37 to
0.83)
Abikoff et al. n = 97; (t = 64, Waitlist Yes (a) Parent-rated organizational skills – Children's (a) g = 2.00 (95% CI 1.50 to 2.50)
(2013)a c = 33)b control Organizational Skills Scale – Total score; (b) teacher-rated (b) g = 1.04 (95% CI 0.59 to 1.48)
organizational skills – Children's Organizational Skills Scale – (c) g = 0.74 (95% CI 0.31 to 1.17)
Total score; (c) teacher-rated academics – Academic
Performance Rating Scale
Pfiffner et al. n = 69; (t = 36, No treatment Yes (a) Organizational skills – Children's Organizational Skills Scale (a) g = 0.20 (95% CI −0.42 to 0.82),
(2007) c = 33) control – Total score (reported as mean across parents and teachers); follow-up – g = −0.29 (95% CI −0.82 to 0.24)
(b) attention – Child Symptoms Inventory – Inattention scale (b) g = 0.91 (95% CI 0.40 to 1.41),
(reported as mean across parents and teachers) follow-up – g = 0.53 (95% CI −0.01 to 1.09)
Pfiffner et al. n = 125, Treatment as Not (a) Parent-rated organizational skills – Children's (a) g = 0.88 (95% CI 0.49 to 1.26),
(2014)a (t = 74, c = 51)c usual reported Organizational Skills Scale – Total; (b) teacher-rated 6-month follow-up – g = 0.56 (95% CI 0.18 to
organizational skills – Children's Organizational Skills Scale – 0.93)
Total; (c) parent-rated attention – Child Symptoms Inventory (b) g = 0.66 (95% CI 0.29 to 1.04),
– Inattention scale; (d) teacher-rated attention – Child 6-month follow-up – g = 0.18 (95% CI −0.19 to
Symptoms Inventory – Inattention scale 0.54)
(c) g = 0.72 (95% CI 0.34 to 1.09),
6-month follow-up – g = 0.72 (95% CI 0.34 to
1.09)
(d) g = 0.79 (95% CI 0.41 to 1.16),
6-month follow-up – g = 0.16 (95% CI −0.20 to
0.52)
Power et al. n = 199; Parent Yes (a) Parent-rated organizational skills – Homework Problems (a) g = 0.20 (95% CI −0.10 to 0.49)
(2012)a (t = 100, education Checklist – Poor productivity factord; (b) teacher-rated 3-month follow-up – g = 0.19 (95% CI −0.12 to
c = 99) organizational skills; Homework Performance Questionnaire 0.49)
– Teacher version; (c) parent-rated attention – Homework (b) g = 0.26 (95% CI −0.03 to 0.55),
Problems Checklist - Homework completion scaled; (d) 3-month follow-up – g = 0.32 (95% CI 0.02 to
teacher-rated academics – Academic Performance Rating 0.63)
Scale – Academic productivity (c) g = 0.63 (95% CI 0.33 to 0.93),
3-month follow-up – g = 0.11 (95% CI −0.18 to
0.41)
(d) g = 0.18 (95% CI −0.11 to 0.47),
3-month follow-up – g = 0.21 (95% CI −0.09 to
0.51)
Evans et al. n = 49; (t = 31, Community Not (a) Parent-rated attention – Disruptive Behavior Disorders (a) g = 0.08 (95% CI −0.49 to 0.66)
(2011)a c = 18) control reported Rating Scale - Inattention scale; (b) teacher-rated attention – (b) g = −0.04 (95% CI −0.62 to 0.53)
Disruptive Behavior Disorders Rating Scale - Inattention scale; (c) g = 0.09 (95% CI −0.48 to 0.66)
(c) teacher-rated academics – Classroom Performance (d) g = 0.28 (95% CI −0.30 to 0.85)
Survey; (d) GPA - 2nd semester grades
Langberg et al. n = 37; (t = 24, Waitlist Not (a) Parent-rated organizational skills – Homework Problems (a) g = 0.85 (95% CI 0.16 to 1.54)
(2008a, b)a c = 13) control reported Checklist – Noncompliance scaled; (b) parent-rated attention (b) g = 0.48 (95% CI −0.19 to 1.15)
– Homework Problems Checklist – Inattention/avoidance (c) g = 0.27 (95% CI −0.39 to 0.93)
scaled; (c) teacher-rated academics – Academic Performance
Rating Scale – Total score
Langberg et al. n = 47; (t = 23, Waitlist Not (a) Parent-rated organizational skills – Children's (a) g = 0.94 (95% CI 0.35 to 1.54)
(2012)a c = 24) control reported Organizational Skills Scale – Total score (b) teacher-rated (b) g = 0.19 (95% CI −0.38 to 0.75)
organizational skills – Children's Organizational Skills Scale – (c) g = 0.51 (95% CI −0.06 to 1.08)
Total score; (c) parent-rated attention – Vanderbilt ADHD (d) g = 0.64 (95% CI 0.07 to 1.22)
Diagnostic Parent Rating Scale – Inattention scale; (d) GPA
Sibley et al. n = 36, (t = 18, Treatment as Not (a) Parent-rated attention – Disruptive Behavior Disorders (a) g = 1.02 (95% CI 0.34 to 1.70)
(2013)a c = 18) usual reported Rating Scale – Inattention scale; (b) teacher-rated attention – (b) g = 0.21 (95% CI −0.56 to 0.98)
Disruptive Behavior Disorders Rating Scale – Inattention (c) g = −0.26 (95% CI −1.03 to 0.51)
scale; (c) GPA
Evans et al. n = 216; Community Yes (a) Parent-rated organizational skills – Children's (a) g = 0.27 (95% CI 0.003 to 0.54),
(2016)a (t = 112, control Organizational Skills Scale - Organized actions; (b) 6-month follow-up - g = 0.20 (95% CI −0.06 to
c = 104) parent-rated attention - Disruptive Behavior Disorders Rating 0.47)
Scale - Inattention scale; (c) teacher-rated attention – (b) g = 0.37 (95% CI 0.11 to 0.64),
Disruptive Behavior Disorders Rating Scale - Inattention scale; 6-month follow-up - g = 0.48 (95% CI 0.21 to
(d) teacher-rated academics – Classroom Performance Survey 0.75)
– Academic factor (c) g = 0.17 (95% CI −0.10 to 0.44),
6-month follow-up - g = 0.10 (95% CI −0.17 to
0.37)
(d) g = 0.20 (95% CI −0.07 to 0.47),
6-month follow-up - g = 0.09 (95% CI −0.18 to
0.36)
Molina et al. n = 23; (t = 11, Treatment as Not (a) Percentage of passing grades (a) g = 0.58 (95% CI −0.24 to 1.41)
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 115

Table 2 (continued)

Study Sample size Control Intent to Measures Differences between groups at post-treatment
condition treat and follow-up, where applicable

(2008) c = 12) usual reported


Sibley et al. n = 128 Treatment as Yes (a) Parent-rated attention – Disruptive Behavior Disorders (a) g = 0.96 (95% CI 0.59 to 1.32),
(2016)a (t = 67, c = 61) usual Rating Scale – Inattention scale; (b) teacher-rated attention – 6-month follow-up – g = 0.80 (95% CI 0.41 to
Disruptive Behavior Disorders Rating Scale – Inattention 1.20)
scale; (c) GPA – cumulative GPA (b) g = 0.05 (95% CI −0.29 to 0.40),
6-month follow-up – g = 0.02 (95% CI −0.36 to
0.40)
(c) g = 0.22 (95% CI −0.13 to 0.57),
6-month follow-up – g = 0.14 (95% CI −0.25 to
0.52)
Evans et al. n = 36; (t = 24, Community Yes (a) Parent-rated attention – Disruptive Behavior Disorders (a) g = 0.09 (95% CI −0.59 to 0.77)
(2014)a c = 12) control Rating Scale – Inattention scale; (b) teacher-rated academics (b) g = 0.70 (95% CI 0.002 to 1.40)
– Classroom Performance Survey – Academic performance (c) g = 0.22 (95% CI −0.46 to 0.90)
scale; (c) GPA
Sibley et al. n = 23 Treatment as Not (a) GPA - quizzes and tests (a) g = 0.60 (95% CI −0.05 to 1.25)
(2014a, b)a (t = 10,c = 13) usual reported

References for measures: Academic Competence Evaluation Scales (DiPema & Elliott, 2000); Academic Performance Rating Scale (DuPaul et al., 1991); Classroom Performance Survey
(Brady et al., 2012); Child Symptom Inventory (Gadow & Sprafkin, 1994); Children's Organizational Skills Scale (Abikoff & Gallagher, 2009); Disruptive Behavior Disorders Rating Scale
(Pelham et al., 1992); Homework Performance Questionnaire (HPQ) (Power et al., 2015) Homework Problem Checklist (Anesko et al., 1987); Vanderbilt ADHD Diagnostic Parent Rating
Scale (Wolraich et al., 1998); MTA Swanson, Nolan, and Pelham Questionnaire-IV (Swanson et al., 2001).
a
Study included in meta-analyses.
b
Data from the organizational skills training group used for treatment; data from performance-based intervention excluded from this review.
c
Data from the Child Life and Attention Skills group used for treatment; data from parent–focused treatment excluded from this review.
d
The HPC has two subscales that are referred to differently across studies: (1) Homework Completion (also called the I-Inattention/Avoidance scale) and (2) HPC Materials Manage-
ment (also called NA-Non adherence to rules-scale or the poor productivity scale).

interventions, and it is not clear if they were responsible for systematic 3.4. Meta-analytic results
differences that would over- or under-inflate estimates of the effects of
the intervention. Risk of bias for each study is shown in Supplemental 3.4.1. Teacher-reported organizational skills
Fig. 2. Four studies involving 445 children with ADHD (247 treatment, 198
comparison) comparing organizational skills intervention to control or
treatment-as-usual with teacher-reported organizational skills were lo-
cated (Abikoff et al., 2013; Langberg et al., 2012; Pfiffner et al., 2014;
Power et al., 2012). Fig. 2 shows the effect of OST on teacher-reported
organizational skills as measured by the COSS (k = 3) or the HPC-Teach-
er (k = 1). As shown in Fig. 2, OST was superior to the comparison con-
ditions for teacher-reported organizational skills (k = 4; g = 0.54; 95%
CI 0.17 to 0.91; z = 2.86; p = 0.004). We found moderate heterogeneity
(Q(3) = 10.15, p = 0.02; I2 = 70%); however, due to the small sample of
studies included in the meta-analysis, we deemed moderator analyses
inappropriate and were not able to examine the presence of publication
bias.

3.4.2. Parent-reported organizational skills


Six studies involving 697 children with ADHD (384 treatment, 313
comparison) comparing organizational skills intervention to control or
treatment-as-usual with parent-reported organizational skills were lo-
cated (Abikoff et al., 2013; Evans et al., 2016; Langberg et al., 2008b;
Langberg et al., 2012; Pfiffner et al., 2014; Power et al., 2012). Fig. 2
shows the effect of OST on parent-reported organizational skills as mea-
sured by the COSS (k = 4) or the HPC-Materials Management scale
(k = 2). As shown in Fig. 2, OST was superior to the comparison condi-
tions for parent-reported organizational skills (k = 6; g = 0.83; 95% CI
0.32 to 1.34; z = 3.22; p = 0.001). We found significant heterogeneity
(Q(5) = 46.77, p b 0.001; I2 = 89%); however, due to the small sample
of studies included in the meta-analysis, we deemed moderator analy-
ses inappropriate.

3.4.3. Teacher-reported inattention


Six studies involving 590 children with ADHD (320 treatment, 270
comparison) comparing organizational skills intervention to control or
treatment-as-usual with teacher-reported attention were located
Fig. 1. PRISMA flow diagram of study selection. (Evans et al., 2011; Evans et al., 2016; Mautone et al., 2012; Pfiffner et
116 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

Fig. 2. Forest plot of parent-rated organizational skills (top panel) and teacher-rated organizational skills (bottom panel). Description: Results of the meta-analysis for parent and teacher
reported organizational skills.

al., 2014; Sibley et al., 2013; Sibley et al., 2016). Fig. 3 shows the effect of (Q(9) = 13.88, p = 0.13; I2 = 35%); however, due to the small sam-
OST on teacher-reported attention as measured by the DBD-Inattention ple of studies included in the meta-analysis, we deemed moderator
subscale (k = 4), the SNAP-Inattention scale (k = 1), or the CSI-Inatten- analyses inappropriate. Because there were ten studies reporting
tion scale (k = 1). As shown in Fig. 3, OST was statistically superior to parent-rated attention, we were able to examine the presence of
the comparison conditions for teacher-reported attention (k = 6; g = publication bias. Visual analysis of a funnel plot (shown in Supple-
0.26; 95% CI 0.01 to 0.52; z = 2.00; p = 0.045). We found moderate het- mental Fig. 3) and the Trim and Fill method suggest there are two
erogeneity (Q(5) = 10.62, p = 0.06; I2 = 53%); however, due to the “missing” studies to the right of the weighted mean ES, indicating
small sample of studies included in the meta-analysis, we deemed mod- the possibility that the point estimate we obtained is lower than
erator analyses inappropriate and were not able to examine the pres- the “true” ES.
ence of publication bias.

3.4.4. Parent-reported inattention 3.4.5. Teacher-rated academic performance


Ten studies involving 893 children with ADHD (478 treatment, Seven studies involving 663 children with ADHD (364 treatment,
415 comparison) comparing organizational skills intervention to 299 comparison) comparing organizational skills intervention to con-
control or treatment as usual with parent-reported attention were trol or treatment as usual with teacher-rated academic performance
located (Evans et al., 2011; Evans et al., 2014; Evans et al., 2016; were located (Abikoff et al., 2013; Evans et al., 2011; Evans et al.,
Langberg et al., 2008b; Langberg et al., 2012; Mautone et al., 2012; 2014; Evans et al., 2016; Langberg et al., 2008b; Mautone et al., 2012;
Pfiffner et al., 2014; Power et al., 2012; Sibley et al., 2013; Sibley et Power et al., 2012). Fig. 4 shows the effect of OST on teacher-rated aca-
al., 2016). Fig. 3 shows the effect of OST on parent-reported atten- demic behaviors as measured by the Academic Performance Rating
tion as measured by the DBD-Inattention subscale (k = 5), HPC-In- Scale (k = 3), the Classroom Performance Survey (k = 3), and the Aca-
attention subscale (k = 2), the CSI-Inattention scale (k = 1), the demic Competence Evaluations Scale (k = 1). As shown in Fig. 4, OST
Vanderbilt ADHD Diagnostic Parent Rating Scale-Inattention sub- was statistically superior to the comparison conditions for teacher-re-
scale (k = 1), and the SNAP-Inattention subscale (k = 1). As ported academic performance (k = 7; g = 0.33; 95% CI 0.14 to 0.51;
shown in Fig. 3, OST was superior to the comparison conditions for z = 3.48; p b 0.001). We found low levels of heterogeneity (Q(6) =
parent-reported attention (k = 10; g = 0.56; 95% CI 0.38 to 0.74; 7.50, p = 0.28; I2 = 20%). Due to the small sample of studies, we were
z = 6.11; p b 0.001). We found moderate levels of heterogeneity not able to examine the presence of publication bias.
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 117

Fig. 3. Forest plot of parent-rated attention (top panel) and teacher-rated attention (bottom panel).

3.4.6. Student's Grade Point Average (GPA) al., 2014; Langberg et al., 2012; Sibley et al., 2013; Sibley et al., 2014b;
Six studies involving 322 children with ADHD (179 treatment, 143 Sibley et al., 2016). Fig. 5 shows the effect of OST on GPA. As shown in
comparison) comparing organizational skills intervention to control or Fig. 5, the GPA of students in the OST group was statistically superior
treatment as usual with GPA were located (Evans et al., 2011; Evans et to the comparison conditions (k = 6; g = 0.29; 95% CI 0.07 to 0.51;

Fig. 4. Forest plot of teacher-rated academic performance.


118 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

Fig. 5. Forest plot of student GPA.

z = 2.61; p = 0.009). We found low levels of heterogeneity (Q(5) = when assessed by teacher-rated (g = 0.54) and parent-rated (g =
4.48, p = 0.48; I2 = 0%). Due to the small sample of studies, we were 0.83) measures, and for inattention outcomes for children when
not able to examine the presence of publication bias. assessed by parent-rated measures (g = 0.56). The effects for teacher-
rated inattention and academic performance, and student's GPA were
3.4.7. Outcomes not included in meta-analyses statistically significant, although smaller in magnitude: g = 0.26, g =
Data from the Molina et al. (2008) study and the Pfiffner et al. (2007) 0.33, and g = 0.29, respectively. It is likely that the magnitude of ES
study were not included in the meta-analyses due to issues of compara- was related to differences among the studies in terms of specific fea-
bility of data and combined parent/teacher data, respectively. However, tures of OST treatments, outcome measures, informants, and control
we calculated ES for these studies using the same g statistic for qualita- conditions. A relatively small number of studies available for this
tive comparison. As shown in Table 2, Molina did not find a statistically meta-analysis did not allow us to investigate potential mediator vari-
significant effect of OST on the percentage of passing grades (g = 0.58, ables of treatment effects. Thus, we discuss possible differences among
95% CI −0.24 to 1.41). Pfiffner et al. (2007) showed mixed results; there the studies that might have contributed to the differences in magnitude
was a statistically significant effect for the combined rating of children's of the observed ES.
attention (g = 0.91, 95% CI 0.40 to 1.41) but not for the combined rating The ES were the highest for the domain of parent-rated organiza-
of children's organizational skills (g = 0.20, 95% CI −0.42 to 0.68). Note, tional skills. Four of six studies (Abikoff et al., 2013; Langberg et al.,
while the difference between post-treatment means for the treatment 2008b; Langberg et al., 2012; Pfiffner et al., 2014) reported large ES
and control groups was not statistically significant, the authors did re- (range g = 0.85 to 2.00). It is possible that the smaller ES reported by
port a significant time by group's effect using ANOVA. Evans et al. (2016) and Power et al. (2012), g = 0.20 and g = 0.27, re-
Three studies (Langberg et al., 2008b; Sibley et al., 2013; Sibley et al., spectively, were due to a sole focus on organizational skills required
2016) reported data using behavioral observation of organizational for homework (e.g., using a homework checklist) while organizational
skills. Two studies (Sibley et al., 2013; Sibley et al., 2016) had research skills in the home were not directly targeted during the intervention.
assistants evaluate student's organization skills using the Organization The duration of treatment in the Power et al. (2012) study was also rel-
Checklist (Evans et al., 2009). In their 2013 study, Sibley et al. found atively short: 12 sessions versus 16 to 20 sessions in other studies. The
the treatment group had statistically significant better organizational aspect of duration of OST was not addressed in this meta-analysis or
skills than the control group after treatment (g = 1.04, 95% CI 0.36 to in the included individual randomized controlled trials, but future stud-
1.73). However, they did not find a statistically significant difference be- ies might test the effects of treatment duration/intensity on the out-
tween treatment and control groups in their 2016 study (g = 0.33, 95% comes. Most importantly, the Power et al. (2012) and Mautone et al.
CI − 0.04 to 0.69). Langberg et al. (2008b) reported an immediate in- (2012) studies compared OST to an active control condition, “Coping
crease in binder, bookbag and locker organization after the second day with ADHD through Relationships and Education” (CARE). The 12-ses-
of the program; a statistical comparison between treatment and control sion CARE program provided support and education to parents includ-
groups for this measure was not reported in this study. ing: (a) discussing children's progress at home and school, (b)
establishing a context within which parents can support each other in
4. Discussion coping with their children's difficulties, and (c) providing education to
parents about ADHD. The ES might be smaller because the CARE con-
The aim of this study was to quantitatively review all available ran- trolled for treatment factors such as attention from the therapists and
domized controlled trials of OST. To the best of our knowledge, this is education about ADHD.
the first study to employ a quantitative review of organizational skills There was greater heterogeneity in ES in the domain of the teacher
interventions for children with ADHD. We located 14 randomized con- ratings of organizational skills, ranging from large (Abikoff et al.,
trolled studies of OST that met our inclusion criteria. Twelve studies in- 2013) to moderate (Pfiffner et al., 2014) and small (Langberg et al.,
volving 1054 children (576 treatment, 478 control) provided data that 2012; Power et al., 2012). OST interventions in the studies with large
was included in the quantitative syntheses (i.e., meta-analyses). and moderate ES (Abikoff et al., 2013; Pfiffner et al., 2014) consisted
We evaluated outcomes in three domains of interest: (a) organiza- of approximately 20 sessions and had more extensive teacher compo-
tional skills (parent- and teacher-rated), (b) inattention (parent-and nents than in the interventions in the Langberg et al. (2012) and
teacher-rated), and (c) academics (teacher-rated academic perfor- Power et al. (2012) studies, which might explain the differences in ES
mance and student's GPA). Results showed significant effects of OST across studies. However, all OST packages can be viewed as multi-
across all outcomes. Overall, significant effects of large to moderate component interventions and the difference in relative contributions
magnitude were found for organizational skills outcomes for children of child-, parent- and teacher-focused components to the overall ES
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 119

cannot be discerned from the existing studies. Future studies can utilize fails to finish schoolwork and chores, often has difficulty organizing
dismantling designs to evaluate relative effects of the unique compo- tasks and activities, often loses things, and often forgetful in daily
nents and techniques that comprise multi-componential OST interven- activities) describe organizational behavior, which make it difficult to
tions. Furthermore, organizational skills are complex behaviors and not separate change in ADHD symptoms of inattention from change in
unitary skills. It is unknown how the OST interventions affect specific organizational skills ratings. This overlap in symptoms of inattention
subsets of organizational skills as very few studies reported specific sub- and organizational skill can also contribute to high levels of correlations
scales and including subscales in meta-analyses is methodologically between parent and teacher ratings of these constructs. For example,
challenging. the correlations of the total scale COSS score with the inattention sub-
The ES of parent-reported improvement in attention was moderate scale of the Conners were 0.66 and 0.67 for the parent and teacher rat-
while the ES of teacher-reported gain in attention was small. The ES ings, respectively (Abikoff & Gallagher, 2009). To examine if and how
for parent-rated attention were highly heterogenic across studies rang- the OST affects symptoms of inattention, future OST studies can report
ing from minimal (g = 0.08) to large (g = 1.02). The majority of studies change in the four inattention symptoms that overlap with organiza-
that used waitlist control conditions found moderate to large effects of tional behavior separately from change in the five inattention symp-
OST on inattention symptoms. In contrast, two studies that compared toms without such overlap.
OST to a community control condition (Evans et al., 2011; Evans et al., We found that OST had a modest ES in the area of academic perfor-
2014) reported small effects. In these studies families received a packet mance. Although relatively small in magnitude, this ES was statistically
of contact information for providers in their local community and a significant. Given the correlation between academic performance and
summary of the intake evaluation was sent to the school psychologists organizational abilities (Langberg et al., 2011a; Langberg et al., 2011b),
at their respective schools. However, it is unknown how many partici- this finding suggests that organizational skills interventions can benefit
pants in the control group initiated treatment during the intervention. academic performance for children with ADHD. The small ES are diffi-
Three of the six studies that reported teacher-rated outcomes of in- cult to detect in clinical trials of behavioral interventions even with sam-
attention also incorporated school personnel directly or indirectly into ples that would be considered large in our field (e.g., N 200 subjects).
the OST treatment process. Thus, in the “Challenging Horizons Program” Nevertheless, even a small improvement in academic performance can
(Evans et al., 2011), undergraduate counselors communicated with the be clinically meaningful and practically important for children in gener-
teachers on a biweekly basis about students' progress and behavior in al and for children with ADHD in particular. By aggregating results
classroom. The “Supporting Teens' Academic Needs” program (Sibley across studies, meta-analyses can estimate the magnitude of ES and
et al., 2013), included one school consultation and parents were taught confirm statistical significance of smaller effects of active treatments
how to be more involved with the schools and engage teachers. Despite versus control conditions, thus informing the field of evidence-based
these teacher-directed portions of the OST, the teacher-report did not practice in ways that are complementary to the information provided
reveal significant improvements in ADHD symptoms (while parent-re- by the randomized controlled trials.
ports did). It is possible that improvements in attention noted by the
parents were not potent enough to manifest in the classroom or be sa- 4.1. Differences across studies
lient to the teachers. However, it is worth commenting that one study
that reported the largest effect on the teacher-rated attention (Pfiffner There were also differences among treatments that might have
et al., 2014) (g = 0.79) also included a comprehensive training compo- contributed to heterogeneity of ES. Although a small number of individ-
nent for teachers. Specifically, teachers were taught to scaffold and sup- ual studies precluded analyses of treatment characteristic as possible
port attention toward classroom goals, implement a school-home mediators of treatment response, several key treatment variables can
report card, and promote the generalization of skills across classes. be considered in future studies. As noted above, OST aims to improve
Discrepancies between parent- and teacher-ratings of inattention organizational skills by defining criteria for organizing time and
may be also due to the difference in their involvement in the interven- materials and setting realistic goals for staying organized. However,
tions. A noteworthy bias in clinical trials of behavioral interventions is the OST approaches varied across the studies in terms of the specific
that the outcome measures are not blinded for participants (children treatment contents, the number and duration of sessions, the session
and parents) because participants know that they are receiving treat- format (individual vs. group), and the extent of teacher and parent
ment. In OST, parents are active participants of the treatment and there- involvements.
fore they may be biased to report larger improvement on parent-rated Parents played an important role in most of the trials as they were
questionnaires (although, as noted above, some OST interventions also asked to reinforce the targeted organizational skills at home. For the
included teacher components). This limitation can be addressed in fu- twelve studies included in the meta-analysis, a parent component was
ture studies by including additional outcomes such as naturalistic obser- incorporated in different forms including: the parents joining their
vation of organizational skills and behaviors at school and at home, child at the end of the session to review behavioral techniques such as
report cards, or academic tests. Three trials in this meta-analysis prompting, praise, and rewards (Abikoff et al., 2013; Langberg et al.,
(Langberg et al., 2012; Sibley et al., 2013; Sibley et al., 2016) have 2012); individualized parent sessions that addressed parenting skills
used objective outcomes such as planner use and materials organization (Evans et al., 2014; Pfiffner et al., 2014); elements of family therapy
checklists rated by research assistants. Of note, while observational (Power et al., 2012); group parent sessions to discuss common behav-
measures may reduce the rater bias, they are harder to standardize ioral strategies such as positive reinforcement of expected behavior
and costlier to administer, which limits application of these measures (Langberg et al., 2008b; Sibley et al., 2013); and family sessions with
in clinical trials. the parent and child together that address problem solving (Evans et
Furthermore, parent and teacher ratings are only weakly correlated al., 2011; Evans et al., 2014; Sibley et al., 2013). Clearly, parent compo-
for inattention symptoms and moderately correlated for hyperactivity/ nents are important in any child-focused behavioral interventions but
impulsivity symptoms (Narad et al., 2015). Parents report greater sever- the exact nature of the amount and content of parenting component
ity of ADHD symptoms than teachers, but the magnitude of parent- in OST cannot be easily identified from the existing studies. Similarly,
teacher agreement does not vary across development (Narad et al., teacher involvement and school components varied across studies and
2015). Due to the difference in parent- and teacher-ratings of ADHD, ranged from one consultation with the teacher, to facilitating the par-
we opted to analyze the parent and teacher ratings separately in this ent-teacher meeting, to direct training of the teacher in prompting
study. and rewarding children's organizational skills during classes. It is likely
Another consideration for the assessment of treatment outcomes in that teacher components are easier to incorporate in OST treatments
OST studies is that four of nine DSM inattention symptoms (i.e., often conducted in schools and parent components are more feasible when
120 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

OST is conducted in outpatient mental health settings. Table 1 shows hyperactivity, and conduct problems. We also could not include the
that six studies were conducted in school, five in clinics and three in Pfiffner et al. (2007) study because the outcomes were averaged across
both clinics and schools. teacher and parent ratings and we were interested in evaluating ES
Another notable difference among the studies was the inclusion separately for the parent and teacher ratings. These two studies can be
criteria. Only two studies required organizational deficits as an inclusion included in future meta-analyses that may focus on other outcome
criterion (Abikoff et al., 2013; Power et al., 2012). Most studies used ac- domains.
ademic impairment for inclusion (Evans et al., 2011; Evans et al., 2014; Regarding durability of OST treatment effects, five studies provided
Evans et al., 2016; Sibley et al., 2016) and some also used social impair- follow-up data in a range from one to six months after treatment.
ments (Evans et al., 2011; Evans et al., 2014; Evans et al., 2016). This is Three studies reported significant differences in parent-reported
an important consideration for OST as not all children with ADHD inattention at 6 month follow-up in almost moderate (g = 0.48)
have organizational deficits. Including children without organizational (Evans et al., 2016), moderate g = 0.72 (Pfiffner et al., 2014) and large
skills deficits into the studies might cause a ceiling effect where no fur- ES g = 0.80 (Sibley et al., 2016). Parent-rated organizational skills
ther improvement might be possible. Future studies of OST may consid- were significant (g = 0.56) at the 6-months follow-up in one study
er a priori inclusion criteria for organizational skills to assure that the (Pfiffner et al., 2014). Teacher-rated organizational skills were signifi-
intervention is well-matched to the treatment needs of the study partic- cant (g = 0.32) at the 3-month follow-up in another study (Power
ipants. Age and developmental characteristic of OST participants is an- et al., 2012). These results suggest that OST treatment gains are robust,
other important consideration for future research as the number of at least in the short term.
available studies precluded examination of participant characteristics
in this meta-analysis. Most OST studies included children 8 years of 4.2. Limitations
age and older, with the exception of Mautone et al. (2012), who studied
children in kindergarten and first grade. Some OST interventions de- Our review also revealed several limitations of the randomized
scribed in the meta-analysis (Abikoff et al., 2013; Pfiffner et al., 2007; controlled studies of OST, most notably lack of consistency in outcome
Pfiffner et al., 2014; Power et al., 2012) were developed for elementary assessments and failure to use independent or “blinded” outcome
school students, while others (Evans et al., 2014; Evans et al., 2016; assessment. This underscores a need for outcome measures with strong
Langberg et al., 2012; Sibley et al., 2014b; Sibley et al., 2016) were devel- psychometric properties and clinical utility in the area of testing organi-
oped for middle school students. These treatments differ from each zational skills interventions. One point to convey is that all outcome
other because they address organizational skills required for age appro- measures (i.e., parent ratings, teacher ratings, observations, or grades)
priate academic tasks. are likely to have their unique strength and limitations. We note that
Given that impairments in attention and organizational skill increase parent and teacher ratings in clinical trials of behavioral interventions
in severity with age, due to the increase in academic demands and are not blinded and can be affected by expectation biases, but this
decrease in adult supervision, clinical judgment suggests that earlier does not mean that they are “inferior” to observational measures.
interventions may promote the acquisition of skills and avert future Counting items in the backpack or number of turned-in homework as-
problems. However, behavioral interventions for young children with signments may be more objective (because the count can be done by
ADHD are shown to reduce impulsivity and noncompliance (Barkley, a researcher unaware of treatment assignments). However, behavioral
2013; M.T.A., 1999) and deficits in attention and organization may be counts are subject to measurement error due to situational variability
overlooked until older ages when compounded by functional impair- and are hard to standardize across children. Also, in contrast to some
ments. OST specifically addresses deficits in organization, time manage- fields of behavioral research that have widely accepted “gold-standard”
ment, and planning and it is important to recognize that these skills are measures (such as the Yale-Brown Obsessive Compulsive Scale in stud-
related to age and cognitive development. Complex executive functions ies of behavioral therapy for OCD), the field of OST research is relatively
such as planning continue to mature during adolescence and young new and it appears that no single measure has emerged as a possible
adulthood, and many of the organizational skills taught to adolescents gold standard. We suggest that future studies of OST clearly designate
are developmentally inappropriate for younger children. When children one primary outcome and use a comprehensive set of secondary and
enter middle school the demands on organizational skills change dra- exploratory outcome measures.
matically leading some children to exhibit greater difficulties in middle The majority of studies of OST used the waitlist or treatment-as-
school. Our review suggests that OST has been best tested mostly in 8 to usual (TAU) as control conditions, but the description of allowed con-
12 year-old children. Future studies might consider downward exten- comitant treatments was inconsistent across publications. The terms
sions of OST approaches for younger children that might include age- “waitlist-control”, “treatment-as-usual”, and “community control” are
appropriate organizational skills that are required not only for school, sometimes used interchangeably in studies of psychosocial interven-
but also for play activities and daily living tasks. tions and imply that subjects are allowed to continue mental health
Neurocognitive deficits in sustained attention, working memory, re- and/or educational services that they have been receiving prior to enrol-
sponse inhibition, and planning seen in children with ADHD (Nigg, ment in the study. For example, clinical trials may include subjects on
2005; Willcutt et al., 2005) are connected to organizational skills, and concomitant medication but require that medication is stable for a peri-
future studies might test the effects of OST on neurocognitive profiles od of time. An important distinction is whether or not subjects are asked
as well as the utility of neurocognitive testing in predicting response not to initiate new treatments for the duration of the active phase of the
to OST. Also, children with ADHD show delays and heterogeneity in study. Two studies in our dataset (Evans et al., 2011; Evans et al., 2014)
brain maturation trajectories (Gopin & Healey, 2011; Shaw et al., provided subjects with a list of resources in community and encouraged
2007). This calls for testing neural mechanisms and biomarkers of OST them to pursue care. Other studies did not encourage or discourage sub-
toward a long-term goal of matching patients to treatments that can jects in control conditions from pursuing additional services while in
engage neural mechanisms of attention and executive functions to the active phase of the study. Some control subjects initiated new treat-
improve organizational skills. ments, which might have led to greater symptom reduction compared
Two studies of OST that met our a priori search criteria did not pro- to control conditions that required no initiation of new treatments.
vide data for calculating ES in the domains of interest in this meta-anal- The results of this meta-analysis might have also been affected by
ysis. Molina et al. (2008) reported the percentages of grades as a several limitations of the body of available randomized trials, including
measure of academic performance, a metric that could not be converted uneven sample sizes (sometimes treatment was twice as large as con-
to ES value. The study also reported the total BASC externalizing scale trol conditions), small number of studies to meta-analyze, high risk of
that combines ratings of inattention with ratings of aggression, bias due to lack of blinding of outcome assessors, and few trials
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 121

conducting intent to treat analysis. The small sample of studies in this Funding
meta-analysis did not allow us to explore possible causes of heterogene-
ity, which for our primary outcomes was quite large. Also, the small Dr. Aida Bikic received support from Region of Southern Denmark
number of studies precluded our ability to examine the presence of pub- Psychiatry Research, TrygFonden (J.nr. 7-12-1137), The Region of
lication bias in all but one meta-analysis (parent-rated attention), Southern Denmark's PhD pool (2011), University of Southern
which revealed the possibility of publication bias using the Trim and Denmark (12/2/2011) and Lundbeck Foundation (j.nr. R169-2014-38).
Fill method. A limitation of our meta-analysis is that we did not include
a meta-analysis of observational measures of organizational skills, as
only three studies provided data for each of the measures, which is con- Acknowledgments
sidered a small number to combine statistically. We also were unable to
synthesize data on parent-rated academic performance because this We thank the founding organizations. We thank Ms. Shivani Kaushal
outcome was not included in any study. Another limitation is that we for her help with the literature search in preparation of revisions of this
used HPC-I as a proxy measure for inattention, despite its specific paper and for proofreading the final manuscript.
focus on behaviors related to homework. However, HPC-I shows a cor-
relation of 0.67 with BASC-PRS Inattention subscale (Power et al., Appendix A. Supplementary data
2006), which is why it was used as a measure of attention. Among the
DSM symptoms of Inattention, four are indicative of organizational Supplementary data to this article can be found online at http://dx.
problems. The attention improvements reported by parents and doi.org/10.1016/j.cpr.2016.12.004.
teachers in the studies might be influenced by improvement of these
four organizational-related symptoms. However, it was not possible to References
dismantle the improvement in specific attention symptoms as none of
the studies reported items beyond subscale scores. The same is true Abikoff, H., & Gallagher, R. (2009). The children's organizational skills scales: Technical man-
ual. North Tonawanda, NY: Multi-Health Systems.
for the specific effect on the organizational skill measures, where total Abikoff, H., Gallagher, R., Wells, K. C., Murray, D. W., Huang, L., Lu, F., & Petkova, E. (2013).
scores were preferably reported. The goal of meta-analysis is to estimate Remediating organizational functioning in children with ADHD: Immediate and long-
treatment effects aggregated across studies and domains of term effects from a randomized controlled trial. Journal of Consulting and Clinical
Psychology, 81(1), 113–128. http://dx.doi.org/10.1037/a0029648.
measurement, and this approach does not disentangle the complexity
Abikoff, H., Nissley-Tsiopinis, J., Gallagher, R., Zambenedetti, M., Seyffert, M., Boorady, R., &
of psychological functions such as organizational skills. Organizational McCarthy, J. (2009). Effects of MPH-OROS on the organizational, time management,
functioning involves a complex set of skills and as more clinical trials and planning behaviors of children with ADHD. Journal of the American Academy of
Child and Adolescent Psychiatry, 48(2), 166–175. http://dx.doi.org/10.1097/CHI.
of OST become available, future meta-analyses may investigate relative
0b013e3181930626.
effects on specific organizational skills, for example, as reflected by the American Psychiatric Association, APA (2013). Diagnostic and statistical manual of mental
COSS subscales of organized actions, task planning, and materials man- disorders (5th ed.) (Washington DC).
agement. It is unknown whether the improvements in organizational Anesko, K. M., Schoiock, G., Ramirez, R., & Levine, F. M. (1987). The homework problem
checklist: Assessing children's homework problems. Behavioral Assessment, 9,
functioning were uniform across the specific subskills in these studies. 1979–1985.
Future studies should examine the effects of OST on the specific items Barkley, R. A. (2013). Defiant children. A clinician's manual for assessment and parent train-
of attention and organizational skills measures. ing. Guilford Press.
Barkley, R. A., & Fischer, M. (2011). Predicting impairment in major life activities and oc-
cupational functioning in hyperactive children as adults: Self-reported executive
function (EF) deficits versus EF tests. Developmental Neuropsychology, 36(2),
5. Conclusion 137–161. http://dx.doi.org/10.1080/87565641.2010.549877.
Booster, G. D., Dupaul, G. J., Eiraldi, R., & Power, T. J. (2012). Functional impairments in
children with ADHD: Unique effects of age and comorbid status. Journal of Attention
OST leads to moderate improvements in organizational skills of chil- Disorders, 16(3), 179–189. http://dx.doi.org/10.1177/1087054710383239.
dren with ADHD as rated by teachers and large improvements as rated Booster, G. D., Mautone, J. A., Nissley-Tsiopinis, J., Van Dyke, D., & Power, T. J. (2016). Re-
ductions in negative parenting practices mediate the effect of a family-school inter-
by parents. Modest improvements were also observed on the ratings of
vention for children with attention deficit hyperactivity disorder. School Psychology
symptoms of inattention and academic performance. The review notes Review, 45(2), 192–208. http://dx.doi.org/10.17105/spr45-2.192-208.
methodological limitations of studies to date including relatively small Brady, C. E., Evans, S. W., Berlin, K., Bunford, N., & Kerns, L. (2012). Evaluating school im-
pairment with adolescents using the classroom performance survey. School
samples of the majority of studies, heterogeneity of the outcome mea-
Psychology Review, 41, 429–446.
sures, and lack of attentional control comparison conditions. The clinical Coghill, D. R., Rhodes, S. M., & Matthews, K. (2007). The neuropsychological effects of
implication of this meta-analysis is that OST is a helpful treatment for chronic methylphenidate on drug-naive boys with attention-deficit/hyperactivity
organizational skills deficits in ADHD and it could be considered as disorder. Biological Psychiatry, 62(9), 954–962. http://dx.doi.org/10.1016/j.biopsych.
2006.12.030.
part of comprehensive treatment approaches for the core ADHD symp- Dalsgaard, S., Mortensen, P. B., Frydenberg, M., & Thomsen, P. H. (2002). Conduct prob-
toms as well as associated functional impairments. lems, gender and adult psychiatric outcome of children with attention-deficit hyper-
activity disorder. The British Journal of Psychiatry, 181, 416–421.
Dalsgaard, S., Mortensen, P. B., Frydenberg, M., & Thomsen, P. H. (2013). Long-term crim-
inal outcome of children with attention deficit hyperactivity disorder. Criminal
Roles of each author Behaviour and Mental Health, 23(2), 86–98. http://dx.doi.org/10.1002/cbm.1860.
Dalsgaard, S., Ostergaard, S. D., Leckman, J. F., Mortensen, P. B., & Pedersen, M. G. (2015).
Mortality in children, adolescents, and adults with attention deficit hyperactivity dis-
Aida Bikic and Denis Sukhodolsky designed the study and wrote order: A nationwide cohort study. Lancet, 385(9983), 2190–2196. http://dx.doi.org/
the protocol. Aida Bikic and Spencer McCauley conducted literature 10.1016/S0140-6736(14)61684-6.
searches, provided summaries of previous research studies, and extract- Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168.
http://dx.doi.org/10.1146/annurev-psych-113011-143750.
ed data. Brian Reichow conducted the statistical analysis and wrote the
DiPema, J. C., & Elliott, S. N. (2000). Academic competence evaluation scales. San Antonio,
results section. Aida Bikic, Denis Sukhodolsky, Brian Reichow, and Karim TX: The Psychological Corporation.
Ibrahim wrote the manuscript and all authors read and approved the DuPaul, G., Rapport, M. D., & Perriello, L. M. (1991). Teacher ratings of academic skills: The
development of the academic performance rating scale. School Psychology Review, 20,
final manuscript.
284–300.
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of test-
ing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463.
Conflict of interest Evans, S. W., Langberg, J. M., Schultz, B. K., Vaughn, A., Altaye, M., Marshall, S. A., &
Zoromski, A. K. (2016). Evaluation of a school-based treatment program for young
adolescents with ADHD. Journal of Consulting and Clinical Psychology, 84(1), 15–30.
The authors have no conflict of interest. http://dx.doi.org/10.1037/ccp0000057.
122 A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123

Evans, S. W., Schultz, B. K., & DeMars, C. E. (2014). High school-based treatment for ado- schoolers with ADHD: A randomized trial in a large public middle school. Journal of
lescents with attention-deficit/hyperactivity disorder: Results from a pilot study ex- Attention Disorders, 12(3), 207–217. http://dx.doi.org/10.1177/1087054707311666.
amining outcomes and dosage. School Psychology Review, 43(2), 185–202. Molina, B. S., Hinshaw, S. P., Swanson, J. M., Arnold, L. E., Vitiello, B., Jensen, P. S., ... Houck, P.
Evans, S. W., Schultz, B. K., Demars, C. E., & Davis, H. (2011). Effectiveness of the challeng- R. (2009). The MTA at 8 years: Prospective follow-up of children treated for combined-
ing horizons after-school program for young adolescents with ADHD. Behavior type ADHD in a multisite study. Journal of the American Academy of Child and Adolescent
Therapy, 42(3), 462–474. http://dx.doi.org/10.1016/j.beth.2010.11.008. Psychiatry, 48(5), 484–500. http://dx.doi.org/10.1097/CHI.0b013e31819c23d0.
Evans, S. W., Schultz, B. K., White, L. C., Brady, C., Sibley, M. H., & van Eck, K. (2009). A Murphy, P. (2002). Cognitive functioning in adults with attention-deficit/hyperactivity
school-based organization intervention for young adolescents with attention defi- disorder. Journal of Attention Disorders, 5(4), 203–209.
cit/hyperactivity disorder. School Mental Health, 1, 78–88. Murphy, K. R., Barkley, R. A., & Bush, T. (2002). Young adults with attention deficit hyper-
Faraone, S. V. (2000). Genetics of childhood disorders: Xx. ADHD, part 4: Is ADHD genetical- activity disorder: Subtype differences in comorbidity, educational, and clinical histo-
ly heterogeneous? Journal of the American Academy of Child and Adolescent Psychiatry, ry. The Journal of Nervous and Mental Disease, 190(3), 147–157.
39(11), 1455–1457. http://dx.doi.org/10.1097/00004583-200011000-00022. Narad, M. E., Garner, A. A., Peugh, J. L., Tamm, L., Antonini, T. N., Kingery, K. M., ... Epstein, J.
Gadow, K. D., & Sprafkin, J. (1994). Child symptom inventories manual. Stony Brook, NY: N. (2015). Parent-teacher agreement on adhd symptoms across development.
Checkmate Plus. Psychological Assessment, 27(1), 239–248. http://dx.doi.org/10.1037/a0037864.
Gallagher, R., Abikoff, H. B., & Spira, E. G. (2014). Organizational skills training for children Nigg, J. T. (2005). Neuropsychologic theory and findings in attention-deficit/hyperactivity
with ADHD an empirically supported treatment. Guilford Press. disorder: The state of the field and salient challenges for the coming decade.
Haack, L. M., Villodas, M., McBurnett, K., Hinshaw, S., & Pfiffner, L. J. (2016). Parenting as a Biological Psychiatry, 57(11), 1424–1435. http://dx.doi.org/10.1016/j.biopsych.2004.
mechanism of change in psychosocial treatment for youth with ADHD, predominant- 11.011.
ly inattentive presentation. Journal of Abnormal Child Psychology. http://dx.doi.org/10. Owens, J. S., Holdaway, A. S., Zoromski, A. K., Evans, S. W., Himawan, L. K., Girio-Herrera, E.
1007/s10802-016-0199-8. , & Murphy, C. E. (2012). Incremental benefits of a daily report card intervention over
Gopin, C. B., & Healey, D. M. (2011). The neural and neurocognitive determinants of time for youth with disruptive behavior. Behavior Therapy, 43(4), 848–861. http://dx.
ADHD. Journal of Infant, Child, and Adolescent Psychotherapy, 10, 13–31. doi.org/10.1016/j.beth.2012.02.002.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York, NY: Aca- Pelham, W. E., Jr., & Fabiano, G. A. (2008). Evidence-based psychosocial treatments for at-
demic Press. tention-deficit/hyperactivity disorder. Journal of Clinical Child and Adolescent
Heudo-Medina, T., Sanchez-Meca, J., Marin-Marinez, F., & Botella, J. (2006). Assessing het- Psychology, 37(1), 184–214. http://dx.doi.org/10.1080/15374410701818681.
erogeneity in meta-analysis: Q statistic or i2 index. Psychological Methods(11), 193–206. Pelham, W. E., Gnagy, E. M., Greenslade, K. E., & Milich, R. (1992). Teacher ratings of DSM-
Higgins, J. P. T., & Altman, D. G. (2008). Assessing risk of bias in included studies. In J. P. T. III-R symptoms for the disruptive behavior disorders. Journal of the American Academy
Higgins, & S. Green (Eds.), Cochrane handbook for systematic reviews of interventions. of Child and Adolescent Psychiatry, 31, 210–218.
John Wiley & Sons: Chichester, UK. Pfiffner, L. J., Hinshaw, S. P., Owens, E., Zalecki, C., Kaiser, N. M., Villodas, M., & McBurnett,
Higgins, J. P., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. K. (2014). A two-site randomized clinical trial of integrated psychosocial treatment
Statistics in Medicine, 21(11), 1539–1558. http://dx.doi.org/10.1002/sim.1186. for ADHD-inattentive type. Journal of Consulting and Clinical Psychology, 82(6),
Kent, K. M., Pelham, W. E., Jr., Molina, B. S., Sibley, M. H., Waschbusch, D. A., Yu, J., ... Karch, 1115–1127. http://dx.doi.org/10.1037/a0036887.
K. M. (2011). The academic experience of male high school students with ADHD. Pfiffner, L. J., Yee Mikami, A., Huang-Pollock, C., Easterlin, B., Zalecki, C., & McBurnett, K.
Journal of Abnormal Child Psychology, 39(3), 451–462. http://dx.doi.org/10.1007/ (2007). A randomized, controlled trial of integrated home-school behavioral treat-
s10802-010-9472-4. ment for ADHD, predominantly inattentive type. Journal of the American Academy of
Langberg, J. M. (2011). Homework, organization and planning skills (hops) intervention: A Child and Adolescent Psychiatry, 46(8), 1041–1050. http://dx.doi.org/10.1097/chi.
treatment manual. Bethesda, MD: National Association of School Psychologists 0b013e318064675f.
Publications. Pietrzak, R. H., Mollica, C. M., Maruff, P., & Snyder, P. J. (2006). Cognitive effects of imme-
Langberg, J. M., Epstein, J. N., & Graham, A. J. (2008a). Organizational-skills interventions diate-release methylphenidate in children with attention-deficit/hyperactivity disor-
in the treatment of ADHD. Expert Review of Neurotherapeutics, 8(10), 1549–1561. der. Neuroscience and Biobehavioral Reviews, 30(8), 1225–1245. http://dx.doi.org/10.
http://dx.doi.org/10.1586/14737175.8.10.1549. 1016/j.neubiorev.2006.10.002.
Langberg, J. M., Epstein, J. N., Urbanowicz, C. M., Simon, J. O., & Graham, A. J. (2008b). Ef- Polanczyk, G., de Lima, M. S., Horta, B. L., Biederman, J., & Rohde, L. A. (2007). The world-
ficacy of an organization skills intervention to improve the academic functioning of wide prevalence of ADHD: A systematic review and metaregression analysis. The
students with attention-deficit/hyperactivity disorder. School Psychology Quarterly, American Journal of Psychiatry, 164(6), 942–948. http://dx.doi.org/10.1176/ajp.2007.
23(3), 407–417. http://dx.doi.org/10.1037/1045-3830.23.3.407. 164.6.942.
Langberg, J. M., Arnold, L. E., Flowers, A. M., Altaye, M., Epstein, J. N., & Molina, B. S. (2010). Power, T. J., Mautone, J. A., Soffer, S. L., Clarke, A. T., Marshall, S. A., Sharman, J., ... Jawad, A.
Assessing homework problems in children with ADHD: Validation of a parent-report F. (2012). A family-school intervention for children with adhd: Results of a random-
measure and evaluation of homework performance patterns. School Mental Health, ized clinical trial. Journal of Consulting and Clinical Psychology, 80(4), 611–623. http://
2(1), 3–12. http://dx.doi.org/10.1007/s12310-009-9021-x. dx.doi.org/10.1037/a0028188.
Langberg, J. M., Epstein, J. N., Becker, S. P., Girio-Herrera, E., & Vaughn, A. J. (2012). Evalu- Power, T. J., Watkins, M. W., Mautone, J. A., Walcott, C. M., Coutts, M. J., & Sheridan, S. M.
ation of the homework, organization, and planning skills (hops) intervention for mid- (2015). Examining the validity of the homework performance questionnaire: Multi-
dle school students with ADHD as implemented by school mental health providers. informant assessment in elementary and middle school. School Psychology Quarterly,
School Psychology Review, 41(3), 342–364. 30(2), 260–275. http://dx.doi.org/10.1037/spq0000081.
Langberg, J. M., Epstein, J. N., Girio, E. L., Becker, S. P., Vaughn, A. J., & Altaye, M. (2011a). Power, T. J., Werba, B. E., Watkins, M. W., Angelucci, J. G., & Eiraldi, R. B. (2006). Patterns of
Materials organization, planning, and homework completion in middle school stu- parent-reported homwork problems among ADHD-referred and non-referred chil-
dents with ADHD: Impact on academic performance. School Mental Health, 3(2), dren. School Psychology Quarterly, 21, 13–33.
93–101. http://dx.doi.org/10.1007/s12310-011-9052-y. Rapoport, J. L., & Gogtay, N. (2008). Brain neuroplasticity in healthy, hyperactive and psy-
Langberg, J. M., Vaughn, A. J., Williamson, P., Epstein, J. N., Girio-Herrera, E., & Becker, S. P. chotic children: Insights from neuroimaging. Neuropsychopharmacology, 33(1),
(2011b). Refinement of an organizational skills intervention for adolescents with 181–197. http://dx.doi.org/10.1038/sj.npp.1301553.
ADHD for implementation by school mental health providers. School Mental Health, Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005). Publication bias in meta-analysis: Pre-
3(3), 143–155. http://dx.doi.org/10.1007/s12310-011-9055-8. vention, assessment, and adjustments. Chichester, West Suffox, UK: John Wiley & Sons.
Leroux, J., & Levitt-Perlman, M. (2000). The gifted child with attention deficit disorder: An Shaw, P., Eckstrand, K., Sharp, W., Blumenthal, J., Lerch, J. P., Greenstein, D., ... Rapoport, J.
identification and intervention challenge. Roeper Review, 22(3), 171–177. L. (2007). Attention-deficit/hyperactivity disorder is characterized by a delay in cor-
M.T.A., Cooperative Group (1999). A 14-month randomized clinical trial of treatment tical maturation. Proceedings of the National Academy of Sciences of the United States
strategies for attention-deficit/hyperactivity disorder. Archives of General Psychiatry, of America, 104(49), 19649–19654. http://dx.doi.org/10.1073/pnas.0707741104.
56(12), 1073–1086. Sibley, M. H. (2016). Parent-teen therapy for executive function deficits and ADHD. Build-
Maibing, C. F., Pedersen, C. B., Benros, M. E., Mortensen, P. B., Dalsgaard, S., & Nordentoft, ing skills and motivation. New York: Guilford.
M. (2015). Risk of schizophrenia increases after all child and adolescent psychiatric Sibley, M. H., Altszuler, A. R., Morrow, A. S., & Merrill, B. M. (2014a). Mapping the academ-
disorders: A nationwide study. Schizophrenia Bulletin, 41(4), 963–970. http://dx.doi. ic problem behaviors of adolescents with ADHD. School Psychology Quarterly, 29(4),
org/10.1093/schbul/sbu119. 422–437. http://dx.doi.org/10.1037/spq0000071.
Massetti, G. M., Lahey, B. B., Pelham, W. E., Loney, J., Ehrhardt, A., Lee, S. S., & Kipp, H. Sibley, M. H., Altszuler, A. R., Ross, J. M., Sanchez, F., Pelham, W. E., & Gnagy, E. M. (2014b).
(2008). Academic achievement over 8 years among children who met modified A parent-teen collaborative treatment model for academically impaired high school
criteria for attention-deficit/hyperactivity disorder at 4–6 years of age. Journal of students with ADHD. Cognitive and Behavioral Practice, 1, 32–42.
Abnormal Child Psychology, 36(3). http://dx.doi.org/10.1007/s10802-007-9186-4 Sibley, M. H., Graziano, P. A., Kuriyan, A. B., Coxe, S., Pelham, W. E., Rodriguez, L., ... Ward,
17940863. A. (2016). Parent-teen behavior therapy + motivational interviewing for adolescents
Mautone, J. A., Marshall, S. A., Sharman, J., Eiraldi, R. B., Jawad, A. F., & Power, T. J. (2012). with ADHD. Journal of Consulting and Clinical Psychology, 84(8), 699–712. http://dx.
Development of a family-school intervention for young children with attention defi- doi.org/10.1037/ccp0000106.
cit hyperactivity disorder. School Psychology Review, 41(4), 447–466. Sibley, M. H., Pelham, W. E., Derefinko, K. J., Kuriyan, A. B., Sanchez, F., & Graziano, P. A.
McBurnett, K., Pfiffner, L. J., & Frick, P. J. (2001). Symptom properties as a function of adhd (2013). A pilot trial of supporting teens' academic needs daily (stand): A parent-ado-
type: An argument for continued study of sluggish cognitive tempo. Journal of lescent collaborative intervention for ADHD. Journal of Psychopathology and Behavioral
Abnormal Child Psychology, 29(3), 207–213. Assessment, 35(4), 436–449. http://dx.doi.org/10.1007/s10862-013-9353-6.
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for Skoe, E., & Kraus, N. (2012). A little goes a long way: How the adult brain is shaped by mu-
systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6 sical training in childhood. The Journal of Neuroscience, 32(34), 11507–11510. http://
(doi: e1000097). dx.doi.org/10.1523/JNEUROSCI.1949-12.2012.
Molina, B. S., Flory, K., Bukstein, O. G., Greiner, A. R., Baker, J. L., Krug, V., & Evans, S. W. Sterne, J. A. C., Becker, B. J., & Egger, M. (2005). The funnel plot. In publication bias in
(2008). Feasibility and preliminary efficacy of an after-school program for middle meta-analysis: Prevention, assessment, and adjustments. In A. J. Sutton, H. R.
A. Bikic et al. / Clinical Psychology Review 52 (2017) 108–123 123

Rothstein, & M. Boernstein (Eds.), Publication bias in meta-analysis: Prevention, assess- Swanson, J. M., Kraemer, H. C., Hinshaw, S. P., Arnold, L. E., Conners, C. K., Abikoff,
ment, and adjustments (pp. 75–98) (pp. 75–98). H. B., ... Wu, M. (2001). Clinical relevance of the primary findings of the MTA:
Sterne, J. A. C., Egger, M., & Moher, D. (2008). Addressing reporting biases. In S. Success rates based on severity of ADHD and odd symptoms at the end of treat-
Green, & J. P. T. Higgins (Eds.), Cochrane handbook for systematic reviews of inter- ment. Journal of the American Academy of Child and Adolescent Psychiatry, 40(2),
ventions (pp. 297–333). Chichester, UK: John Wiley & Sons. 168–179.
Storebo, O. J., Ramstad, E., Krogh, H. B., Nilausen, T. D., Skoog, M., Holmskov, M., ... Gluud, Toplak, M. E., Jain, U., & Tannock, R. (2005). Executive and motivational processes in ad-
C. (2015). Methylphenidate for children and adolescents with attention deficit hyper- olescents with attention-deficit-hyperactivity disorder (ADHD). Behavioral and Brain
activity disorder (ADHD). Cochrane Database of Systematic Reviews, 11, CD009885. Functions, 1(1), 8. http://dx.doi.org/10.1186/1744-9081-1-8.
http://dx.doi.org/10.1002/14651858.CD009885.pub2. Willcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., & Pennington, B. F. (2005). Validity of
Storer, J., Evans, S. W., & Langberg, J. (2014). Organization interventions for children and the executive function theory of attention-deficit/hyperactivity disorder: A meta-an-
adolescents with attention-deficit/hyperactivity disorder (ADHD). In M. Weist, N. alytic review. Biological Psychiatry, 57(11), 1336–1346. http://dx.doi.org/10.1016/j.
Lever, C. Bradshaw, & J. S. Owens (Eds.), Handbook of school mental health biopsych.2005.02.006.
(pp. 385–398) (2nd ed.). New York: Springer. Wolraich, M. L., Feurer, I. D., Hannah, J. N., Baumgaertel, A., & Pinnock, T. Y. (1998).
Swanson, J. M., & Volkow, N. D. (2009). Psychopharmacology: Concepts and opinions Obtaining systematic teacher reports of disruptive behavior disorders utilizing
about the use of stimulant medications. Journal of Child Psychology and Psychiatry, DSM-IV. Journal of Abnormal Child Psychology, 26, 141–152.
50(1–2), 180–193. http://dx.doi.org/10.1111/j.1469-7610.2008.02062.x.

View publication stats

You might also like