Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

Available online at www.sciencedirect.

com

ScienceDirect
Behavior Therapy 49 (2018) 249 – 261
www.elsevier.com/locate/bt

Consumer Smartphone Apps Marketed for Child and Adolescent


Anxiety: A Systematic Review and Content Analysis
Laura Jane Bry
Tommy Chou
Elizabeth Miguel
Jonathan S. Comer
Mental Health Interventions and Technology (MINT) Program, Florida International University

Anxiety disorders are collectively the most prevalent mental Keyword: anxiety; child; technology; mobile; mHealth
health problems affecting youth. To increase the reach of
mental health care, recent years have seen increasing
enthusiasm surrounding mobile platforms for expanding CHILDHOOD ANXIETY DISORDERS CONSTITUTE an enor-
treatment delivery options. Apps developed in academia and mous public health concern. In the U.S. alone,
supported in clinical trials are slow to reach the consumer estimates indicate that anxiety disorders are collec-
marketplace. Meanwhile, proliferation of industry-developed tively the most prevalent class of mental disorders
apps on consumer marketplaces has been high. The present and are among the earliest disorders to establish
study analyzed content within mobile products prominently themselves, with median age of onset occurring at
marketed toward consumers for anxiety in youth. Systematic age 6 (Merikangas et al., 2010). Indeed, almost 1 in
inventory of the Google Play Store and Apple Store using 10 preschoolers suffer from an anxiety disorder
keyword searches for child and adolescent anxiety yielded 121 before age 5 (Egger & Angold, 2006) and nearly
apps, which were evaluated on the basis of their descriptive one-third of adolescents experience anxiety disorder
characteristics, mobile functionalities, and adherence to onset prior to age 18 (Merikangas et al., 2010).
evidence-based treatment principles. Findings revealed that Furthermore, anxiety is related to a high degree of
evidence-based treatment content within the sample is scant comorbidity with other mental health problems
and few comprehensive anxiety self-management apps were (Costello, Egger, & Angold, 2005) and a stable
identified. Advanced features that leverage the broader course across the lifespan. Clinical levels of anxiety
functionalities of smartphone capabilities (e.g., sensors, during adolescence have been linked to a number
ecological momentary assessments) were rarely present. of poor outcomes in adulthood, including increased
Findings underscore the need to increase the prominence and risk for anxiety, depression, substance use, suicidal
accessibility of quality child anxiety intervention products for behavior, educational underachievement, early
consumers. Strategies for improving marketing of supported parenthood, and overall reduced quality of life
apps to better penetrate consumer markets are discussed. (Comer et al., 2011; Woodward & Fergusson,
2001). Moreover, daily interference and impairment
This work was supported in part by the National Institutes of
in those experiencing anxiety is high, and the nature
Health (NIH) K23 MH090247 (PI: Comer). of anxiety symptoms is linked to deficits in multiple
Address correspondence to Jonathan S. Comer, Ph.D., Professor domains of functioning, such as school absenteeism
of Psychology and Psychiatry, Mental Health Interventions and
Technology (MINT) Program, Center for Children and Families,
(Kearney, 2008), poorer social skills (Crawford
Department of Psychology, Florida International University, 11200 & Manassis, 2011), sleep problems (Weiner,
S.W. 8th Street, Miami, FL 33199; e-mail: jocomer@fiu.edu. Elkins, Pincus, & Comer, 2015), lower levels of
0005-7894/© 2017 Association for Behavioral and Cognitive Therapies.
peer acceptance (Greco & Morris, 2005), elevated
Published by Elsevier Ltd. All rights reserved. substance use (Wu, Goodwin, Comer, Hoven &
250 bry et al.

Cohen, 2010), and greater peer victimization obstacles; Sareen et al., 2007). Organization-level
(Crawford & Manassis, 2011; Siegel, La Greca, & and systemic barriers to traditional clinic-based
Harrison, 2009). Early intervention for anxiety is services have also been identified, including mental
critical. health workforce shortages (Thomas, Ellis, Konrad,
The past several decades have witnessed tremen- Holzer, & Morrissey, 2009) and English language
dous advances in the development and evaluation of proficiency (Derose & Baker, 2000). Moreover,
evidence-based treatments for anxious youth (Higa- individuals experiencing psychological distress
McMillan, Francis, Rith-Najarian, & Chorpita, perceive greater barriers to treatment than their
2016). Cognitive-behavioral therapy (CBT) has nonimpaired counterparts (Mohr et al., 2010).
received the strongest support in clinical trials and Thus, the obstacles to providing evidence-based
is considered the gold-standard psychosocial inter- mental health treatment to those in need are highly
vention for anxiety disorders in children and entrenched in the American health care system and
adolescents (e.g., Compton et al., 2004; Higa- individual attitudes. Overcoming such barriers to
McMillan et al., 2016; Walkup et al., 2008). quality mental health care will require a paradigm
Exposure exercises—widely accepted to be among shift in the manner in which treatments are delivered
the most essential ingredients of effective CBT for (Comer & Barlow, 2014; Kazdin & Blase, 2011).
anxious youth (Kendall et al., 2005)—have children Over the last two decades, there has been increasing
develop a hierarchy of situations and objects that enthusiasm about the potential for leveraging tech-
cause them fear, as they systematically confront these nology to better meet population-level mental health
feared experiences in a graduated fashion. Other key care needs (Chou, Bry, and Comer, 2017a, b; Comer
CBT ingredients for child anxiety include: psychoe- & Barlow, 2014; Kazdin & Blase, 2011). For
ducation about the harmless and normative nature of example, technology-based or –assisted mental health
anxiety, self-monitoring (child or parent observes interventions hold promise to provide treatment at a
and keeps logs of their anxious patterns, behaviors, lower cost (Muñoz, 2010; Washington State Institute
and thoughts), contingency management (child is for Public Policy, 2015), though more research is
rewarded and reinforced for brave behaviors, needed to demonstrate cost-effectiveness at a systems
rewards are removed for behavioral avoidance), level (Schweitzer & Synowiec, 2012). Technology
problem solving (child learns to identify problems also affords the potential to overcome geographical
and generate, select, and evaluate solutions), and obstacles and expand access to care to more
thought challenging/cognitive restructuring (i.e., child individuals, including children and adolescents in
learns to identify and modify anxious “self-talk”). geographically remote areas (e.g., Bunnell, Davidson,
Although relaxation training was once considered to Dewey, Price, & Ruggiero, 2016; Comer & Barlow,
be an important element of anxiety treatment, it is 2014; Hilty, Cobb, Neufeld, Bourgeois, & Yellowlees,
now considered less essential and potentially coun- 2008; Price, Yuen, Davidson, Hubel, & Ruggiero,
terproductive, and is rarely included in modern CBTs 2015). With about 75% of Americans accessing
for youth anxiety (Ehrenreich-May et al., 2016). health care information online (Pew Research Center,
Despite advances in the identification of efficacious 2015), the feasibility and acceptability of technology-
treatment practices for child and adolescent anxiety, based treatments appears to be on the rise. Moreover,
significant barriers prevent those in need from recent randomized controlled trials have supported
accessing supported care. Indeed, epidemiological the initial efficacy of technology-enhanced interven-
data show that rates of treatment among those with tions in improving children’s mental health outcomes
mental disorders is low, with less than half of affected (e.g., Hedman et al., 2014; Jones et al., 2014; March,
individuals seeking any type of mental health Spence, & Donovan, 2009; Spence, Holmes, March,
treatment in a 12-month period (Wang et al., 2005). & Lipp, 2006).
Treatment rates are lowest among vulnerable and The platforms of behavioral intervention tech-
traditionally underserved groups (e.g., economically nologies (BITs) have increasingly shifted towards
disadvantaged, rural, racial/ethnic minorities, elderly, applications addressing health care needs via a range
those lacking insurance; Wang et al., 2005). More- of mobile communication devices—referenced
over, when traditional clinic-based services are broadly as mHealth applications. While mHealth
accessed, dropout rates are high (Wierzbicki & platforms range across a number of consumer
Pekarik, 1993). Several patient-level barriers have products (e.g., smartphones, tablets, wearable sen-
been identified, including attitudinal barriers (e.g., sors), the present evaluation focuses specifically on
low perceived need and stigma; Mojtabai et al., those made available for smartphones; Jones et al.,
2011), financial limitations (Mojtabai, 2005) and 2015). Given the increasing prevalence and usage
structural barriers (e.g., geographically underserved rates of smartphones, in particular, across a wide
regions; scheduling difficulties; transportation range of demographics (e.g., youth, racial/ethnic
child anxiety apps 251

minorities, those dwelling in rural communities; Pew and examination of mobile apps for youth anxiety, to
Research Center, 2017), smartphone applications date no studies have evaluated the scope and quality
are being developed as a novel method of extending of mobile apps actually dominating the consumer
access and delivering mental health treatment to marketplace for child or adolescent anxiety. The
traditionally underserved groups (Anton et al., present study entailed a systematic content analysis of
2016). Preliminary studies point to evidence for the readily searchable apps on leading consumer mar-
acceptability of using smartphones to monitor ketplaces for mobile communication technologies.
mental health (Torous, Friedman, & Keshavan, Given concerns about the quality of mobile apps
2014) as well as the feasibility and efficacy of targeting other mental health problems (e.g., depres-
delivering interventions on smartphones (Donker sion, Shen et al., 2015; eating disorders, Juarascio,
et al., 2013; Jones et al., 2014); however, this body of Manasse, Goldstein, Forman, & Butryn, 2015), it
literature is inchoate, precluding firm conclusions. was hypothesized that the majority of mobile apps
Innovative research groups are increasingly draw- marketed to consumers for youth anxiety would not
ing on the expanding technological capabilities and include the critical evidence-based components sup-
functionalities of smartphone platforms, which afford ported in research trials for treating youth anxiety
unique opportunities for patient monitoring and treat- (e.g., exposures, psychoeducation about anxiety, self-
ment. For example, a phone’s sensor data, (i.e., its use monitoring, contingency management, development
of the innate GPS, accelerometer, and/or microphone) of fear hierarchies, problem solving, and thought
can allow for passive data collection on user sleep challenging). To further examine the research-
patterns, heart rate, social context, physical location, practice gap, apps were also evaluated on the extent
mood and stress levels (Mohr, Zhang, & Schueller, to which they incorporated advanced technological
2017), each providing clinical information that can components and functionalities highlighted in the
relate to a user’s physiological anxiety symptoms and academic mHealth literature (e.g., ecological momen-
the environmental factors producing such. Further- tary assessment, data collection through sensors).
more, smartphone platforms provide features that Lastly, comparisons were made between the content
allow for ecological momentary assessment, “just-in- and functionalities of free apps in the consumer
time” intervention, and the delivery of interactive, marketplace to the content and functionalities of
tailored treatment content aligned with the precision apps that cost money to explore whether financial
medicine movement (Schueller, Muñoz, & Mohr, considerations might be associated with the quality of
2013) in ways face-to-face treatment may not. apps for child and adolescent anxiety.
The unique opportunities brought about by
smartphones and related mobile communication Methods
technologies have not gone unnoticed by the private app search criteria and selection
sector, evidenced by the proliferation of industry- procedures
funded mental health apps available on the Screening and assessment of apps for study inclusion
consumer marketplace. As of January 2014, there was guided by a systematic review process and
were roughly 2,000 mobile apps marketed for restricted to the two most widely used marketplaces
anxiety alone that were available to consumers for mobile apps: Android’s Google Play store and
(Chan, Torous, Hinton, & Yellowlees, 2014) and a Apple’s iOS App store (Boulos, Wheeler, Taveres &
national U.S. survey showed that more than half of Jones, 2011). Search terms were identified for
Americans had downloaded at least one health- anxiety-related apps and included two technical
related app (Krebs & Duncan, 2015). Despite terms (i.e., anxiety, phobia) as well as two common
growing mHealth development and research within synonyms and layperson alternatives (i.e., fear,
academic settings, research-to-practice gaps and stress) in effort to identify consumer-driven products
poor dissemination of science-based health care that take into account varying levels of mental health
innovations to the general public persist (Westfall, literacy. These four anxiety search terms were
Mold, & Fagnan, 2007). Amidst rapid expansion crossed with a second set of four search terms to
of industry-sponsored mHealth apps marketed for restrict results to apps specific to youth problems
consumers, it is not clear whether supported mHealth (i.e., child, kid, teen, and adolescent). Combining
apps developed in academic settings are actually each of the four search terms for anxiety with each of
reaching consumers, and whether mHealth apps that the four search terms for youth resulted in 16 unique
are readily available on the consumer marketplace searches in each of the two app marketplaces, for a
are grounded in evidence-based principles. total of 32 searches.
Despite the high prevalence and burdens of Given research suggesting that only a small
child and adolescent anxiety disorders, and despite number of users view apps past the first 10 ranked
advances in academic settings in the development apps in their search query, and most downloaded
252 bry et al.

apps are listed within the first 5 ranked apps per policy), and (d) risk management (the app includes
those search terms (Dogruel, Joeckel, & Bowman, language regarding the management of suicidal
2015), not all apps that were generated in each ideation, mental health emergencies, and/or indicates
search were evaluated. As a conservative approx- the app is not intended to replace a therapist). For
imation of potential consumer search patterns, the each app, coders also recorded the presence versus
study team included up to the top 30 results from absence of three specific mobile app functionality
each of the 32 unique searches. components: (a) sensors (data is imported to the app
The Google Play store and Apple App store were via sensors innate to the smartphone that capture
inventoried using the aforementioned search terms motion, orientation, or environment), (b) interactivity
during a single week in February 2016, resulting in (the app’s content is individualized and influenced by
the identification of 755 total apps, as some search user behavior, input, or context, and/or the app
terms yielded fewer than 30 results. One hundred provides customizable options to users based on
eighty-two of these apps were identified as duplicates preference), and (c) ecological momentary assessment
(either on the basis of appearing in both the Android (assessment and/or intervention, in real time, of the
and Apple marketplaces, or appearing in the results of user’s mood, thoughts, behaviors or distress level).
multiple search term combinations) and excluded. Consensus guidelines on research-supported
The remaining 573 unique mobile apps were further practices for youth anxiety (Chorpita & Daleiden,
scrutinized for study inclusion. Apps meeting the 2009; Higa-McMillan et al., 2016; Silverman, Pina &
following inclusion criteria were retained for analysis: Viswesvaran, 2008) were consulted, and a panel of
(a) marketed for the treatment or management of three doctoral-level youth anxiety experts provided
anxiety-related symptoms, (b) intended for use by additional input to identify the key evidence-based
children, teens, or their parents (i.e., apps were not practice components in the treatment of child anxiety.
specifically listed for adult use only), (c) available For each app, coders recorded the presence or absence
to the public for download, (d) available in English, of six identified evidence-based treatment compo-
and (e) evidenced stability in the marketplace by nents: (a) psychoeducation, (b) self-monitoring,
remaining available throughout the entirety of the (c) cognitions and thought challenging, (d) problem
6-month coding window. solving, (e) contingency management, and (f) expo-
Two study authors (LB and TC) used the sures. See Figure 1 for definitions of how these
information provided in the apps’ titles, app store components were operationalized for study coders. In
descriptions, and available screenshots to identify addition, given historical recommendations for re-
those apps meeting the above inclusion criteria. The laxation training in the treatment of youth anxiety,
most common reason for exclusion were apps that, despite waning enthusiasm for the practice in modern
despite appearing in search results for anxiety-related CBTs for youth anxiety, coders also assessed apps for
apps, did not make any mention of treating or relaxation training (see Figure 1).
managing anxiety-related symptoms in their descrip- Three coders (LB, TC, and EM) were trained to
tion pages. Most of these apps were games or other reliability on several rounds of sample mental health
multimedia content marketed toward youth. An apps. Coders had to achieve an interrater reliability
ultimate sample of 121 apps met inclusion criteria criterion of k = 0.80 on a series of 8 independently
and was submitted to content analysis. coded apps before initiating coding on the study
apps. The final round of independent practice coding
app coding revealed high concordance and high interrater
A codebook was created to organize content analysis reliability, k = 0.93.
and optimize intercoder reliability. Content analysis The 121 study apps were downloaded from their
consisted of noting the presence or absence of all respective app stores and each was assessed and
study codes except reading level, which was treated coded by at least one study coder. To ensure
as a continuous variable. Reading level of each app interrater reliability, 20% of the overall app sample
was approximated by uploading the full text was independently double-coded by two reviewers.
included in the app’s description page into a Flesch- Interrater reliability was calculated overall, as well as
Kincaid grade level calculator. Other study codes on individual codes. Overall Kappa reliability
included descriptive characteristics of the apps: coefficients ranged from k = 0.71–1.00 on individual
(a) age category (the app rating that the app plat- codes and an overall reliability of k = 0.94, indicating
form, not the developer, has assigned via the app’s strong reliability (Fleiss, 1971).
description page), (b) price category (free versus
for-purchase), (c) confidentiality (the app offers the data analysis
option of logging in via a set password and/or the app Cohen’s kappa values and descriptive statistics were
directly states its security, privacy, or data storage calculated using SPSS version 23. Chi square tests
child anxiety apps 253

Psychoeducation
Defined as the presence of any of the following:
Defines Anxiety
Normalizes/ Adaptive in nature (e.g., fight of flight response)
Provides prevalence rates
Describes Cycle of Reinforcement
Describes symptoms: Thoughts, Feelings, Behaviors
Describes impairment domains
Describes comorbidities associated
Self-monitoring
Defined as the presence of any of the following:
Self-evaluation of mood
Self-evaluation of thoughts
Self-evaluation of behaviors
Cognitions and Thought Challenging
Defined as the presence of any of the following:
Lists thought traps
Negative self-talk
Provides relevant examples of thought traps
Describes automatic nature
Looking for evidence (probability v possibility)
So what if it happens?
Alternate outcome/ “how else could it turn out?”
“What would you tell a friend in the same situation?”
Encourages user to generate neutral or positive, or more logical, self-
statements
Problem Solving
Defined as the presence of any of the following:
Identifying the problem
Identifying all possible solutions
Evaluate each solution
Try out the best solution
Evaluate the outcome
Creating a coping plan
Contingency Management
Defined as the presence of any of the following:
Internal app rewards (badges, levels, points) for effort and use
Positive reinforcement description
Reward planning and follow through
Labeled praise
Describes fading rewards over time
Exposures
Defined as the presence of any of the following:
Provides definition and rationale for exposures
Provides example of appropriate gradation (starting small/ easy)
Instructs user to form hierarchy
Provides visualization of user’s hierarchy
Encourages approach, not avoidance
Imaginal or In vivo
Relaxation Training
Defined as the presence of any of the following:
Somatic Responses to anxiety
Prompts user to list/identify their anxious feelings
Focus on Pleasant Stimuli/ Distraction
Guided/ Structured Mindfulness
Progressive Muscle Relaxation
Breath Training

FIGURE 1 Study definitions of evidenced-based treatment components within study apps


254 bry et al.

were computed to make comparisons between free crisis or suicidality aimed at directing users to more
and for-purchase apps on all categorical variables. appropriate risk-management outlets were more
T-tests measured differences between free and frequent within the sample, but found in only 1 out
for-purchase apps for all continuous variables. of every 6 apps.
Results functionality components
sample characteristics
Advanced functionalities often included or touted in
Table 1 presents characteristics of the sampled youth the academic literature on the potential of mHealth
anxiety apps available on the consumer marketplace. were rare among sampled apps for child anxiety on
Over three-quarters of the sample were Android apps the marketplace (see Table 2). No apps gathered data
found in the Google Play Store. The majority of passively through sensors and less than 5% of the
sampled apps were available free of cost. Among sampled apps used ecological momentary assessment
apps that were not available for free, prices ranged to evaluate or “ping” user mood, emotional or
from $0.99–$6.99 (M = $1.21, SD = 1.74). The behavioral states in real time. Lastly, apps that
majority of apps in the sample had a formal age allowed users to customize content to their prefer-
classification designated through the app store as ences or those containing interactive, logic-driven
being appropriate for either “Everyone” (Google content reacting to user input were similarly rare.
Play Store) or those ages “4 +” (Apple iTunes Store).
The mean Flesch-Kincaid Grade Level score of the evidence-based treatment
overall sample indicated that the content on study components
apps were written, on average, at a 9 th grade reading Half of the sampled apps for child anxiety on the
level. The mean Flesch-Kincaid reading level of apps marketplace included any evidence-based treatment
specifically categorized as “Everyone” or age “4 +” component (see Table 3), and 23% of sampled apps
indicated that content on these apps’ description contained two or more evidence-based compo-
pages was also written at a 9 th grade reading level. nents. The most common evidence-based treatment
Lastly, features to maintain user safety were scant component found across sampled apps on the
within the sample. Specifically, features related to marketplace was “exposure,” which was found in
user confidentiality (e.g., passwords, statements a fifth of sampled apps. Similarly, roughly one-fifth
about data security) were found in less than 5% of of sampled apps on the marketplace contained
apps in the sample. Statements regarding acute risk, mention of cognitive biases associated with anxiety
or had instruction in thought challenging or cognitive
restructuring, and nearly one-fifth of the sampled
Table 1 apps referenced self-monitoring, reflection, or
Characteristics of Sampled Youth Anxiety Apps on the tracking of one’s thoughts, emotions, or behaviors.
Marketplace (N = 121) General psychoeducational information related to
N % anxiety, its definition and symptoms, and how it is
Marketplace
maintained or treated was scant among sampled
Google Play Store 83 68.6
iOS App Store 38 31.4
Cost Table 2
Free 70 57.9 Prevalence of Advanced Functionalities Across Sampled
For Purchase 51 42.1 Youth Anxiety Apps on the Marketplace (N = 121)
Designated Age Classification
N %
Everyone/Ages 4 + a 91 75.2
Not for everyone/Ages 4 + a 30 24.8 Individual Functionalities
Confidentiality Sensors
Yes 5 4.1 Yes 0 0.0
No 116 95.9 No 121 100.0
Risk Management Interactive Content
Yes 18 14.9 Yes 3 2.5
No 102 85.1 No 118 97.5
M SD Ecological Momentary Assessment
Flesch-Kincaid Reading Grade Level 9.3 3.4 Yes 4 3.3
a No 117 96.7
Google Play Store and iOS App Store have different age
Any Advanced Functionalities
classification levels. The lowest age classification level on the
Google Play Store is “Everyone,” whereas the lowest age Yes 5 4.1
classification level on the iOS App Store is “Ages 4 +”. No 116 95.9
child anxiety apps 255

Table 3
Prevalence of Evidence-Based Treatment Components Across Sampled Youth Anxiety Apps on the Marketplace (N = 121)
Total sample Cost Significance test
Free For-purchase
N % N % N %
Individual Evidence-Based Components
Exposures χ 2 (1, 121) = 0.19, p = 0.67
Yes 26 21.5 16 13.2 10 8.3
No 95 78.5 54 44.6 41 33.9
Cognitive Restructuring/Thought Challenging
Yes 25 20.7 10 8.3 15 12.4 χ 2 (1, 121) = 4.12, p = 0.04
No 96 79.3 60 49.6 36 29.8
Self-Monitoring
Yes 24 19.8 11 9.1 13 10.7 χ 2 (1, 121) = 1.77, p = 0.18
No 97 80.2 59 48.8 38 31.4
Psychoeducation
Yes 20 16.5 9 7.4 11 9.1 χ 2 (1, 121) = 1.62, p = 0.20
No 101 83.5 61 50.4 40 33.1
Contingency Management
Yes 14 11.6 10 8.3 4 3.3 p = 0.39, Fisher’s Exact Test
No 107 88.4 60 49.6 47 38.8
Problem Solving
Yes 6 5.0 2 1.7 4 3.3 p = 0.24, Fisher’s Exact Test
No 115 95.0 68 56.2 47 38.8
Any Evidence-Based Component(s)
Yes 60 49.6 32 26.4 28 23.1 χ 2 (1, 121) = 1.00, p = .32
No 61 50.4 38 31.4 23 19.0

apps, with only 1 in every 6 apps referencing Discussion


such information. Mention of rewards or positive Despite increased scholarly attention to the poten-
reinforcement for use of the app or brave/approach tial of leveraging smartphones to extend the reach
behavior toward anxiety-related situations was of evidence-based treatments (e.g., Chou, Bry, and
present in roughly 1 out of 10 apps, and problem- Comer, 2017a, b; Donker et al., 2013; Jones et al.,
solving content was even more rare. 2015; Whiteside, 2016), and despite considerable
The majority of sampled apps marketed for youth industry activity in the development of smartphone
anxiety that lacked any evidence-based treatment apps for youth anxiety, this is the first investigation
components were largely distraction tools, such to systematically assess the overall quality of readily
as games (21%), coloring activities (9%), or other searchable smartphone apps for youth anxiety on
audio or visual distraction activities (9%). Roughly leading consumer marketplaces. Of great concern,
half of all study apps (53%) included relaxation evidence-based components for the treatment of
exercises (e.g., breathing exercises, guided imagery, youth anxiety were quite scant among sampled apps
progressive muscle relaxation), which was once on the consumer marketplace. The sampling strategy
considered to be an important element of anxiety yielded very few standalone, comprehensive treat-
treatment, but is now considered less essential ment or anxiety-management products. Although
and potentially counterproductive, and thus rarely roughly half of the sample had at least one evidence-
included in modern CBTs for youth anxiety. based treatment component, only a quarter of
apps incorporated more than one evidence-based
cost-related differences in treatment component. Given that consensus treat-
evidence-based content ment guidelines (e.g., Higa-McMillan et al., 2016)
Table 3 also includes data on the presence of evidence- emphasize the need for a multicomponent approach
based treatment components, broken down by app to treating youth anxiety (e.g., simultaneously
cost (i.e., free versus for-purchase). Among specific including psychoeducation, thought challenging,
evidence-based components, content related to cog- contingency management, and exposure exercises
nitions and thought challenging was significantly into a course of treatment), there is a clear need to
more common among apps costing money than increase the development and accessibility of more
among free apps. comprehensive self-management apps that leverage
256 bry et al.

multiple evidence-based treatment strategies. Indeed, friendly representations of traditional in-clinic con-
without any formal body assessing and recommend- cepts and out-of-session homework tasks such as
ing self-management apps to consumers (FDA, 2015; mood and thought tracking. These apps may be useful
Huckvale et al., 2015), the present findings suggest to clinicians who recommend them as adjuncts to in-
the possibility for consumers to encounter spurious clinic treatment and may increase out-of-session
or ill-equipped treatment apps for youth anxiety is homework compliance and overall engagement in
high. Encouragingly, at the time of this report, the treatment (see Jones et al., 2015). Relatedly, it is
American Psychiatric Association and the United important to focus on within-app features that can
Kingdom’s National Health Service in partnership improve engagement to mHealth interventions. Re-
with their National Information Board have both set cent work on practice elements related to engagement
out to endorse a range of self-management apps in traditional child and adolescent treatments shows
across mental health disorders to better guide five prominent elements: assessment, psychoeduca-
consumers towards quality digital treatment options tion, accessibility, attention to barriers to care, and
(APA Smartphone App Evaluation Task Force, 2016; goal setting (Becker, Boustani, Gellatly, & Chorpita,
National Information Board, 2015). 2017). Using these as a guide, the present sample
Evidence-based treatment of anxiety is generally of apps would yield poor results on assessment,
regarded as a multicomponent procedure consisting psychoeducation, and goal setting, although given the
largely of the content areas upon which apps were mobile platform and rising rates of access to
assessed (Chorpita & Daleiden, 2009). In addition smartphones, this sample might score well on the
to improving the flow of consumers toward quality accessibility and attention to barrier to care. Future
comprehensive self-management apps, consumers work examining engagement factors in mHealth
may also benefit from using a single quality app interventions is needed to fully consider the viability
dedicated to one practice element (e.g., thought of mobile phones as a treatment platform. Further,
restructuring) or a group of singularly focused research focusing on whether engagement-promoting
treatment apps (i.e., pairing an app with exposure- factors differ across mHealth and more traditional
based content with one geared toward thought face-to-face treatment delivery formats is needed to
restructuring). This more modular approach may inform mHealth adherence and the extent to which
better meet unique patient needs and symptom mHealth platforms may ultimately increase access to
profiles, similar to in-clinic modular treatment care. For example, researchers focusing specifically on
approaches (Chorpita, Taylor, Francis, Moffitt, & self-administered eHealth and mHealth engagement
Austin, 2004). Such a modular approach may also be have noted high rates of attrition from these
more feasible to implement, as comprehensive apps interventions (Christensen, Griffiths, & Farrer,
incorporating a range of evidence-based features are 2009). However, using the model of “supportive
highly complex and expensive for researchers and accountability,” or pairing a treatment app or website
programmers to create and maintain (Watts et al., with a human coach, researchers have found that just
2013). Similarly, usability research suggests that 10 minutes per week of coaching on engagement to
most individuals are accustomed to using mobile the intervention with no other delivery of therapeutic
phone apps in short bursts, and comprehensive, content by the coach can significantly reduce attrition
content-heavy mHealth apps may not align with and improve mental health outcomes (Mohr,
end-user habits (Vaish, Wyngarden, Chen, Cheung, Cuijpers, and Lehman, 2011). mHealth apps avail-
& Bernstein, 2014). Recent findings from a field trial able to consumers are beginning to incorporate
piloting a modular mHealth approach for adults human support strategies (e.g., Joyable, Coach.me),
consisting of a suite of 14 distinct mental health though none of the apps in this sample employed a
apps coordinated by a central app “hub” showed human coaching model. Future research on how
favorable reductions in depressive and anxious a human coaching model, or supportive account-
symptomatology (Mohr et al., 2017) and favorable ability, relates to children and adolescents or
engagement. Future research examining modular families utilizing mHealth interventions will be
mHealth approaches for youth problems is needed important for considering engagement to these
to inform the extent to which single, comprehensive treatment models.
treatment apps versus suites of modular, individual The present analysis found that less than 5% of the
practice element apps best promote user engagement sampled apps marketed for youth anxiety addressed
and symptom reduction. confidentiality. Research examining user attitudes
Moreover, endorsements for quality treatment apps and perceptions toward mHealth data security and
focused on a single practice element may additionally patient privacy shows that patients are indeed
benefit clinicians and patients already accessing concerned about the storage of personal health-
treatment. Apps can offer innovative and user- related data in digital spaces and potential secondary
child anxiety apps 257

use of such data (Atienza et al., 2015). With only 4% care may access quality care (Kazdin & Blasé, 2011).
of sampled apps containing a password protection or However, the present study suggests that currently,
a data security notice, the majority of apps for youth mHealth interventions developed in academic set-
anxiety may go against consumer comfort and tings for youth anxiety are not yet being disseminated
preferences. Despite recent proliferation of apps or made readily accessible to consumers. The
available to consumers on public platforms, these findings from this report underscore a need for
apps may be met with consumer distrust and strategies that help researchers better break into the
concerns over privacy. consumer marketplace to increase the availability of
Scholarly attention has frequently touted the evidence-based mHealth interventions. Without such
great potential for mHealth platforms to leverage efforts, the field of mHealth is poised to replicate the
advanced mobile features and innovations to well-documented research-to-practice gap associated
broaden intervention opportunities. One such area with traditional care models (Weisz, Jensen-Doss, &
of interest relates to the measurement and monitor- Hawley, 2006).
ing of physiological indices of anxiety (e.g., arousal, The present findings also summon questions
heart rate, sleep patterns). The importance of in situ related to a replication of other known barriers to
data for improving clinical assessment has been treatment. For example, significant differences were
emphasized (Aldao and De los Reyes, 2016; Davis, found between for-purchase apps and free apps in
May & Whiting, 2011; Silverman & Ollendick, their incorporation of cognitive restructuring and
2005), and smartphones offer the ability to capture in thought challenging. Often, financial considerations
situ data via sensors and ecological momentary can regrettably impact the quality of care received in
assessment and integrate this information into the traditional office-based care, but technology may
intervention itself to provide “just-in-time,” “in-the- offer needed opportunities to balance the accessibility
moment” treatment content to users. Indeed, eco- of evidence-based treatment. As the field of mHealth
logical momentary interventions for anxiety are continues to evolve, caution must be taken to avoid
gaining empirical support and scholarly attention perpetuating disparities in the quality of available
(Schueller, Aguilera, & Mohr, 2017). Yet, the services.
present findings suggest that the vast majority of
readily accessible smartphone apps for youth anxiety limitations and future directions
on the consumer marketplace lag behind scholarly Several study limitations warrant comment. First,
enthusiasm in this area. Research focusing on EMA although the present methodology attempted to
and sensors is a burgeoning area, although to date, replicate common consumer search strategies to
the majority of studies relating these to mental health identify youth anxiety apps, the present findings
outcomes have utilized only small samples (Mohr, may not generalize to apps identified via other search
Zhang, et al., 2017). However, with continued strategies. However, little is presently known about
advances, and as “wearable” devices and “tracking” the precise search patterns of consumers seeking to
personal data gain traction in the consumer market, a identify youth anxiety apps. For example, the present
key future direction will be integrating objective use of the search term “stress” as a hypothesized
sensor data and evidence-based assessment of layperson synonym for “anxiety” may have influ-
physiological anxiety responses with interventions enced the search results. Many apps meeting
that are both accessible to consumers and make use selection criteria encouraged user download of
of these data through actionable intervention. non-evidence-based distraction tools like coloring
Moreover, apps incorporating such advanced books and games through statements that claimed
functionalities (often developed in academia) do not these activities could decrease user stress. It is
appear to be meaningfully penetrating the consumer possible that restricting study search terms to just
marketplace. Despite opportunities for smartphone the more clinical and technical term “anxiety” may
apps to bridge gaps between research and practice have yielded a sample with more favorable incorpo-
that have been observed with regard to traditional ration of evidence-based treatment components.
clinic-based care, researchers must be cautious about Further work engaging consumers in generating
replicating a similar research-to-practice gap in the search terms and examining the apps naturally
arena of mHealth. Traditionally, research shows an selected by consumers may provide a more general-
18-year gap from the point of intervention develop- izable view of digital consumption.
ment to widespread dissemination (Westfall et al., Importantly, some high-quality treatment apps
2007). Technology has the potential to serve as an did not make it into the present analysis based on
agile platform through which supported interven- this consumer-based search strategy. For example,
tions may be more quickly disseminated and through the app SmartCAT (Pramana, Parmanto, Kendall,
which larger proportions of individuals in need of & Silk, 2014), an mHealth platform delivering CBT
258 bry et al.

to children with anxiety, is an intervention devel- components, it is nonetheless possible that sampled
oped in academia that incorporates EMA, a apps are effective and include other active elements.
therapist portal and monitoring system, and all 7 Randomized evaluations formally examining the
evidence-based treatment components included for effectiveness of leading consumer products for
content analysis in the present study. However, at reducing youth anxiety would complement the
the time of the study’s app search and selection, and present analysis and help determine the state of
at the time of this report, the SmartCAT app is still readiness for private-sector mHealth products to
not included in the top 30 search results of any of meet consumer mental health needs.
the 16 search terms used, despite its presence on Further, this analysis represents a snapshot of
the Google Play Store. Little is known about accessible consumer-marketed anxiety apps from
how search results are generated within app stores 2016, and it is possible that conducting the same
(e.g., what determines an app’s position as 3rd in a study at a different time could yield different results.
search, versus 30th in that same search) and To partially account for potential fluctuations on
whether quality apps would have appeared using the consumer marketplace, apps were only included
the set of search terms if apps had been culled for content review if they demonstrated stable
beyond the top 30. Big data mining of app accessibility by maintaining their presence on the
marketplaces could yield important information marketplace across a 6-month study window.
related to both consumer search patterns and Relative stability of the youth anxiety app market-
search result rankings, which could then inform places was observed, with over 90% of the initially
consumer health literacy as well as researcher identified apps still available on the marketplace 6
efforts to make quality, evidence-based interven- months later.
tions more accessible to consumers. Unfortunately, Finally, given considerable variability in the
this data is privately owned through the Google and number of screens and functionalities across apps,
Apple corporations and would require specific we standardly selected the app description pages
permissions and access in order to be utilized for (which all apps include) to assess app reading level.
these purposes. Ultimately, it is important to keep Importantly, the reading level of an app’s descrip-
in mind the scope of this current analysis as a tion page may not be representative of the reading
consumer-driven framework. Thus, these are the level of the actual app. That said, in this consumer-
apps that appear to consumers who may be focused review, a description page may act as a
searching for self-management apps using common “gatekeeper” to the actual app itself, with users
search terms, and these are the apps marketing judging app content based on what is marketed and
themselves toward symptom management, regard- how it is marketed in the description page. Reading
less of the actual scope of content therein. level of this content, therefore, may impact the
Second, the present focus on evidence-based extent to which apps are eventually downloaded by
treatment components predominantly emphasized users and ultimately their accessibility to consumers.
cognitive-behavioral strategies. While CBT is con-
sidered the current gold-standard psychosocial conclusion
intervention for youth anxiety (Walkup et al., Despite limitations, the present study adds to a
2008) and relevance mapping of randomized- growing body of literature indicating that relatively
controlled trials for youth anxiety formed the little evidence-based treatment content is currently
foundation of treatment component focus, it is included in the majority of consumer-marketed
possible that this lens failed to capture other mental health apps for a range of clinical targets
potentially useful intervention methods. Indeed, (Juarascio et al., 2015; Shen et al., 2015). Given the
some have cautioned developers away from high prevalence, early onset, stability and impair-
attempting to directly mimic in-clinic sessions and ment associated with youth anxiety disorders, and
tools in behavioral intervention technologies given given that today’s children, teens, and families are
limitations associated with traditional face-to-face more digitally connected than any previous genera-
treatments as well as the potential to restrict design, tion (Pew Research Center, 2015), self-management
innovation and creativity (Schueller et al., 2013). of anxiety symptoms through mobile platforms may
Third, the present findings indicate that the most represent a developmentally appropriate treatment
readily accessible apps that are marketed for youth opportunity with significant public health potential.
anxiety are not strongly grounded in evidence- However, the present findings raise concerns about
based treatment content. That said, formal investi- the quality of the majority of accessible smartphone
gations have not been conducted testing the efficacy apps marketed for youth anxiety. The present
of leading consumer apps on the marketplace. findings also highlight how, at present, smartphone
Despite the absence of evidence-based treatment apps that are most readily available to consumers
child anxiety apps 259

contain relatively simplistic functionality and do not the distillation and matching model to 615 treatments from
yet incorporate the more advanced data collection 322 randomized trials. Journal of Consulting and Clinical
Psychology, 77(3), 566–579. http://dx.doi.org/10.1037/
and intervention strategies touted in the mHealth a0014565
literature. The present examination also shows that Chorpita, B. F., Taylor, A. A., Francis, S. E., Moffitt, C., &
despite the existence of higher quality apps developed Austin, A. A. (2004). Efficacy of modular cognitive behavior
and evaluated in research settings and in the private therapy for childhood anxiety disorders. Behavior Therapy,
sector, such comprehensive self-management options 35(2), 263–287. http://dx.doi.org/10.1016/S0005-
7894(04)80039-X
that incorporate evidence-based treatment compo- Chou, T., Bry, L. J., & Comer, J. S. (2017a). Multimedia field test:
nents are not highly visible to consumers and Evaluating the creative ambitions of SuperBetter and its quest to
therefore will expectedly have limited reach. Future gamify mental health. Cognitive and Behavioral Practice, 24,
mHealth efforts would do well to explore strategies 115–120. http://dx.doi.org/10.1016/j.cbpra.2016.10.002
for researchers to better break into the consumer Chou, T., Bry, L. J., & Comer, J. S. (2017b). Overcoming
traditional barriers only to encounter new ones: Doses of
marketplace to increase the visibility and therefore caution and direction as technology-enhanced treatments
accessibility of quality mHealth interventions. begin to “go live.”Clinical Psychology: Science and Practice.
Conflict of Interest Statement http://dx.doi.org/10.1111/cpsp.12196
Christensen, H., Griffiths, K. M., & Farrer, L. (2009).
The authors declare there are no conflicts of interest. Adherence in internet interventions for anxiety and depression:
systematic review. Journal of Medical Internet Research, 11(2),
References e13. http://dx.doi.org/10.2196/jmir.1194.
Comer, J. S., & Barlow, D. H. (2014). The occasional case
against broad dissemination and implementation: Retaining
Aldao, A., & De los Reyes, A. (2016). Introduction to a role for specialty care in the delivery of psychological
the special section: Toward implementing physiological treatments. American Psychologist, 69, 1–18. http://dx.doi.
measures in clinical assessments of adult mental health. org/10.1037/a0033582
Journal of Psychopathology and Behavioral Assessment, Comer, J. S., Blanco, C., Grant, B., Hasin, D., Liu, S. M.,
38(1), 1–4. http://dx.doi.org/10.1007/s10862-015-9521-y Turner, J. B., & Olfson, M. (2011). Health-related quality of
Anton, M. T., Jones, D. J., Cuellar, J., Forehand, R., Gonzalez, life across the anxiety disorders: Results from the National
M., Honeycutt, A., . . . Pitmman, S. (2016). Caregiver use of Epidemiologic Survey on Alcohol and Related Conditions.
the core components of technology-enhanced Helping the Journal of Clinical Psychiatry, 72, 43–50. http://dx.doi.org/
Noncompliant Child: A case series analysis of low-income 10.4088/JCP.09m05094blu
families. Cognitive and Behavioral Practice, 23, 194–204. Compton, S. N., March, J. S., Brent, D., Albano, A. M., Weersing,
http://dx.doi.org/10.1016/j.cbpra.2015.04.005 R., & Curry, J. (2004). Cognitive-behavioral psychotherapy for
APA Smartphone App Evaluation Task Force. (2016). APA anxiety and depressive disorders in children and adolescents:
Task Force to Develop Guidelines to Assess Apps, Wearable An evidence-based medicine review. Journal of the American
Sensors. Retrieved from: http://psychnews.psychiatryonline. Academy of Child and Adolescent Psychiatry, 43(8), 930–959.
org/doi/full/10.1176%2Fappi.pn.2016.2a10. http://dx.doi.org/10.1097/01.chi.0000127589.57468.bf
Atienza, A. A., Zarcadoolas, C., Vaughon, W., Hughes, P., Costello, E. J., Egger, H. L., & Angold, A. (2005). The develop-
Patel, V., Chou, W. Y. S., & Pritts, J. (2015). Consumer mental epidemiology of anxiety disorders: Phenomenology,
attitudes and perceptions on mhealth privacy and security: prevalence and comorbidity. Child and Adolescent Psychiatric
findings from a mixed-methods study. Journal of Health Clinics of North America, 14(4), 631–648. http://dx.doi.org/
Communication, 20(6), 673–679. http://dx.doi.org/10. 10.1016/j.chc.2005.06.003
1080/10810730.2015.1018560 Crawford, A. M., & Manassis, K. (2011). Anxiety, social
Becker, K. D., Boustani, M., Gellatly, R., & Chorpita, B. F. skills, friendship quality, and peer victimization: An
(2017). Forty Years of Engagement Research in Children’s integrated model. Journal of Anxiety Disorders, 25(7),
Mental Health Services: Multidimensional Measurement and 924–931. http://dx.doi.org/10.1016/j.janxdis.2011.05.005
Practice Elements. Journal of Clinical Child & Adolescent Davis, T. E., May, A., & Whiting, S. E. (2011). Evidence-based
Psychology, 1–23. http://dx.doi.org/10.1080/15374416. treatment of anxiety and phobia in children and adolescents:
2017.1326121 Current status and effects on the emotional response. Clinical
Boulos, M. N. K., Wheeler, S., Tavares, C., & Jones, R. (2011). Psychology Review, 31(4), 592–602. http://dx.doi.org/10.
How smartphones are changing the face of mobile and 1016/j.cpr.2011.01.001
participatory health care: An overview, with example from Dogruel, L., Joeckel, S., & Bowman, N. D. (2015). Choosing the
eCAALYX. Biomedical Engineering Online, 10, 24–38. right app: An exploratory perspective on heuristic decision
http://dx.doi.org/10.1186/1475-925X-10-24 processes for smartphone app selection. Mobile Media &
Bunnell, B. E., Davidson, T. M., Dewey, D., Price, M., & Communication, 3(1), 125–144. http://dx.doi.org/10.1177/
Ruggiero, K. J. (2016). Rural and Urban/Suburban Families’ 2050157914557509
Use of a Web-Based Mental Health Intervention. Telemedicine Derose, K. P., & Baker, D. W. (2000). Limited English
and e-Health, 23(5), 390–396. http://dx.doi.org/10.1089/tmj. proficiency and Latinos’ use of physician services. Medical
2016.0153 Care Research and Review, 57(1), 76–91. http://dx.doi.org/
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2014). 10.1177/107755870005700105
Mobile tele-mental health: increasing applications and a Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M. -R., &
move to hybrid models of care. Health care, 2, 220–233. Christensen, H. (2013). Smartphones for Smarter Delivery
http://dx.doi.org/10.3390/health care2020220 of Mental Health Programs: A Systematic Review. Journal
Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence- of Medical Internet Research, 15(11), e247–e260. http://dx.
based treatments for children and adolescents: application of doi.org/10.2196/jmir.2791
260 bry et al.

Egger, H. L., & Angold, A. (2006). Common emotional and Review, 28(3), 451–471. http://dx.doi.org/10.1016/j.cpr.2007.
behavioral disorders in preschool children: presentation, 07.012
nosology, and epidemiology. Journal of Child Psychology Kendall, P. C., Robin, J. A., Hedtke, K. A., Suveg, C., Flannery-
and Psychiatry, 47(3), 313–337. http://dx.doi.org/10.1111/ Schroeder, E., & Gosch, E. (2005). Considering CBT with
j.1469-7610.2006.01618.x anxious youth? Think exposures. Cognitive and Behavioral
Ehrenreich-May, J., Rosenfield, D., Queen, A. H., Kennedy, S. M., Practice, 12, 136–150. http://dx.doi.org/10.1016/S1077-
Remmes, C. S., & Barlow, D. H. (2016). An initial waitlist- 7229(05)80048-3
controlled trial of the unified protocol for the treatment of Krebs, P., & Duncan, D. T. (2015). Health app use among US
emotional disorders in adolescents. Journal of Anxiety mobile phone owners: a national survey. JMIR mHealth and
Disorders, 46, 46–55. http://dx.doi.org/10.1016/j.janxdis. uHealth, 3(4), e101–e113. http://dx.doi.org/10.2196/mhealth.
2016.10.006 4924
Fleiss, J. L. (1971). Measuring nominal scale agreement March, S., Spence, S. H., & Donovan, C. L. (2009). The efficacy
among many raters. Psychological Bulletin, 76(5), 378–382. of an internet-based cognitive-behavioral therapy intervention
http://dx.doi.org/10.1037/h0031619 for child anxiety disorders. Journal of Pediatric Psychology,
Food and Drug Administration, (2015). Policy for low risk 34(5), 474–487. http://dx.doi.org/10.1093/jpepsy/jsn099
devices. Retrieved from: http://www.fda.gov/downloads/ Merikangas, K. R., He, J. -P., Burstein, M., Swanson, S. A.,
medicaldevices/deviceregulationandguidance/guidance Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen,
documents/ucm429674.pdf J. (2010). Lifetime prevalence of mental disorders in US
Greco, L. A., & Morris, T. L. (2005). Factors influencing the link adolescents: Results from the national comorbidity study-
between social anxiety and peer acceptance: Contributions of adolescent supplement (NCS-A). Journal of the American
social skills and close friendships during middle childhood. Academy of Child and Adolescent Psychiatry, 49(10),
Behavior Therapy, 36(2), 197–205. http://dx.doi.org/10. 980–989. http://dx.doi.org/10.1016/j.jaac.2010.05.017
1016/S0005-7894(05)80068-1 Mohr, D., Cuijpers, P., & Lehman, K. (2011). Supportive
Hedman, E., El Alaoui, S., Lindefors, N., Andersson, E., Rück, C., accountability: a model for providing human support to
Ghaderi, A., . . . Ljótsson, B. (2014). Clinical effectiveness enhance adherence to eHealth interventions. Journal of
and cost-effectiveness of Internet-vs. group-based cognitive Medical Internet Research, 13(1), e30–e41. http://dx.doi.
behavior therapy for social anxiety disorder: 4-year follow-up org/10.2196/jmir.1602
of a randomized trial. Behaviour Research and Therapy, 59, Mohr, D. C., Ho, J., Duffecy, J., Baron, K. G., Lehman, K. A., Jin,
20–29. http://dx.doi.org/10.1016/j.brat.2014.05.010 L., & Reifler, D. (2010). Perceived barriers to psychological
Higa-McMillan, C. K., Francis, S. E., Rith-Najarian, L., & treatments and their relationship to depression. Journal of
Chorpita, B. F. (2016). Evidence base update: 50 years of Clinical Psychology, 66(4), 394–409. http://dx.doi.org/10.
research on treatment for child and adolescent anxiety. 1002/jclp.20659
Journal of Clinical Child and Adolescent Psychology, 45, Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L.,
91–113. http://dx.doi.org/10.1080/15374416.2015. Kwasny, M. J., Weingardt, K., . . . Caccamo, L. (2017).
1046177 IntelliCare: An Eclectic, Skills-Based App Suite for the
Hilty, D. M., Cobb, H. C., Neufeld, J. D., Bourgeois, J. A., & Treatment of Depression and Anxiety. Journal of Medical
Yellowlees, P. M. (2008). Telepsychiatry reduces geographic Internet Research, 19(1), e10–e24. http://dx.doi.org/10.
physician disparity in rural settings, but is it financially 2196/jmir.6645
feasible because of reimbursement? Psychiatric Clinics of Mohr, D. C., Zhang, M., & Schueller, S. (2017). Personal sensing:
North America, 31(1), 85–94. http://dx.doi.org/10.1016/j. Understanding mental health using ubiquitous sensors and
psc.2007.11.010 machine learning. Annual Review of Clinical Psychology, 13(1),
Huckvale, K., Prieto, J. T., Tilney, M., Benghozi, P. J., & Car, J. 23–47. http://dx.doi.org/10.1146/annurev-clinpsy-032816-
(2015). Unaddressed privacy risks in accredited health 044949
and wellness apps: a cross-sectional systematic assessment. Mojtabai, R. (2005). Trends in contacts with mental health
BMC Medicine, 13(1), 214–227. http://dx.doi.org/10.1186/ professionals and cost barriers to mental health care among
s12916-015-0444-y adults with significant psychological distress in the United
Jones, D. J., Anton, M., Gonzalez, M., Honeycutt, A., Khavjou, States: 1997-2002. American Journal of Public Health, 95(11),
O., Forehand, R., & Parent, J. (2015). Incorporating mobile 2009–2014. http://dx.doi.org/10.2105/AJPH.2003.037630
phone technologies to expand evidence-based care. Cognitive Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B.,
and Behavioral Practice, 22, 281–290. http://dx.doi.org/10. Wang, P. S. … Kessler, R. C. (2011). Barriers to mental
1016/j.cbpra.2014.06.002 health treatment: Results from the national comorbidity
Jones, D. J., Forehand, R., Cuellar, J., Parent, J., Honeycutt, A., survey replication (NCS-R). Psychological Medicine, 41(8),
Khavjou, O., . . . Newey, G. A. (2014). Technology- 1751–1761. http://dx.doi.org/10.1017/S0033291710002291
enhanced program for child disruptive behavior disorders: Muñoz, R. F. (2010). Using evidence-based internet interventions
Development and pilot randomized control trial. Journal of to reduce health disparities worldwide. Journal of Medical
Clinical Child and Adolescent Psychology, 43, 88–101. Internet Research, 12(5), e60–e70. http://dx.doi.org/10.2196/
http://dx.doi.org/10.1080/15374416.2013.822308 jmir.1463
Juarascio, A. S., Manasse, S. M., Goldstein, S. P., Forman, E. M., & National Information Board. (2015). Policy paper: NIB work-
Butryn, M. L. (2015). Review of smartphone applications for streams explain how we plan to improve digital services by
the treatment of eating disorders. European Eating Disorders making it easier for the public to access health and care
Review, 23(1), 1–11. http://dx.doi.org/10.1002/erv.2327 information. Retrieved from: https://www.gov.uk/government/
Kazdin, A. E., & Blasé, S. L. (2011). Rebooting psychotherapy publications/national-information-boards-workstreams.
research and practice to reduce the burden of mental illness. Pew Research Center. (2017). Health fact sheet. Retrieved from:
Perspectives on Psychological Science, 6(1), 21–37. http:// http://www.pewinternet.org/fact-sheets/health-fact-sheet/ .
dx.doi.org/10.1177/1745691610393527 Pew Research Center. (2015). Technology device ownership.
Kearney, C. A. (2008). School absenteeism and school refusal Retrieved from: http://www.pewinternet.org/2015/10/29/
behavior in youth: A contemporary review. Clinical Psychology technology-device-ownership-2015/.
child anxiety apps 261

Pramana, G., Parmanto, B., Kendall, P. C., & Silk, J. S. (2014). The Vaish, R., Wyngarden, K., Chen, J., Cheung, B., & Bernstein,
SmartCAT: an m-health platform for ecological momentary M. S. (2014, April). Twitch crowdsourcing: crowd contri-
intervention in child anxiety treatment. Telemedicine and butions in short bursts of time. In Proceedings of the 32nd
e-Health, 20(5), 419–427. http://dx.doi.org/10.1089/tmj.2013. annual ACM conference on Human factors in computing
0214 systems (pp. 3645–3654).
Price, M., Yuen, E. K., Davidson, T. M., Hubel, G., & Ruggiero, Walkup, J. T., Albano, A. M., Piacentini, J., Birmaher, B.,
K. J. (2015). Access and completion of a web-based treatment Compton, S. N., Sherrill, J. T. . . . Kendall, P. C. (2008).
in a population-based sample of tornado-affected adolescents. Cognitive behavioral therapy, sertraline, or a combination
Psychological Services, 12(3), 283–290. http://dx.doi.org/10. in childhood anxiety. The New England Journal of
1037/ser0000017 Medicine, 359(26), 2753–2766. http://dx.doi.org/10.1056/
Sareen, J., Jagdeo, A., Cox, B. J., Clara, I., ten Have, M., Belik, NEJMoa0804633
S.L., de Graaf, R., & Stein, M. B. (2007). Perceived barriers to Wang, P. S., Lane, M., Olfson, M., Pincus, H. A., Wells, K. B.,
mental health service utilization in the United States, Ontario, & Kessler, R. C. (2005). Twelve-month use of mental health
and the Netherlands. Psychiatric Services, 58(3), 357–364. services in the United States: Results from the national
http://dx.doi.org/10.1176/ps.2007.58.3.357 comorbidity survey replication. Archives of General Psychiatry,
Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017). Ecological 62(6), 629–640. http://dx.doi.org/10.1001/archpsyc.62.6.629
momentary interventions for depression and anxiety. Washington State Institute for Public Policy. (2015). Remote
Depression and Anxiety, 34(6), 540–545. http://dx.doi.org/10. cognitive behavioral therapy (CBT) for anxious children.
1002/da.22649 Retrieved from: http://wsipp.wa.gov/BenefitCost/Program/64.
Schueller, S. M., Muñoz, R. F., & Mohr, D. C. (2013). Realizing Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L.,
the potential of behavioral intervention technologies. Williams, A., & Andrews, G. (2013). CBT for depression:
Current Directions in Psychological Science, 22(6), 478–483. a pilot RCT comparing mobile phone vs. computer. BMC
http://dx.doi.org/10.1177/0963721413495872 Psychiatry, 13(1), 49–58. http://dx.doi.org/10.1186/1471-
Schweitzer, J., & Synowiec, C. (2012). The economics of eHealth 244X-13-49
and mHealth. Journal of Health Communication, 17(sup1), Weiner, C. L., Elkins, R. M., Pincus, D. B., & Comer, J. S.
73–81. http://dx.doi.org/10.1080/10810730.2011.649158 (2015). Anxiety sensitivity and sleep-related problems in
Shen, N., Levitan, M. -J., Johnson, A., Bender, J. L., Hamilton- anxious youth. Journal of Anxiety Disorders, 32, 66–72.
Page, M., Jadad, A. R., & Wiljer, D. (2015). Finding a http://dx.doi.org/10.1016/j.janxdis.2015.03.009
Depression App: A Review and Content Analysis of the Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006).
Depression App Marketplace. Journal of Medical Internet Evidence-based youth psychotherapies versus usual clinical
Research: mHealth and uHealth, 3(1), e16–e34. http://dx. care: a meta-analysis of direct comparisons. American
doi.org/10.2196/mhealth.3713 Psychologist, 61(7), 671–689. http://dx.doi.org/10.1037/0003-
Siegel, R. S., La Greca, A. M., & Harrison, H. M. (2009). Peer 066X.61.7.671
victimization and social anxiety in adolescents: Prospective and Westfall, J., Mold, J., & Fagnan, L. (2007). Practice-based
reciprocal relationships. Journal of Youth and Adolescence, research – “Blue Highways” on the NIH roadmap. Journal
38(8), 1096–1109. http://dx.doi.org/10.1007/s10964-009- of the American Medical Association, 297(4), 403–406.
9392-1 http://dx.doi.org/10.1001/jama.297.4.403
Silverman, W. K., & Ollendick, T. H. (2005). Evidence-based Whiteside, S. P. H. (2016). Mobile device-based applications for
assessment of anxiety and its disorders. Journal of Clinical childhood anxiety disorders. Journal of Child and Adolescent
Child and Adolescent Psychology, 34, 380–411. http://dx. Psychopharmacology, 26, 246–251. http://dx.doi.org/10.
doi.org/10.1080/15374410701817907 1089/cap.2015.0010
Silverman, W. K., Pina, A. A., & Viswesvaran, C. (2008). Wierzbicki, M., & Pekarik, G. (1993). A meta-analysis of
Evidence-based psychosocial treatments for phobic and psychotherapy dropout. Professional Psychology: Research
anxiety disorders in children and adolescents. Journal of and Practice, 24(2), 190–195. http://dx.doi.org/10.1037/
Clinical Child and Adolescent Psychology, 37, 104–130. 0735-7028.24.2.190
http://dx.doi.org/10.1080/15374410701817907 Woodward, L. J., & Fergusson, D. M. (2001). Life course
Spence, S. H., Holmes, J. M., March, S., & Lipp, O. V. (2006). outcomes of young people with anxiety disorders in
The feasibility and outcome of clinic plus internet delivery adolescence. Journal of the American Academy of Child
of cognitive-behavior therapy for childhood anxiety. Journal and Adolescent Psychiatry, 40(9), 1086–1093. http://dx.doi.
of Consulting and Clinical Psychology, 74(3), 614–621. org/10.1097/00004583-200109000-00018
http://dx.doi.org/10.1037/0022-006X.74.3.614 Wu, P., Goodwin, R., Comer, J. S., Hoven, C., & Cohen, P.
Thomas, K. C., Ellis, A. R., Konrad, T. R., Holzer, C. E., & (2010). The relationship between anxiety disorders and
Morrissey, J. P. (2009). County-level estimates of mental substance use among adolescents in the community:
health professional shortage in the United States. Psychiatric Specificity and gender differences. Journal of Youth and
Services, 60(10), 1323–1328. http://dx.doi.org/10.1176/ps. Adolescence, 39, 177–188. http://dx.doi.org/10.1007/
2009.60.10.1323 s10964-008-9385-5
Torous, J., Friedman, R., & Keshavan, M. (2014). Smartphone
ownership and interest in mobile applications to monitor
symptoms of mental health conditions. JMIR mHealth and R E C E I V E D : May 5, 2017
uHealth, 2(1), e2–e10. http://dx.doi.org/10.2196/mhealth. A C C E P T E D : July 25, 2017
2994 A V A I L A B L E O N L I N E : 29 July 2017

You might also like