Download as pdf or txt
Download as pdf or txt
You are on page 1of 17

Available online at www.sciencedirect.

com

ScienceDirect
Cognitive and Behavioral Practice 28 (2021) 393–409

www.elsevier.com/locate/cabp

A Single-Session Workshop to Enhance Emotional Awareness


and Emotion Regulation for Graduate Students: A Pilot Study
Emily E. Bernstein, Harvard University
Nicole J. LeBlanc and Kate H. Bentley, Massachusetts General Hospital
Paul J. Barreira, Harvard University Health Services
Richard J. McNally, Harvard University

Emerging adults are at substantial risk for developing or worsening psychopathology and university students appear to be
particularly vulnerable. Interventions targeted at these young adults that can mitigate transdiagnostic causal risk factors
or burgeoning mental health problems have the potential to make a large impact. We aimed to develop and pilot test an
accessible, single-session, transdiagnostic group intervention with the goals of enhancing emotion regulation skills and
reducing risk for mental health problems in graduate students. The intervention included psychoeducation, skills instruc-
tion (e.g., mindful emotion awareness, cognitive flexibility, countering emotion-driven behaviors), group discussion, and
supervised practice based on content from the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders. The
pilot program demonstrated strong feasibility and acceptability. Baseline, 1-month, and 3-month follow-up surveys also
suggested benefits for reducing emotional avoidance and suppression, increasing use of cognitive reappraisal, and reduc-
ing symptoms of depression and neuroticism. Graduate students have seldom been the beneficiaries of university-based
intervention and prevention research. Furthermore, most college and university mental health centers do not have the
capacity to provide psychoeducation, preventative, or early intervention services to the many students who need or could
benefit from them. Results suggest that future iterations of this intervention could address such barriers to meaningfully
supporting emerging adults in graduate school.

Mental Health in Emerging Adulthood disorders and substance use (Hankin & Abramson,

E MERGING adulthood (broadly defined as ages


2001; Leebens & Williamson, 2017; Masten et al.,
18–30 in high-income countries) is a period of 2008). This risk appears to be increasing in younger
profound change (Arnett, 2000). During this time, cohorts, who are experiencing severe anxiety, depres-
young people experience neurodevelopmental sion, and psychological distress at substantially higher
changes that support emotion regulation abilities, as rates than older generations (Twenge, 2000; Twenge
well as increased facility with adaptive emotion regula- et al., 2019). Further, college and university students
tion strategies (Taber-Thomas & Perez-Edgar, 2015; are particularly vulnerable to increases in psy-
Zimmermann & Iwanski, 2014). These changes enable chopathology (Booth et al., 2016).
emerging adults to cope with an increasingly complex Emerging adults enrolled in graduate school experi-
and fluctuating social environment, as well as educa- ence major life transitions, stress, and uncertainty
tional and occupational challenges. Emerging adults (Gewin, 2012). Popular press and academic reports
who struggle to navigate this developmental stage, how- alike highlight the widespread, but relatively under-
ever, appear to be at substantial risk for developing or studied, mental health problems in graduate schools.
worsening psychopathology, particularly emotional Common sources of distress include issues of negative
social comparison, self-consciousness and fears of judg-
ment, perseveration on setbacks and struggles, fear of
Keywords: unified protocol; emotion regulation; transdiagnostic; failure, and general anxiety (Di Pierro, 2017; Troop,
cognitive-behavioral therapy; graduate students 2011). Graduate students across fields of study are
1077-7229/20/Ó 2021 Association for Behavioral and Cognitive more likely to experience anxiety and depression
Therapies. Published by Elsevier Ltd. All rights reserved. compared to the general public (Di Pierro, 2017;
394 Bernstein et al.

Garcia-Williams et al., 2014; Levecque et al., 2017). Fur- care providers across the country (Thomas et al.,
thermore, graduate students appear at elevated risk for 2009).
suicide thoughts and behaviors; an estimated 15% of Students experience numerous barriers to treat-
graduate students report lifetime, serious suicidal idea- ment—for example, most interventions used at health
tion or self-harm, 7.3% within the past 2 weeks, and 5– centers and in the community require multiple ses-
10% have a history of suicide attempts (Drum et al., sions, making them impractical or unappealing for
2009; Garcia-Williams et al., 2014). In comparison, many busy students. Young people also identify stigma,
4.3% of the general population over the age of 18 perceived lack of need for treatment, and faculty’s atti-
(4.7% of those ages 26–49) reports serious thoughts tudes about treatment as additional barriers to even
of suicide, and just 0.5% a history of attempts seeking treatment (Dearing et al., 2005; Eisenberg
(Substance Abuse and Mental Health Services et al., 2007; Gaddis et al., 2018; Thomas et al., 2014).
Administration, 2019). Reports of mental health prob- Although an estimated half of students experience
lems among graduate students have been associated mental health concerns in a given year, a minority
with feelings of loneliness and lack of social support, report ever using mental health services, with estimates
competitiveness of academic program, poor work–life ranging from 30% to less than 20% (Hyun et al., 2006;
balance, lack of support from advisors, number of Rummell, 2015). Treatment-seeking behavior is fur-
semesters spent in school, financial concerns, identify- ther reduced among students of color, relative to
ing as female, transgender, or nonbinary, and being a White peers, and is particularly low among Asian and
sexual minority or international student (Di Pierro, Asian American students (Lipson et al., 2018). With
2017; Garcia-Williams et al., 2014; Hyun et al., 2006; so many students in the United States meeting criteria
Rummell, 2015). for a mental disorder in the past year and many more
at risk or experiencing subthreshold symptoms, the
Mental Health Services on College/ current paradigm of individual-based, long-term treat-
University Campuses ment is unlikely to be feasible for addressing these
problems. Thus, there is an urgent need for brief and
These statistics make it clear that emerging adults
scalable prevention and early intervention programs
enrolled in graduate school are at elevated risk for psy-
on college and university campuses that can better
chopathology. Importantly, however, this phase also
reach students (Kazdin & Rabbitt, 2013; Schleider &
seems ideal for engaging empirically supported preven-
Weisz, 2017).
tion and early intervention efforts for emotional disor-
ders (Tyssen et al., 2001). Interventions targeted at
these young adults that can mitigate transdiagnostic, Promise of Brief Preventive Group
modifiable risk factors or burgeoning mental health Interventions
problems have the potential to make a large impact Given the rising rates of psychopathology in emerg-
and shift mental health trajectories across the life span. ing adults and college/university campuses’ difficulties
However, graduate students have seldom been the ben- meeting these needs, we aimed to develop and pilot
eficiaries of university-based intervention and preven- test an accessible, transdiagnostic group intervention
tion research. Furthermore, most college and with the goals of enhancing emotion regulation skills
university mental health centers do not have the capac- and reducing risk for mental health problems in grad-
ity to provide psychoeducation, preventative, or early uate students. The intervention included psychoeduca-
intervention services to the many students (graduate tion, skills instruction, group discussion, and
and undergraduate) who need or could benefit from supervised practice based on content from the Unified
them. This is especially true among graduate popula- Protocol for Transdiagnostic Treatment of Emotional
tions as on-campus mental health resources are fre- Disorders (UP; Barlow, Ellard, et al., 2017; Barlow,
quently targeted for undergraduates. According to Farchione, et al., 2017; Barlow et al., 2011). The UP
the most recent Association for University and College is an evidence-based cognitive-behavioral treatment
Counseling Center Directors (AUCCCD) annual sur- developed by Barlow and colleagues to apply across
vey, of the 621 centers involved, 64.7% reported need- the full range of anxiety, depressive, and related disor-
ing more service hours to meet student needs, almost ders (including subthreshold symptoms; Barlow,
half implement session limits, and approximately one Ellard, et al., 2017; Barlow, Farchione, et al., 2017;
third had wait-lists (LeViness et al., 2017). Additionally, Barlow et al., 2004). Through core skills modules
centers reported increases in time spent providing (e.g., mindful emotion awareness, cognitive flexibility,
direct services at the expense of indirect services, such countering emotion-driven behaviors), the UP teaches
as training, supervision, and consultation. This pattern adaptive, nonavoidant strategies for responding to
parallels the larger trend of a shortage of mental health intense emotions (Ellard et al., 2010; Sauer-Zavala
Transdiagnostic CBT Workshop for Graduate Students 395

et al., 2012). Randomized trials have indicated high hours. And, only a small number have been designed
rates of treatment response (e.g., significant improve- for graduate students (Conley et al., 2013, 2015,
ments in symptom [anxiety, depression] severity, levels 2017). Within this subgroup, most focus on general
of negative affect, and daily functioning) to the UP that stress management or mindfulness and meditation
were maintained at 6-month and 12-month follow-ups techniques and have specifically targeted students in
(Barlow & Farchione, 2018; Bullis et al., 2014; medical or other clinical fields (Jones & Johnston,
Farchione et al., 2012). 2000; Kao et al., 2014; McGrady et al., 2012; Shapiro
To date, the UP has been successfully adapted to et al., 2007). For these reasons, there have been calls
treat a variety of target populations. The vast majority for more innovation in reaching graduate students
of empirical support has been demonstrated for (Conley et al., 2017; Garcia-Williams et al., 2014)
patients with anxiety and obsessive–compulsive disor- We built on these earlier works to adapt the UP for
ders (for which it appears to be as effective as gold- graduate students and sought to address some
standard diagnosis-specific interventions; e.g., Barlow, reported barriers to treatment seeking in a few ways.
Ellard, et al., 2017; Barlow, Farchione, et al., 2017), First, the intervention was a single session and utilized
and comorbid unipolar and bipolar depressive disor- a group format, limiting the investment required of
ders (Boswell et al., 2014; Ellard et al., 2017). The UP participants. This design builds on promising evidence
has shown preliminary empirical support in case series, that brief and even single-session interventions can be
small open trials, or single-case experimental design as, and in some cases more, effective than traditional
studies for posttraumatic stress disorder, alcohol use long-term programs for a host of outcomes, including
disorder (comorbid with anxiety), eating disorders, anxiety, depression, self-esteem, and substance use in
insomnia, and suicidal and nonsuicidal self-injurious adolescents and adults (Cooper & Archer, 1999;
thoughts and behaviors (see Barlow & Farchione, Ghafoori et al., 2016; Kenney et al., 2014; Mio &
2018). The UP has also been successfully implemented Matsumuto, 2018; Schleider & Weisz, 2016, 2017).
in group format (Bullis et al., 2015; De Ornelas Maia And in addition to reaching more people, group for-
et al., 2015; Osma et al., 2018; Reinholt et al., 2017). mats have the added benefits of providing a sense of
Recently, the UP was adapted and piloted as a single- community and social support, which can be particu-
session, 2-hour prevention-focused group intervention larly helpful for graduate students reporting feeling
for first-year university students (Bentley et al., 2018). isolated. Furthermore, in the context of a single-
The in-person intervention received moderate to high session intervention, group formats can be advanta-
acceptability and satisfaction ratings and participants geous as participants offer multiple examples of nega-
(n = 45) reported declines in neuroticism and emo- tive emotions, stressful experiences, and applications
tional avoidance and improvements in quality of life of the intervention skills for one another. Second, to
from baseline to the 1-month follow-up. A subsequent further increase accessibility and minimize stigma,
online, single-session intervention (1–2 hours) simi- the intervention was framed as a workshop intended
larly received good satisfaction ratings and participants to teach evidence-based skills for managing stress,
reported lower stress and negative affect at 1-month rather than treatment or group therapy. It was offered
and 6-month follow-ups relative to those in the control for individuals struggling with a host of negative emo-
condition (Sauer-Zavala et al., 2020). tions or stressors, as well as for individuals who were
Parallel meta-analytic data suggest that cognitive-, simply curious about the topics. Workshops were held
behavioral-, and mindfulness-based interventions, in on-campus classroom buildings, rather than in the
social support, and psychoeducation are particularly college counseling center. The intervention was deliv-
helpful for student populations (Regehr et al., 2013; ered by upper-level graduate student clinicians (i.e.,
Yusufov et al., 2018). There is evidence that skills- peers), held in the evening and within individual
oriented group interventions and the inclusion of departments, and was advertised by students and
supervised practice are particularly strong predictors administrators within given departments.
of positive outcomes for students, including preven- This pilot program was meant to be a primary and
tion, reducing symptoms, and enhancing well-being secondary (preventing current subclinical stress symp-
(Conley et al., 2013, 2015, 2017). Excitingly, group toms from converting to outright disorders) preven-
treatments delivered in a class setting have yielded sim- tion program to enhance students’ emotional well-
ilar prevention outcomes to those delivered in clinical being via teaching them emotion regulation skills. Par-
ones, suggesting that quality interventions can be suc- ticipants were not selected for specific levels of emo-
cessfully delivered in nontraditional contexts (Conley tional symptoms or psychopathology. Specific aims
et al., 2013). Most of these interventions, however, were to use evidence-based methods to (a) educate stu-
involve multiple sessions, with averages around 10 dents about emotions; (b) equip students with adaptive
396 Bernstein et al.

cognitive-behavioral skills to cope with different types departments. It was also made clear that data would
of stress and prevent the development or worsening not be shared with faculty and that deidentified results
of emotional symptoms; and (c) collect preliminary would be reported in aggregate across departments.
feasibility, acceptability, and outcomes data. Finally, participants completed surveys on their per-
sonal devices and were therefore able to fill them out
Methods in private.
Procedure
Sample
The workshop was adapted under the supervision of
UP author, Dr. Kate Bentley, to ensure that the gradu- Eligible participants were current graduate students.
ate student workshop remained consistent with the Participants were over 18 years of age (M = 26.1,
aims and targets of the original UP. Departments were SD = 2.6) and represented first- through eighth-year
selected through a larger initiative by Harvard Univer- students. Among attendees who consented to provide
sity Health Services to collect data on the mental health demographic information (n = 53, 67.1%), the major-
and needs of graduate students. Departments offered ity identified as female (n = 32, 60.4%), White
this pilot program were the first to request and com- (n = 36, 67.9%), and not Hispanic or Latino (n = 43,
plete the Health Services survey. Consistent across sur- 81.1%). Participants reported on average mild depres-
veys were students’ requests for additional resources. sive symptoms (Patient Health Questionnaire [PHQ-9]
The pilot program ultimately included six workshops M = 7.2, SD = 4.8) and moderate anxiety symptoms
conducted across four departments. Workshop leaders (Generalized Anxiety Disorder 7-Item [GAD-7]
met with two to four student representatives from each M = 6.8, SD = 5.1). Twelve participants’ (22.7%)
of the initial departments to (a) provide a brief over- PHQ-9 scores exceeded the threshold for a probable
view of the workshop, including its format and four depression diagnosis (10) and 13 participants’
components; (b) gauge interest; (c) gather informa- (24.5%) GAD-7 scores exceeded the threshold for a
tion regarding the structure and common stressors of probable anxiety disorder diagnosis (10). A summary
their programs; (d) solicit feedback regarding the tone of demographic and clinical characteristics of the sam-
of the materials (e.g., Did the psychoeducation appear ple are included in Table 1. There were no differences
too basic?); and (e) solicit feedback on how best to in demographics, histories of service use, or responses
advertise, where and when the workshop should be to clinical measures among departments.
held, and whether it should be intra- or inter- Twenty-two participants (41.5%) reported having
departmental. No representatives declined the offer received a mental health diagnosis in the past. Half
to host a workshop and all representatives expressed of participants reported past or current use of psy-
a preference for workshops to be for their department chotherapy services and close to a third past or current
alone, believing that it would be more comfortable and psychiatric medication use. Among participants who
helpful to learn the skills alongside peers undergoing never accessed services, the most common barriers
similar pressures and that it could support ongoing reported included lack of time (n = 9, 47.4%) and con-
conversations among students afterward. cerns waning before an appointment (n = 10, 52.6%).
Workshops were then advertised by administrators Other barriers included financial cost, embarrassment,
and the student representatives within individual worries about side effects, and not believing services
departments via e-mail, flyers, and word of mouth. would be helpful.
Interested students were able to sign up and opt into
the research arm, a decision that had no bearing on
their participation in the workshop. Participants who Materials
consented to participate in the research arm com-
pleted online questionnaires at baseline (up to 3 days Intervention
before the workshop), immediately after the workshop, Format. The workshop lasted 2 hours and was led by
and follow-up (1- and 3 months after the workshop), two advanced doctoral students in clinical psychology
and were compensated $10 for each completed survey. and supervised by a licensed clinical psychologist.
Participants who completed all surveys received an The workshop included PowerPoint slides to present
additional $10 for a possible total of $50. To mitigate and summarize key concepts, didactic presentation of
confidentiality concerns, we prohibited faculty, staff, material, experiential exercises, and group discussion.
or others who were not current graduate students in Participants were provided with blank worksheets to
a given department from joining or observing work- use throughout the workshop to record group exam-
shops. Names of participants were not shared with ples and practice skills independently. Students
Transdiagnostic CBT Workshop for Graduate Students 397

Table 1
Demographic Characteristics and Service Use

Measure Whole sample Group differences


n (%)
Gender v2 = 3.59, p = .73
Male 20 (37.7)
Female 32 (60.4)
Other 1 (1.9)
Race v2 = 6.82, p = .87
White 36 (67.9)
Black 3 (5.7)
Asian 9 (17.0)
Multiracial 3 (5.7)
Other 2 (3.8)
Ethnicity v2 = 2.38, p = .50
Hispanic/Latino 10 (18.9)
Not Hispanic/Latino 43 (81.1)
Graduate year v2 = 9.54, p = .95
1 14 (26.4)
2 9 (17.0)
3 7 (13.2)
4 10 (18.9)
5 8 (15.1)
6 4 (7.6)
7 0 (0.0)
8 1 (1.9)
Current use of services v2 = 3.36, p = .34
Yes 23 (43.4)
Medication 12 (22.6)
Psychotherapy 18 (34.0)
No 30 (56.6)
Past use of services v2 = 2.98, p = .40
Yes 31 (58.5)
Medication 16 (30.2)
Psychotherapy 27 (50.9)
Other 4 (7.6)
No 22 (41.5)
Measure M (SD) Group differences
Age 26.1 (2.6) F(3, 49) = 0.23, p = .88
BEAQ 46.1 (7.5) F(3, 48) = 1.96, p = .13
ERQ Reappraisal 4.2 (1.0) F(3 ,49) = 0.38, p = .77
ERQ Suppression 3.3 (1.5) F(3, 49) = 2.61, p = .06
BFI Extraversion 25.0 (7.2) F(3, 48) = 0.57, p = .64
BFI Neuroticism 26.9 (5.1) F(3, 48) = 0.84, p = .48
PHQ-9 7.2 (4.8) F(3, 49) = 1.73, p = .17
GAD-7 6.8 (5.1) F(3, 49) = 2.08, p = .12
Q-LES-Q-SF 62.9 (13.6) F(3, 47) = 0.98, p = .41
Note. Characteristics of the sample are described in terms of counts and proportions (categorical variables) or means (M) and standard
deviations (SD; continuous variables). Group differences refer to the separate departmental workshops. BEAQ = Brief Experiential
Avoidance Questionnaire; ERQ = Emotion Regulation Questionnaire; BFI = Big Five Inventory; PHQ-9 = Patient Health Questionnaire 9-
Item; GAD-7 = Generalized Anxiety Disorder 7-Item; Q-LES-Q-SF = Quality of Life Enjoyment and Satisfaction Questionnaire—Short
Form.
398 Bernstein et al.

received one 10-minute break midway through the were guided through a mindful breathing practice.
workshop. Second, they repeated the mindful breathing exercise
followed by prompts to observe physical sensations,
Content. The sessions were broken down to cover thoughts, and actions (or action urges). Group discus-
the four core components of the UP and followed sion about the experience followed each practice.
the structure of Bentley et al. (2018): function of emo- The third section focused on how thoughts influ-
tions (psychoeducation), mindful emotion awareness ence emotional experiences, recognizing negative
(present-focused, nonjudgmental awareness of automatic thoughts, and strategies for generating alter-
thoughts, feelings, and behaviors), cognitive flexibility native appraisals. This module began with an ambigu-
(identifying negative automatic interpretations and gen- ous picture, which was briefly used to illustrate how
erating alternative appraisals), and countering emotion- although most situations can be interpreted in more
driven behaviors (interrupting cycles of negative than one way, our brains instinctively come up with
emotion and choosing actions in line with one’s goals). an initial interpretation very quickly, which can make
The first section covered the functional, adaptive it hard to see alternatives. This was followed with a dis-
nature of emotions. Leaders asked students to rethink cussion of an ambiguous social interaction (e.g., receiv-
the idea that some emotions are good and some are ing an e-mail from one’s advisor asking to meet). With
bad, and explored the important functions different both stimuli, leaders asked participants to generate
emotions serve. To do so, the groups generated exam- examples of possible interpretations and how each
ples of when different basic emotions (i.e., sadness, interpretation would impact their feelings and behav-
happiness, anger, fear, anxiety, and guilt) are typically iors. Participants were then introduced to thinking
felt and why humans evolved to feel them. Leaders traps, specifically jumping to conclusions and catastro-
would then poll the group and ask who would com- phizing, provided with graduate school-related exam-
pletely turn off one of their emotions if given the ples, and practiced generating personal examples for
opportunity. Through the ensuing discussion, groups each. Last, using an example of each type of thinking
would discuss the dangers of not having each emotion trap from the group, leaders walked participants
(e.g., without fear, a person would be in physical dan- through challenging questions (e.g., “What evidence
ger; without anxiety, a person would not prepare for do I have for and against this belief?”; “Could there
an exam or presentation). Leaders challenged students be any other explanations?”; “How bad would it really
to consider that negative emotions are not inherently be?”; “How could I cope with it?”) to come up with
problematic, but instead that certain habits of reacting more balanced and flexible interpretations. Partici-
to strong emotions can be. As a first step in helping stu- pants were allowed time to practice challenging one
dents understand their emotional experiences, leaders of their own thoughts independently.
concluded this module by introducing the three- The fourth section highlighted common, problem-
component model, or the interactions among cogni- atic emotion-driven behaviors (e.g., avoidance).
tive, behavioral, and physiological components of emo- Emotion-driven behaviors were defined as anything a
tions. Students practiced filling out a three-component person does to avoid feeling an emotion, escape an
model as a group and, time allowing, as individuals. To uncomfortable emotion, or prevent it from getting
do so, leaders would solicit an example of a common too intense. Groups would share examples of common,
stressor from a group member and then ask that stu- unhelpful behaviors (e.g., procrastination, oversleep-
dent to walk through his or her reactions. Other stu- ing, yelling, avoiding networking, substance use) and
dents were also invited to add additional examples of discuss the short-term benefits of these behaviors
cognitive, behavioral, and physiological responses they (i.e., relief), as well as long-term consequences (i.e.,
might have in the same situation. perpetuating problematic cycles). Leaders then
The second section introduced the concept of reviewed ways to counter such tendencies. Students
mindful emotional awareness to promote adaptive practiced identifying emotion-driven behaviors and
responses to emotional experiences. Mindfulness in potential specific, concrete alternative actions first as
this context was defined as practicing being aware of a group and then as individuals. Leaders would make
one’s emotional experience as it unfolds, and trying sure to review at least one single-step example, such
to observe the moment without judging it. Leaders as choosing to text a friend when noticing one’s habit
would emphasize that the goal is to strengthen one’s of withdrawing during stressful periods, and at least
ability to observe and refocus one’s attention when it one multistep or graded example, such as progressively
has drifted, rather than to necessarily feel relaxed or working up to talking to professors at departmental
to prevent one’s mind from wandering. Participants social hours. Participants were asked to identify at least
were led through two experiential exercises. First, they one alternative action they could commit to trying
Transdiagnostic CBT Workshop for Graduate Students 399

within the next 24 hours. Leaders emphasized the Second, examples leaders used to illustrate new con-
importance of specificity and repeated practice. tent or skills were intentionally relevant to graduate
Leaders concluded with a review of all skills and students (e.g., research presentations, relationships
strategies for continued practice. Active practice with advisors, writing a dissertation)—for example, to
(group and individual work) was integral to each sec- introduce the bidirectional relationship between
tion. A summary of key points and copies of worksheets thoughts and emotions, leaders would say:
were provided to participants as well.
The way we think about or interpret situations can
really color how we feel about them. For example,
Considerations and Modifications for Current
imagine your advisor e-mails and asks to meet with
Study. First, leaders presented the workshop as an
you ASAP. If you read it to mean that she didn’t like
introduction to evidence-based skills for managing
the paper you just sent, how would you feel? If you
stress or other negative emotions common to graduate
think it’s because she has a big project she wants to
school. Leaders intentionally avoided clinical lan-
involve you in, how would you feel? If you think maybe
guage, such as “depressed,” “disorder,” “therapy,” or
she just wants to check in briefly in person, how would
“treatment,” throughout the workshop and empha-
you feel? Based on your thought, how would you act
sized that the skills can be helpful for everyone, includ-
leading up to or even during the meeting? Also, do
ing themselves. To illustrate, leaders would begin with
you think the way you were already feeling that day
a slide titled “Does this apply to me?” and say:
(let’s say, grumpy, excited, or anxious) might influence
Let’s talk a little bit about who these skills are for. The the way you think about the situation? If you were run-
short answer is anyone. We use these ourselves all the ning late for lab and had skipped breakfast, would you
time! Have you ever looked back and wished you han- be more or less likely to think something was wrong? If
dled a situation differently? We all respond to our emo- you were having a relaxing morning and had just
tions in ways that are unhelpful sometimes. For instance, received good news from a different professor, would
who here has felt anxious about a project and procrasti- you be more or less likely to think something was
nated starting it? Said something mean in the heat of the wrong?
moment? Sacrificed sleep when stressed? Isolated your-
self or stopped doing things when you’re feeling low? In this same module, slides included intentional
These are common responses to strong emotions that examples of thinking traps, such as “when talking to
a lot of us can relate to. The reason these reactions feel other graduate students, think ‘everyone is smarter
bad is because they conflict with your values or goals— than me’; before the qualifying examination, think
they ultimately get in the way of what you really want ‘I’m going to fail. I’ll have to leave the program.’” Sim-
to do, whether that’s succeeding in your research, being ilarly, examples of emotion-driven behaviors included
healthy, or enjoying other people or hobbies. avoiding meetings with one’s advisor or dissertation
committee, perfectionism, spending excessive amounts
This introduction is the first example of how feed- of time in the lab or doing other work at the expense of
back from student representatives was used. Procrasti- health behaviors.
nation, lashing out when upset, sacrificing sleep, and Third, as each workshop was held within an individ-
withdrawing from others were common experiences ual department, leaders were careful to tailor the con-
reported during these meetings. They were therefore versations to the particular group in two primary ways.
selected with the hope that graduate students would For one, leaders would use language consistent with
quickly feel that the workshop was highly relevant to the norms of the department. Through prior meetings
them. Another key addition was made to the psychoed- with student representatives, leaders would know what
ucation portion at the start of the workshop. Consistent milestones (e.g., a first-year paper, a second-year quali-
with the UP, the take-home message was that all emo- fying exam, annual committee meetings) or experi-
tions communicate important information, and that ences (e.g., working independently without regular
it is how we respond to emotions that can get in our attention from faculty, working in lab groups with con-
way. In this context, leaders would also explicitly say: stant oversight from faculty, heavy teaching loads, diffi-
“Graduate school is really stressful. And we can’t culty obtaining teaching positions) were good
change that. But, we can try to change how we respond examples of stressors that participants could all relate
to or navigate it.” Conversations with students before to or how to describe various players in a department
and after workshops highlighted that this direct, clear (e.g., advisor, principal investigator, committee, lab
validation of the unique, emotional experience of group). This knowledge was also used to provide exam-
graduate school was important for communicating ple thinking traps and emotion-driven behaviors that
understanding, increasing buy-in, and reducing shame. were most likely to resonate with a given group.
400 Bernstein et al.

Second, leaders would ask for examples from the behaviors that are more subtle and may not necessarily
group to be used for all skills practices. In this way, be problematic for a given individual. This lens could
leaders would collaborate with participants to articu- be particularly important for individuals without clini-
late their emotional challenges and experiences and cal levels of avoidance or impairment. Speaking to a
use cognitive-behavioral skills to address them. group of students trained in critical thinking, we
Finally, we adapted the presentation of material to attempted to present this nuance in terms of critically
suit these young adults. We updated visual aids (e.g., thinking about the function of one’s behaviors. For
modern fonts and slide themes, familiar graphics inter- example, leaders would add the following ideas:
change formats [GIFs] and movie or television clips) to
There are some times where you can’t do it all and it’s
render them current for this age group. Additionally,
okay to prioritize parts of your life over others. And
leaders referenced the literature supporting the skills
sometimes it’s okay to watch TV and it’s human to pro-
being taught given that the population was empirically
crastinate. This is about the big picture and keeping
minded. We also aimed to use language throughout the
your long-term goals in mind by using mindfulness
workshop that communicated the basics of cognitive-
and cognitive flexibility. It’s about you making decisions
behvaioral therapy (CBT) in a digestible and actionable
about what to do (choosing to leave lab to go on a run
way, while not oversimplifying it—for example, below is
to let off steam or choosing to stay late in your office
an excerpt from the behavioral module:
and write) rather than choices being driven by emo-
The tricky thing about emotion-driven behaviors is that tions like anxiety or habit.
they can feel like they happen automatically. You might
not feel like you are making a conscious choice to avoid
starting an assignment or talking to a new professor, Baseline Measures. Before the workshop, research par-
because avoiding these things can become a habit. This ticipants completed validated self-report question-
happens because, in the moment, avoidance usually naires of demographic characteristics, past use of
feels better, or at least safer, than approaching the treatment services, emotional distress, emotion regula-
problem. The issue is that even though avoiding the tion, and quality of life. Participants who reported
emotions that make you feel uncomfortable (or the sit- never using mental health services were asked follow-
uations that might lead to those emotions) causes relief up questions about this decision, thereby enabling us
in the short-term, it can cause problems down the line. to identify barriers to access.
Sometimes, the negative consequences of avoiding are The nine-item PHQ-9 was used to assess for depres-
obvious. If you spend all semester watching TV mara- sive symptoms. The PHQ-9 is a commonly used, reliable,
thons instead of preparing for your qualifying exam, and valid measure of depression severity (Kroenke et al.,
it’s pretty clear that you’ll do poorly. But what about 2001). The PHQ-9 asks respondents to rate each of the
waiting again and again for the “right time” to bring nine Diagnostic and Statistical Manual of Mental Disorders
up something that’s bothering you with your advisor? (DSM-IV; American Psychiatric Association, 2000) diag-
Editing a paper for months to make it perfect? Re- nostic criteria for a major depressive episode on a scale
reading emails 20 times before sending them? Spend- from 0 (not at all) to 3 (nearly every day). Higher sum
ing all of your free time in the lab to avoid feeling scores indicate more severe symptoms.
unproductive? Ultimately, avoidance makes things actu- The GAD-7 measures anxiety symptoms. This seven-
ally feel even harder to do and makes you feel less able item scale is a brief, but reliable and valid measure of
to cope. So again, if we know that all of these emotion- general anxiety severity (Spitzer et al., 2006). Respon-
driven behaviors we’ve brainstormed together are dents indicate on a scale from 0 (not at all) to 3 (nearly
going to come back to bite us, why do we keep doing every day) how frequently they experience various symp-
them? Because it feels better in the short-term, even toms (e.g., feeling nervous, anxious, or on edge). Total
though it’s painful later on! scores can range from 0 to 21; higher scores reflect
more severe anxiety.
In this discussion, leaders have defined emotion- We also administered the eight-item Neuroticism
driven behaviors, with an emphasis on avoidance, and and eight-item Extraversion subscales of the Big Five
then go on to introduce alternative or opposite actions. Inventory (BFI) to capture general emotional distress
They do not, however, delve into the differences and different aspects of temperament (John et al.,
between types of emotion-driven behaviors or avoid- 1991, 2008). Respondents indicated how much they
ance (e.g., overt, safety behaviors, cognitive), let alone identify with various temperamental descriptors on a
behavioral activation and scheduling, hierarchies, or scale from 1 (disagree strongly) to 5 (agree strongly).
exposures. At the same time, leaders acknowledge the Scores could therefore range from 8 to 40, with higher
complexity of these ideas, such as noting examples of scores reflecting greater extraversion and neuroticism.
Transdiagnostic CBT Workshop for Graduate Students 401

Emotion regulation measures included the Brief Follow-up Measures. At 1-month and 3-months post-
Experiential Avoidance Questionnaire (BEAQ) and workshop, participants repeated baseline measures of
Emotion Regulation Questionnaire (ERQ). The 10- emotionality, temperament, emotion regulation, and
item ERQ (Gross & John, 2003) assesses the use of quality of life (PHQ-9, GAD-7, BFI, BEAQ, ERQ, and
two emotion regulation strategies: cognitive reap- Q-LES-Q-SF). They also reported on their use of speci-
praisal and emotional suppression. Both subscales have fic skills from the workshop over the past month using
strong internal and test–retest reliability. Higher scores a 1–7 scale (1 = never, 3 = some of the time, 5 = most of the
indicate greater use of the strategy. The BEAQ (Gámez time, 7 = all of the time). The three-component model
et al., 2011, 2014) is a 15-item self-report measure that skill was described as “When experiencing a strong
assesses several types of experiential and emotional emotion, I have taken time to notice my thoughts,
avoidance strategies. Example items include “I’m quick physical feelings, and behaviors, and considered how
to leave any situation that makes me feel uneasy,” “I these three parts interact.” Mindful emotion awareness
work hard to keep out upsetting feelings,” “I try to was described as “When feeling stressed, anxious, or
put off unpleasant tasks for as long as possible,” and down, I have guided my attention to the present
“The key to a good life is never feeling any pain.” moment rather than focusing on what happened in
The measure has good internal consistency and con- the past or might happen in the future.” Cognitive flex-
struct validity. Scores can range from 15 to 90, with ibility was described as “I have been aware of my nega-
higher scores indicating greater use of avoidance tive automatic thoughts and made an effort to
strategies. reevaluate them in order to come up with alternative
Finally, the Quality of Life Enjoyment and Satisfac- interpretations.” Finally, alternative (or opposite)
tion Questionnaire—Short Form (Q-LES-Q-SF) was action was described as “I have made an effort to do
administered. The Q-LES-Q-SF captures an individual’s something different, or act opposite, when I feel like
enjoyment of and satisfaction with various domains of avoiding an uncomfortable situation or emotion.”
daily life and functioning (e.g., physical health, social
relationships; Endicott et al., 1993). The first 14 items Data Analysis
are rated on a scale from 1 to 5 and scored as a percent- Feasibility. We assessed feasibility in terms of workshop
age maximum possible score: attendance, skills acquisition, and self-reported skills
use at 1-month and 3-month follow-up. It was estab-
(total raw score minimum possible score)/
lished a priori that the program would be deemed fea-
(maximum possible score minimum possible
sible if 75% of students registered for the workshop
score)
attended, participants answered 75% of learning
Higher percentage scores correspond to greater checks correctly immediately after the workshop, and
quality of life. The final item asks participants to rate if participants reported using skills at least some of
their overall life satisfaction and contentment during the time (3) at follow-up. We used independent sam-
the past week and is scored alone. ple t tests for continuous measures and chi-square tests
for categorical measures to test whether demographics,
Postworkshop Measures. Immediately after the work- baseline use of emotion regulation strategies, symp-
shop, participants completed anonymous question- toms, temperament, or quality of life differed between
naires to assess satisfaction and learning. Specifically, enrolled individuals who did and did not attend a
participants were asked (a) Overall, how acceptable workshop (i.e., consented to participate in the research
was the workshop to you? In other words, did you think arm via online questionnaire [up to 3 days before the
that the workshop approach and activities made sense workshop], but did not ultimately attend the in-
and were reasonable? (b) Overall, how satisfied were person workshop).
you with the workshop? Answers could range from 1
(not at all acceptable/satisfactory) to 5 (extremely accept- Acceptability and Preliminary Outcomes. The program
able/satisfactory). Open, qualitative feedback on the would be defined as acceptable if, on a scale from 1
workshop was also solicited. Finally, participants were (not at all acceptable) to 5 (extremely acceptable), average
given 10 true or false questions about content from satisfaction ratings 4. This criterion was also deter-
the workshop to gauge understanding and skills acqui- mined a priori. Preliminary outcomes were evaluated
sition (e.g., “Starting to approach uncomfortable situa- with measures of emotion regulation (BEAQ, ERQ)
tions as opposed to avoiding them, is one strategy for and emotional symptoms (PHQ-9, GAD-7, neuroti-
changing problematic cycles of emotion”). cism) over the follow-up period. Secondary measures
402 Bernstein et al.

included quality of life (Q-LES-Q-SF) and tempera- Table 2


ment (extraversion). One-way analyses of variance Skills Use
(ANOVA) were used to examine whether skills acquisi- Measure 1 month 3 months Difference
tion differed between departments. Skills use and M (SD) M (SD)
other outcome measures were assessed using linear Three- 3.4 (1.3) 4.0 (1.3) p = .001
mixed models, in which time (baseline, 1 month, component
3 months) was a fixed predictor and participant was a model
random effect. This also allowed us to examine individ- Mindfulness 3.5 (1.2) 3.9 (1.3) p = .10
ual departmental workshops as potentially moderating Cognitive 4.1 (1.4) 4.4 (1.6) p = .20
factors. Finally, given the small sample and within- flexibility
condition nature of these analyses, we also computed Opposite action 3.9 (1.4) 3.9 (1.4) p = .66
Reliable Change Indices (RCIs) for each case and Note. Higher score indicates more frequent use of skill (1–7): 1
report the percentage of cases surpassing the mini- (never); 3 (some of the time); 5 (most of the time); 7 (all of the time).
mum threshold of reliable change (z > 1.96) for each M = mean; SD = standard deviation.
outcome measure (Jacobson & Truax, 1991).

Results There were no differences in ratings by department


for acceptability, F(3, 48) = 1.63, p = .19, or satisfaction,
Feasibility F(3, 48) = 2.72, p = .06. Forty-two (79.3%) participants
indicated that they would want to attend a future
Across the six pilot workshops, 92 students signed
review or booster session. An additional 5 (9.5%) stu-
up and 79 attended (85.87% overall attendance rate;
dents indicated maybe, 1 (1.9%) indicated no, and 5
minimum attendance rate for a given workshop was
(9.5%) did not answer the question. Responses did
75.0%). The mean number of students per workshop not differ by department, v2 = 9.96, p = .53. Thirty-
was 13.2; attendance ranged from 4 to 20. Sixty-four one (58.5%) participants provided qualitative evalua-
students consented to the research component of the tions, of which 27 were positive (e.g., “It gave us con-
pilot program during the sign-up process and com- crete and achievable ways to manage emotions,”
pleted baseline (preworkshop) surveys. Fifty-three of “Very useful and encouraged us to be comfortable talk-
those students ultimately attended a workshop and
ing about emotions”) and 4 were mixed (e.g., “I think
therefore had, at minimum, data for the baseline and
if the information were new to me it would have been
postworkshop surveys (67.1% of workshop attendees).
more helpful,” “I . . . feel guilty about taking time to do
There were no significant differences in any demo- this instead of working”).
graphic or clinical measure between individuals who
did (n = 53) and did not (n = 11) attend a workshop,
ps > 0.05. Fifty-two individuals (98.1%) completed the Outcomes
1-month follow-up survey and 50 (94.3%) completed
the 3-month follow-up survey. Means and standard deviations for each outcome
Participants performed well on the learning checks measure at baseline, 1 month, and 3 months are
of skills acquisition immediately after the workshop, included in Table 3. Participants reported positive
with an average score of 9.5 out of 10 (SD = 0.9). There changes in emotion regulation following the work-
were no differences in performance by department, F shop, including less emotional avoidance (BEAQ), F
(3, 49) = 0.13, p = .94. Additionally, average reports (2, 97.48) = 11.25, p < .001, less emotional suppression
of skills use exceeded 3 (some of the time) for the (ERQ Suppression), F(2, 98.15) = 4.74, p = .01, and
three-component model, mindfulness, cognitive flexi- more reappraisal (ERQ Reappraisal), F(2,
bility, and opposite action at both 1-month and 3- 98.83) = 10.23, p < .001. Relative to baseline, BEAQ
month follow-ups (see Table 2). Use of the three- scores were significantly lower at both 1 month and
component model increased from 1 month to 3 months, ps < 0.05. Correspondingly, relative to base-
3 months, F(1, 29) = 11.86, p = .001. Use of other skills line, 14.6% of participants experienced reliable, posi-
did not differ between the two time points, ps > 0.05. tive change in BEAQ scores (RCI; z > 1.96) at
1 month and 25.0% at 3 months. ERQ Reappraisal
Acceptability scores were significantly higher at 3 months than at
baseline and at 1 month, ps < 0.05. And ERQ Suppres-
Average acceptability scores were 4.7 (out of 5; sion scores declined significantly from baseline to
SD = 0.5) and average satisfaction scores were 4.2 3 months, p = .007. Similarly, 25.0% of participants
(out of 5; SD = 0.7). Ratings are visualized in Fig. 1. had significant, positive RCIs for ERQ Reappraisal
Transdiagnostic CBT Workshop for Graduate Students 403

Fig. 1. Acceptability and satisfaction ratings

and 12.0% for ERQ Suppression at 3 months. Notably, 95.69) = 5.30, p = .007, after the workshop. Specifically,
RCI calculations revealed no reliable worsening of PHQ-9 scores at 3 months were significantly lower than
reports for BEAQ or ERQ Suppression at 3 months at baseline, p = .04, and BFI Neuroticism scores at
and only 4.0% for ERQ Reappraisal. 3 months were significantly lower than at baseline
Additionally, participants experienced declines in and 1 month, ps < 0.05. Relative to baseline, 28.0% of
depressive symptoms (PHQ-9), F(2, 99.01) = 3.14, participants reported reliable improvements in PHQ-
p = .048, and neuroticism (BFI Neuroticism), F(2, 9 scores and 44.9% in BFI Neuroticism scores at
404 Bernstein et al.

Table 3
Clinical Measures

Measure Baseline 1 month 3 months Effect of time


M (SD) M (SD) M (SD)
BEAQ 46.1 (7.5) 41.9 (9.0) 41.33 (9.6) p < .001
ERQ Reappraisal 4.2 (1.0) 4.4 (0.8) 4.80 (0.7) p < .001
ERQ Suppression 3.3 (1.5) 3.1 (1.4) 2.94 (1.3) p = .01
BFI Extraversion 25.0 (7.2) 24.7 (7.3) 25.86 (7.6) p = .03
BFI Neuroticism 26.9 (5.1) 26.3 (5.0) 25.68 (5.2) p = .007
PHQ-9 7.2 (4.8) 6.1 (3.4) 5.68 (3.7) p = .048
GAD-7 6.8 (5.1) 6.8 (4.3) 5.98 (4.3) p = .25
Q-LES-Q-SF 49.2 (7.6) 62.8 (13.7) 65.71 (13.8) p = .29
Note. M = mean; SD = standard deviation; BEAQ = Brief Experiential Avoidance Questionnaire (high scores = more avoidance);
ERQ = Emotion Regulation Questionnaire (high scores = more reappraisal and suppression); BFI = Big Five Inventory (high scores = high
extraversion and neuroticism); PHQ-9 = Patient Health Questionnaire 9-Item (high scores = worse depression); GAD-7 = Generalized
Anxiety Disorder 7-Item (high scores = worse anxiety); Q-LES-Q-SF = Quality of Life Enjoyment and Satisfaction Questionnaire—Short
Form (high scores = better quality of life).

3 months, relative to the 10.0% of participants who decreased use of emotional avoidance and suppres-
experienced reliable worsening of depressive symp- sion—positive changes in emotion regulation strate-
toms and 28.6% who reported reliable increases in gies in line with the intervention. Students also
neuroticism. Finally, there was a main effect of time tended to report declines in depressive symptoms
on BFI Extraversion, F(2, 95.60) = 3.63, p = .03, such and neuroticism over 3 months following the interven-
that scores increased from 1 month to 3 months, tion. Furthermore, it was encouraging to see a minority
p = .048. At 3-months postworkshop, 44.9% of partici- of students report worsening symptoms, virtually no
pants reported reliable increases in extraversion, increase in use of experiential avoidance or emotional
whereas 30.6% reported reliable worsening. Although suppression, and no decline in use of cognitive reap-
anxiety symptoms (GAD-7) numerically declined with praisal following the workshop.
time and reports of quality of life (Q-LES-Q-SF) Though these data suggest preliminary evidence for
increased, changes were not statistically significant, positive outcomes, without a control condition (e.g.,
ps > 0.05. At 3 months, 22.0% of participants reported one-on-one CBT, wait-list, other workshop), it is prema-
reliable improvements in GAD-7 scores and 27.1% in ture to conclude that this intervention is efficacious.
Q-LES-Q-SF scores. Only 10.0% of students reported Furthermore, we were unable to examine outcomes
reliable increases in GAD-7 scores and 14.6% reported beyond three months. Given the fluctuations in exter-
reliable decreases in Q-LES-Q-SF scores. Changes for nally and internally imposed stress inherent in gradu-
all outcome measures are visualized in Fig. 2. Individ- ate school (e.g., exam periods, holiday vacations),
ual departments did not emerge as a significant moder- future work would ideally examine outcomes over
ator for any of the above outcomes, ps > 0.05. longer periods and within these varying contexts. In
the present study, workshops were conducted in
November, February, and March. Consequently, base-
Discussion line and follow-up surveys were administered during a
This study aimed to adapt the UP for use as a single- range of academic periods for students, including
session, transdiagnostic group intervention for gradu- exams, ends of semesters, and winter and summer vaca-
ate students. The intervention educated students about tions, as well as typical weeks. Results did not vary by
emotions and equipped them with specific skills to department, suggesting that at least in a small pilot
cope with stress. Results demonstrated that the inter- sample, workshop effects were not significantly
vention was feasible, with high rates of attendance impacted by time of year.
and comprehension and reports of continued skills Additionally, in this pilot study, we were unable to
use throughout the follow-up period. Coupled with parse out the effects of past or concurrent mental
high acceptability and satisfaction ratings, these find- health services on individuals’ decisions to attend work-
ings suggest that participants understood and res- shops or their responses to the intervention, or to com-
onated with the rationale for UP skills and were able pare effects based on whether or not participants met
to implement them independently. Moreover, students diagnostic criteria or were at high risk for a mental dis-
reported increased use of cognitive flexibility and order. Responses to the surveys could also be skewed by
Transdiagnostic CBT Workshop for Graduate Students 405

Fig. 2. Changes in clinical measures. Note. Time: 1 = baseline; 2 = 1-month follow-up; 3 = 3-month follow-up. (A) BEAQ = Brief
Experiential Avoidance Questionnaire; declines indicate reduced use of avoidance. (B) ERQ = Emotion Regulation
Questionnaire; increases indicate greater use of reappraisal. (C) ERQ; declines indicate reduced use of suppression. (D) PHQ-
9 = Patient Health Questionnaire 9-Item; declines indicate reduced depressive symptoms. (E) GAD-7 = Generalized Anxiety
Disorder 7-Item; declines indicate reduced anxious symptoms. (F) BFI = Big Five Inventory; declines indicate reduced
neuroticism. (G) BFI; increases indicate heightened extraversion. (H) Q-LES-Q-SF = Quality of Life Enjoyment and Satisfaction
Questionnaire—Short Form; increases indicate improved quality of life

students’ desires to perform well. Although researchers ance, and only numerical trends for the remaining out-
emphasized that responses would be helpful in evaluat- come measures (Bentley et al., 2018). Future programs
ing and improving the program, and explicitly asked with graduate students would benefit from not only
for critical feedback, it is difficult to confirm whether including comparison groups and longer assessment
data accurately reflect participants’ experiences, partic- periods but also recruiting larger, more diverse sam-
ularly without a control group. ples and assessing use of skills and emotional experi-
Still, findings are promising and merit future study. ences in real time and with more ecologically valid
Encouragingly, results were consistent with and built measures (e.g., daily diary, ecological momentary
on those from the single-session UP intervention for assessment). Future work may also expand this pro-
first-year undergraduates. Acceptability data were gram to include post-workshop supports, such as addi-
comparable and rates of attendance higher in this tional supervised practice of skills, online resources,
population compared to the undergraduate program. reminders to use skills, and booster sessions.
Additionally, the undergraduate program found The two-hour intervention appeared acceptable
within-condition statistically significant improvements and beneficial. However, changes may be more robust
for neuroticism, quality of life, and experiential avoid- or persist longer term with a higher dose of the
406 Bernstein et al.

intervention (e.g., a longer workshop) or repeated presenting the intervention as a workshop rather than
engagement (e.g., booster sessions). Importantly, the group treatment, and conducting workshops within
intervention comprised the core messages from the individual departments to increase social support and
UP, but could not include the entire nuance and normalize mental health problems. Overall, study
guided work from the longer, multisession, original results are heartening that a brief, group intervention
protocol. In support of such modifications, a majority could benefit emerging adults in managing the stress
of participants indicated interest in future booster or of graduate school and reducing or preventing symp-
review sessions and a large number of participants toms of emotional disorders. Findings support more
described wanting extended time for discussion and research that could evaluate the program in more rig-
practice in their qualitative feedback. Additionally, orous, diverse ways.
although the workshop was intended to be transdiag-
nostic, much of the discussion centered on experi- References
ences of anxiety, fear, and sadness; future iterations
of the study could incorporate discussion of other com- Arnett, J. J. (2000). Emerging adulthood: A theory of development
from the late teens through the twenties. American Psychologist,
mon issues, such as substance use or health behaviors
55, 469–480. https://doi.org/10.1037/0003-066X.55.5.469.
for bolstering resilience (e.g., exercise, sleep). Barlow, D. H., Allen, L. B., & Choate, M. L. (2004). Toward a
Consistent with prior study of graduate student unified treatment for emotional disorders. Behavior Therapy, 35,
mental health, students in this study largely endorsed 205–230. https://doi.org/10.1016/S0005-7894(04)80036-4.
Barlow, D. H., Ellard, K., Fairholme, C., Farchione, T., Boisseau, C.,
at least mild symptoms of depression and anxiety and
Allen, L., & Ehrenreich-May, J. (2017). Unified protocol for the
about half had actively sought clinical support. Equally transdiagnostic treatment of emotional disorders: Workbook (2nd ed.).
concerning, many non-treatment-seeking students Oxford University Press. http://dx.doi.org/10.1093/med-
reported notable barriers to accessing care, including psych/9780190686017.001.0001.
time constraints, financial cost, stigma, doubts that ser- Barlow, D. H., & Farchione, T. (Eds.). (2018). Applications of the
unified protocol for transdiagnostic treatment of emotional disorders.
vices would be helpful, or feelings that their problems https://doi.org/10.1093/med-psych/9780190255541.001.0001.
were insufficiently severe to warrant an appointment. Barlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W.,
These observations underscore the urgent need to Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-
develop more time- and cost-efficient interventions, Hollands, J., Conklin, L. R., Boswell, J. F., Ametaj, A., Carl, J. R.,
Boettcher, H. T., & Cassiello-Robbins, C. (2017). The unified
particularly for emerging adults. Universities every-
protocol for transdiagnostic treatment of emotional disorders
where are grappling with the high, and rising, rates compared with diagnosis-specific protocols for anxiety
of stress, anxiety, and depression among students and disorders: A randomized clinical trial. JAMA Psychiatry, 74,
are unable to feasibly reach all at-risk students. 875–884. https://doi.org/10.1001/jamapsychiatry.2017.2164.
Barlow, D. H., Farchione, T. J., Fairholme, C. P., Ellard, K. K.,
Boisseau, C. L., Allen, L. B., & Ehrenreich-May, J. (2011). Unified
Conclusions protocol for transdiagnostic treatment of emotional disorders: Therapist
Scalable, early interventions that target subclinical guide. Oxford University Press. http://dx.doi.org/10.1093/med:
psych/9780199772667.001.0001.
or mild symptoms may be particularly useful in mitigat- Barlow, D. H., Farchione, T. J., Sauer-Zavala, S., Latin, H. M., Ellard,
ing mental health burdens on campuses, reducing wait- K. K., Bullis, J. R., ... Cassiello-Robbins, C. (2017). Unified protocol
lists for treatment, and conserving university resources for transdiagnostic treatment of emotional disorders: Therapist guide
for higher acuity cases. The UP holds particular pro- (2nd ed.). Oxford University Press. http://dx.doi.org/10.1093/
med-psych/9780190685973.001.0001.
mise given its focus on transdiagnostic emotion regula- Bentley, K. H., Boettcher, H., Bullis, J. R., Carl, J. R., Conklin, L. R.,
tion skills that are broadly applicable to the emotional Sauer-Zavala, S., ... Barlow, D. H. (2018). Development of a
challenges of emerging adulthood and graduate single-session, transdiagnostic preventive intervention for young
school. In this way, the program can support students adults at risk for emotional disorders. Behavior Modification, 42,
781–805. https://doi.org/10.1177/0145445517734354.
experiencing nonspecific distress, evidenced in reduc-
Booth, R. W., Sharma, D., & Leader, T. I. (2016). The age of
tions in neuroticism at follow-up, as well as disorder- anxiety? It depends where you look: Changes in STAI trait
specific symptoms. The present format also provides anxiety, 1970–2010. Social Psychiatry and Psychiatric Epidemiology,
notable advantages for reaching students—for exam- 51, 193–202. https://doi.org/10.1007/s00127-015-1096-0.
ple, workshops were scheduled at times, locations, Boswell, J. F., Anderson, L. M., & Barlow, D. H. (2014). An
idiographic analysis of change processes in the unified
and points in the academic year selected by students transdiagnostic treatment of depression. Journal of Consulting
to be most accessible and useful. Moreover, partici- and Clinical Psychology, 82, 1060–1071. https://doi.org/10.1037/
pants within a workshop came from the same academic a0037403.
field, enabling us to tailor material to stressors espe- Bullis, J. R., Fortune, M. R., Farchione, T. J., & Barlow, D. H. (2014).
A preliminary investigation of the long-term outcome of the
cially characteristic of specific disciplines. Additionally, unified protocol for transdiagnostic treatment of emotional
we aimed to increase accessibility and reduce stigma by disorders. Comprehensive Psychiatry, 55, 1920–1927. https://doi.
eliminating a requisite clinical threshold for enrolling, org/10.1016/j.comppsych.2014.07.016.
Transdiagnostic CBT Workshop for Graduate Students 407

Bullis, J. R., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., Suzuki, N., &
Carl, J. R., & Barlow, D. H. (2015). The unified protocol for Watson, D. (2014). The brief experiential avoidance
transdiagnostic treatment of emotional disorders: Preliminary questionnaire: Development and initial validation. Psychological
exploration of effectiveness for group delivery. Behavior Assessment, 26, 35–45. https://doi.org/10.1037/a0034473.
Modification, 39, 295–321. https://doi.org/10.1177/ Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., & Watson, D.
0145445514553094. (2011). Development of a measure of experiential avoidance:
Conley, C. S., Durlak, J. A., & Dickson, D. A. (2013). An evaluative The multidimensional experiential avoidance questionnaire.
review of outcome research on universal mental health Psychological Assessment, 23, 692–713. https://doi.org/10.1037/
promotion and prevention programs for higher education a0023242.
students. Journal of American College Health, 61, 286–310. Garcia-Williams, A. G., Moffitt, L., & Kaslow, N. J. (2014). Mental
https://doi.org/10.1080/07448481.2013.802237. health and suicidal behavior among graduate students. Academic
Conley, C. S., Durlak, J. A., & Kirsch, A. C. (2015). A meta-analysis of Psychiatry, 38, 554–560. https://doi.org/10.1007/s40596-014-
universal mental health prevention programs for higher 0041-y.
education students. Prevention Science, 16, 487–507. https:// Gewin, V. (2012). Mental health: Under a cloud. Nature, 490,
doi.org/10.1007/s11121-015-0543-1. 299–301. https://doi.org/10.1038/nj7419-299a.
Conley, C. S., Shapiro, J. B., Kirsch, A. C., & Durlak, J. A. (2017). A Ghafoori, B., Fisher, D., Korosteleva, O., & Hong, M. (2016). A
meta-analysis of indicated mental health prevention programs randomized, controlled pilot study of a single-session
for at-risk higher education students. Journal of Counseling psychoeducation treatment for urban, culturally diverse,
Psychology, 64, 121–140. https://doi.org/10.1037/cou0000190. trauma-exposed adults. Journal of Nervous and Mental Disease,
Cooper, S., & Archer, J. (1999). Brief therapy in college counseling 204, 421–430. https://doi.org/10.1097/
and mental health. Journal of the American College Health NMD.0000000000000512.
Association, 48, 21–28. https://doi.org/10.1080/ Gross, J. J., & John, O. P. (2003). Individual differences in two
07448489909595668. emotion regulation processes: Implications for affect,
Dearing, R. L., Maddux, J. E., & Tangney, J. P. (2005). Predictors of relationships, and well-being. Journal of Personality and Social
psychological help seeking in clinical and counseling psychology Psychology, 85, 348–362. https://doi.org/10.1037/0022-
graduate students. Professional Psychology: Research and Practice, 36, 3514.85.2.348.
323–329. https://doi.org/10.1037/0735-7028.36.3.323. Hankin, B. L., & Abramson, L. Y. (2001). Development of gender
De Ornelas Maia, A. C. C., Nardi, A. E., & Cardoso, A. (2015). The differences in depression: An elaborated cognitive vulnerability-
utilization of unified protocols in behavioral cognitive therapy transactional stress theory. Psychological Bulletin, 127, 773.
in transdiagnostic group subjects: A clinical trial. Journal of https://doi.org/10.1037/0033-2909.127.6.773.
Affective Disorders, 172, 179–183. https://doi.org/10.1016/ Hyun, J. K., Quinn, B. C., Madon, T., & Lustig, S. (2006). Graduate
j.jad.2014.09.023. student mental health: Needs assessment and utilization of
Di Pierro, M. (2017). Mental health and the graduate student counseling services. Journal of College Student Development, 47,
experience. Journal for Quality and Participation, 40, 24–27. 247–266. https://doi.org/10.1353/csd.2006.0030.
Drum, D. J., Brownson, C., Denmark, A. B., & Smith, S. E. (2009). Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical
New data on the nature of suicidal crises in college students: approach to defining meaningful change in psychotherapy
Shifting the paradigm. Professional Psychology: Research and research. Journal of Consulting and Clinical Psychology, 59, 12–19.
Practice, 40, 213–222. https://doi.org/10.1037/a0014465. https://doi.org/10.1037/0022-006X.59.1.12.
Eisenberg, D., Golberstein, E., & Gollust, S. E. (2007). Help-seeking John, O. P., Donahue, E., & Kentle, R. (1991). The Big Five
and access to mental health care in a university student Inventory—versions 4a and 54. University of California, Berkeley,
population. Medical Care, 45, 594–601. https://doi.org/ Institute of Personality and Social Research.
10.1097/MLR.0b013e31803bb4c1. John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to
Ellard, K. K., Bernstein, E. E., Hearing, C., Baek, J. H., Sylvia, L. G., the integrative Big-Five Trait Taxonomy: History, measurement,
Nierenberg, A. A., ... Deckersbach, T. (2017). Transdiagnostic and conceptual issues. In O. P. John, R. W. Robins, & L. A.
treatment of bipolar disorder and comorbid anxiety using the Pervin (Eds.), Handbook of personality: Theory and research
unified protocol for emotional disorders: A pilot feasibility and (pp. 114–158). Guilford Press.
acceptability trial. Journal of Affective Disorders, 219. https://doi. Jones, M. C., & Johnston, D. W. (2000). Evaluating the impact of a
org/10.1016/j.jad.2017.05.011. worksite stress management programme for distressed student
Ellard, K. K., Fairholme, C. P., Boisseau, C. L., Farchione, T. J., & nurses: A randomised controlled trial. Psychology and Health, 15,
Barlow, D. H. (2010). Unified protocol for the transdiagnostic 689–706. https://doi.org/10.1080/08870440008405480.
treatment of emotional disorders: Protocol development and Kao, H. S. R., Zhu, L., Chao, A. A., Chen, H. Y., Liu, I. C. Y., &
initial outcome data. Cognitive and Behavioral Practice, 17, 88–101. Zhang, M. (2014). Calligraphy and meditation for stress
https://doi.org/10.1016/j.cbpra.2009.06.002. reduction: An experimental comparison. Psychology Research
Endicott, J., Nee, J., Harrison, W., & Blumenthal, R. (1993). Quality and Behavior Management, 7, 47–52. https://doi.org/10.2147/
of life enjoyment and satisfaction questionnaire: A new measure. PRBM.S55743.
Psychopharmacology Bulletin, 29, 321–326. Kazdin, A. E., & Rabbitt, S. M. (2013). Novel models for delivering
Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., mental health services and reducing the burdens of mental
Thompson-Hollands, J., Carl, J. R., ... Barlow, D. H. (2012). illness. Clinical Psychological Science, 1, 170–191. https://doi.org/
Unified Protocol for transdiagnostic treatment of emotional 10.1177/2167702612463566.
disorders: A randomized controlled trial. Behavior Therapy, 43, Kenney, S. R., Napper, L. E., LaBrie, J. W., & Martens, M. P. (2014).
666–678. https://doi.org/10.1016/j.beth.2012.01.001. Examining the efficacy of a brief group protective behavioral
Gaddis, S. M., Ramirez, D., & Hernandez, E. L. (2018). strategies skills training alcohol intervention with college
Contextualizing public stigma: Endorsed mental health women. Psychology of Addictive Behaviors, 28, 1041–1051.
treatment stigma on college and university campuses. Social https://doi.org/10.1037/a0038173.
Science and Medicine, 197, 183–191. https://doi.org/10.1016/ Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9:
j.socscimed.2017.11.029. Validity of a brief depression severity measure. Journal of General
408 Bernstein et al.

Internal Medicine, 16, 606–613. https://doi.org/10.1046/j.1525- intervention teaching that personality can change. Behaviour
1497.2001.016009606.x. Research and Therapy, 87, 170–181. https://doi.org/10.1016/j.
Leebens, P. K., & Williamson, E. D. (2017). Developmental brat.2016.09.011.
psychopathology: Risk and resilience in the transition to Schleider, J. L., & Weisz, J. R. (2017). Little treatments, promising
young adulthood. Child and Adolescent Psychiatric Clinics of North effects? Meta-analysis of single-session interventions for youth
America, 26, 143–156. https://doi.org/10.1016/j. psychiatric problems. Journal of the American Academy of Child and
chc.2016.12.001. Adolescent Psychiatry, 56, 107–115. https://doi.org/10.1016/
Levecque, K., Anseel, F., De Beuckelaer, A., Van der Heyden, J., & j.jaac.2016.11.007.
Gisle, L. (2017). Work organization and mental health problems Shapiro, S. L., Brown, K. W., & Biegel, G. M. (2007). Teaching self-
in PhD students. Research Policy, 46, 868–879. https://doi.org/ care to caregivers: Effects of mindfulness-based stress reduction
10.1016/j.respol.2017.02.008. on the mental health of therapists in training. Training and
LeViness, P., Bershad, C., & Gorman, K. (2017). The Association for Education in Professional Psychology, 1, 105–115. https://doi.org/
University and College Counseling Center Directors annual 10.1037/1931-3918.1.2.105.
survey. Retrieved from https://www.aucccd.org/ Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A
assets/documents/Governance/2017%20aucccd% brief measure for assessing generalized anxiety disorder: The
20surveypublicapr26.pdf. GAD-7. Archives of Internal Medicine, 166, 1092–1097. https://doi.
Lipson, S. K., Kern, A., Eisenberg, D., & Breland-Noble, A. M. org/10.1001/archinte.166.10.1092.
(2018). Mental health disparities among college students of Substance Abuse and Mental Health Services Administration
color. Journal of Adolescent Health, 63, 348–356. https://doi.org/ (2019). Key substance use and mental health indicators in the
10.1016/j.jadohealth.2018.04.014. United States: Results from the 2018 National Survey on Drug
Masten, A. S., Faden, V. B., Zucker, R. A., & Spear, L. P. (2008). Use and Health (HHS Publication No. PEP19-5068, NSDUH
Underage drinking: A developmental framework. Pediatrics, 121, Series H-54). Rockville, MD: Center for Behavioral Health
235–251. https://doi.org/10.1542/peds.2007-2243A. Statistics and Quality, Substance Abuse and Mental Health
McGrady, A., Brennan, J., Lynch, D., & Whearty, K. (2012). A Services Administration. Retrieved from https://www.
wellness program for first year medical students. Applied samhsa.gov/data/.
Psychophysiology Biofeedback, 37, 253–260. https://doi.org/ Taber-Thomas, B., & Perez-Edgar, K. (2015). Emerging adulthood
10.1007/s10484-012-9198-x. brain development. In J. Arnett (Ed.), The Oxford handbook of
Mio, M. G., & Matsumuto, Y. (2018). A single-session universal emerging adulthood (pp. 126–141). Oxford University Press.
mental health promotion program in Japanese schools: A pilot https://doi.org/10.1093/oxfordhb/9780199795574.001.0001.
study. Social Behavior and Personality: An International Journal, 46, Thomas, K. C., Ellis, A. R., Konrad, T. R., Holzer, C. E., & Morrissey,
1727–1743. https://doi.org/10.2224/sbp.7157. J. P. (2009). County-level estimates of mental health professional
Osma, J., Suso-Ribera, C., Garcı́a-Palacios, A., Crespo-Delgado, E., shortage in the United States. Psychiatric Services, 60, 1323–1328.
Robert-Flor, C., Sánchez-Guerrero, A., ... Torres-Alfosea, M. Á. https://doi.org/10.1176/ps.2009.60.10.1323.
(2018). Efficacy of the Unified Protocol for the Treatment of Thomas, S. J., Caputi, P., & Wilson, C. J. (2014). Specific attitudes
Emotional Disorders in the Spanish public mental health system which predict psychology students’ intentions to seek help for
using a group format: Study protocol for a multicenter, psychological distress. Journal of Clinical Psychology, 70, 273–282.
randomized, non-inferiority controlled trial. Health and Quality https://doi.org/10.1002/jclp.22022.
of Life Outcomes, 16, 46. https://doi.org/10.1186/s12955-018- Troop, D. (2011). Paranoid? You must be a grad student. Chronicle
0866-2. of Higher Education. Retrieved from https://www.
Regehr, C., Glancy, D., & Pitts, A. (2013). Interventions to reduce chronicle.com/article/paranoid-you-must-be-a-grad-student/.
stress in university students: A review and meta-analysis. Journal Twenge, J. M. (2000). The age of anxiety? Birth cohort change in
of Affective Disorders, 148, 1–11. https://doi.org/10.1016/ anxiety and neuroticism, 1952–1993. Journal of Personality and
j.jad.2012.11.026. Social Psychology, 79, 1007–1021. https://doi.org/10.1037/0022-
Reinholt, N., Aharoni, R., Winding, C., Rosenberg, N., Rosenbaum, 3514.79.6.1007.
B., & Arnfred, S. (2017). Transdiagnostic group CBT for anxiety Twenge, J. M., Cooper, A. B., Joiner, T. E., Duffy, M. E., & Binau, S.
disorders: The Unified Protocol in Mental Health Services. G. (2019). Age, period, and cohort trends in mood disorder
Cognitive Behaviour Therapy, 46, 29–43. https://doi.org/10.1080/ indicators and suicide-related outcomes in a nationally
16506073.2016.1227360. representative dataset, 2005–2017. Journal of Abnormal
Rummell, C. M. (2015). An exploratory study of psychology Psychology, 128, 185–199. https://doi.org/10.1037/abn0000410.
graduate student workload, health, and program satisfaction. Tyssen, R., Vaglum, P., Grønvold, N. T., & Ekeberg, I. (2001).
Professional Psychology: Research and Practice, 46, 391–399. https:// Factors in medical school that predict postgraduate mental
doi.org/10.1037/pro0000056. health problems in need of treatment: A nationwide and
Sauer-Zavala, S., Boswell, J. F., Gallagher, M. W., Bentley, K. H., longitudinal study. Medical Education, 35, 110–120. https://doi.
Ametaj, A., & Barlow, D. H. (2012). The role of negative affectivity org/10.1111/j.1365-2923.2001.00770.x.
and negative reactivity to emotions in predicting outcomes in the Yusufov, M., Nicoloro-SantaBarbara, J., Grey, N. E., Moyer, A., &
unified protocol for the transdiagnostic treatment of emotional Lobel, M. (2018). Meta-analytic evaluation of stress reduction
disorders. Behaviour Research and Therapy, 50, 551–557. https:// interventions for undergraduate and graduate students.
doi.org/10.1016/j.brat.2012.05.005. International Journal of Stress Management, 26, 132. https://doi.
Sauer-Zavala, S., Tirpak, J. W., Eustis, E. H., Woods, B. K., & Russell, org/10.1037/str0000099.
K. (2020). Unified protocol for the transdiagnostic prevention Zimmermann, P., & Iwanski, A. (2014). Emotion regulation from
of emotional disorders: Pilot evaluation of a brief, online course early adolescence to emerging adulthood and middle
for college freshmen. https://doi.org/10.1016/j.beth.2020.01. adulthood: Age differences, gender differences, and emotion-
010. specific developmental variations. International Journal of
Schleider, J. L., & Weisz, J. R. (2016). Reducing risk for anxiety and Behavioral Development, 38, 182–194. https://doi.org/10.1177/
depression in adolescents: Effects of a single-session 0165025413515405.
Transdiagnostic CBT Workshop for Graduate Students 409

The authors have no competing interests to disclose. Shaffer, Aleyda M. Trevino, Alyson R. Warr, S. Rue Wilson, and
This work was supported by the Pershing Square Fund for Ziyan Zhu.
Research on the Foundations of Human Behavior (E.E.B.). The
Address correspondence to Emily E. Bernstein, Department of
sponsor had no involvement in study design, data collection,
Psychology, Harvard University, 33 Kirkland Street, Cambridge, MA
analysis, or interpretation, writing, or decision to submit this
02138. e-mail: ebernstein@g.harvard.edu.
article for publication. The authors would like to thank the
following individuals for their feedback and support during the Received: October 11, 2019
development of this project: David H. Barlow, Jocelyn J. Fuentes, Accepted: September 22, 2020
Samantha R. Giffen, Jonathan Haefner, Ian T. Hill, Cate Leonard, Available online 10 November 2020
Barbara S. Lewis, David Martin, Maureen Rezendes, Hannah

You might also like