Download as pdf or txt
Download as pdf or txt
You are on page 1of 17

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/345959187

Dialectical Behavior Therapy in the Treatment of Comorbid Borderline


Personality Disorder and Eating Disorder in a Naturalistic Setting: A Six-Year
Follow-up Study

Article in Cognitive Therapy and Research · June 2021


DOI: 10.1007/s10608-020-10170-9

CITATIONS READS

2 242

5 authors, including:

Marivi Navarro Haro Verónica Guillén Botella


University of Zaragoza University of Valencia
31 PUBLICATIONS 376 CITATIONS 83 PUBLICATIONS 1,676 CITATIONS

SEE PROFILE SEE PROFILE

Laura Badenes-Ribera Luis Borao-Zabala

67 PUBLICATIONS 634 CITATIONS


University of Zaragoza
16 PUBLICATIONS 175 CITATIONS
SEE PROFILE
SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Intervention on Psychosocial Factors at Work. View project

Mindfulness en contextos educativos View project

All content following this page was uploaded by Marivi Navarro Haro on 30 June 2021.

The user has requested enhancement of the downloaded file.


Dialectical Behavior Therapy in the
Treatment of Comorbid Borderline
Personality Disorder and Eating Disorder
in a Naturalistic Setting: A Six-Year
Follow-up Study
María V. Navarro-Haro, Verónica
Guillén Botella, Laura Badenes-Ribera,
Luis Borao & Azucena García-Palacios

Cognitive Therapy and Research

ISSN 0147-5916

Cogn Ther Res


DOI 10.1007/s10608-020-10170-9

1 23
Your article is protected by copyright and
all rights are held exclusively by Springer
Science+Business Media, LLC, part of
Springer Nature. This e-offprint is for personal
use only and shall not be self-archived in
electronic repositories. If you wish to self-
archive your article, please use the accepted
manuscript version for posting on your own
website. You may further deposit the accepted
manuscript version in any repository,
provided it is only made publicly available 12
months after official publication or later and
provided acknowledgement is given to the
original source of publication and a link is
inserted to the published article on Springer's
website. The link must be accompanied by
the following text: "The final publication is
available at link.springer.com”.

1 23
Author's personal copy
Cognitive Therapy and Research
https://doi.org/10.1007/s10608-020-10170-9

ORIGINAL ARTICLE

Dialectical Behavior Therapy in the Treatment of Comorbid Borderline


Personality Disorder and Eating Disorder in a Naturalistic Setting:
A Six‑Year Follow‑up Study
María V. Navarro‑Haro1,2 · Verónica Guillén Botella3 · Laura Badenes‑Ribera4 · Luis Borao1 ·
Azucena García‑Palacios5,6

Accepted: 16 October 2020


© Springer Science+Business Media, LLC, part of Springer Nature 2020

Abstract
Background Dialectical Behavior Therapy (DBT) has shown evidence of its effectiveness in the treatment of borderline
personality disorder (BPD) and eating disorders (EDs) separately, and there is preliminary evidence for co-occurrent BPD
and EDs. However, the long-term effectiveness of DBT for this specific population is still unknown. The main goal of this
study was to assess long-term treatment effectiveness in people diagnosed with BPD and ED.
Methods Participants (N = 109) had previously received a 6-month treatment during a clinical trial (DBT = 64 vs. Treatment
as Usual, Cognitive Behavior Therapy; TAU CBT = 45). Outcome measures (emotional eating, depressive symptoms, anger,
emotion regulation, impulsiveness, and resilience) were evaluated prospectively at 4- and 6-year follow-ups.
Results There was a statistically significant improvement in most study outcomes from pre-treatment to the follow-ups in
the DBT condition, and in depression, resilience and trait anger in the TAU CBT. No statistically significant between-group
differences were found. Nonetheless, a high percentage of participants showed a clinically significant improvement over
time in the DBT condition.
Conclusions Findings of this study contribute to determinate the long-term treatment effectiveness of DBT for people with
BPD and ED in routine psychotherapeutic practice. Longitudinal studies with larger sample sizes are needed to confirm
these results.

Keywords Personality disorders · Borderline personality disorder · Eating disorders · Dialectical behavior therapy ·
Cognitive-behavior therapy · Naturalistic setting

2
* María V. Navarro‑Haro Instituto de Investigación Sanitaria de Aragón, Zaragoza,
mvnavarro@unizar.es Spain
3
Verónica Guillén Botella Dept. Personalidad, Evaluación Y Tratamientos
veronica.guillen@uv.es Psicológicos, Universidad de Valencia, Av. Blasco Ibañez 21,
46010 Valencia, Spain
Laura Badenes‑Ribera
4
Laura.Badenes@uv.es Dept. Metodología de Las Ciencias del Comportamiento,
Universidad de Valencia, Valencia, Spain
Luis Borao
5
lborao@gmail.com Dpt. Psicología Básica, Clínica y Psicobiología, Universitat
Jaume I, Avda Vicent Sos Baynat s/n, 12071 Castellon, Spain
Azucena García‑Palacios
6
azucena@uji.es Ciber Fisiopatología Obesidad Y Nutrición (CB06/03
Instituto Salud Carlos III, Spain), Madrid, Spain
1
Dept. Psicología Y Sociología, Universidad de Zaragoza,
Calle Cdad. Escolar, S/N, 44003 Teruel, Spain

13
Vol.:(0123456789)
Author's personal copy
Cognitive Therapy and Research

Introduction Binge Eating Disorder (BED). The Stanford Model dif-


fers from the standard DBT program in a number of ways:
Borderline Personality Disorder (BPD) and Eating Disor- only a single modality of treatment is used, group DBT
ders (EDs) comorbidity in adulthood has been associated for BED instead of individual therapy, treatment consists
with more severe distortions in eating attitudes, a higher of 20 sessions, and DBT skills training is reduced to three
number of hospitalizations, and non-suicidal and suicidal modules (for more information see Chen and Safer 2010,
behaviors (e.g. Ben-Porath et al. 2009; Chen et al. 2009). p. 299). The review also informed that there is not enough
Moreover, a diagnosis of ED has been suggested as a evidence about the efficacy of DBT in treating Bulimia
predictor of early treatment dropout in individuals with Nervosa (BN) and Anorexia Nervosa (AN) (Ben-Porath
BPD (Carmona et al. 2018). Recent studies indicate a high et al. 2020).
prevalence of comorbid BPD and ED symptoms in sam- Evidence about DBT for BPD and ED comorbidity is
ples with eating disorders (ED), including interpersonal still in its infancy. An open trial conducted in Germany
difficulties, an unstable self‐image, marked impulsivity, evaluated an adapted 3-month DBT plus an added cogni-
and emotion dysregulation (e.g., Martinussen et al. 2017; tive behavioral module specific to EDs in a large sample
Newton 2019). A 10-year follow-up study of the course of of inpatients (n = 24) with BPD and EDs (BN and AN).
EDs in people diagnosed with BPD found that, although The results showed significant improvements in self-rated
baseline comorbid ED remitted at the 10-year follow-up, eating-related complaints and general psychopathology, as
diagnostic migration of EDs was common in the long term well as global psychosocial functioning at post-treatment
(Zanarini et al. 2010). Given common migrations from and 15-month follow-up. (Kröger et al. 2010). Further-
one ED to another (Fairburn and Bohn 2005) and shared more, in a non-randomized controlled trial, Standard DBT
etiological factors in individuals with co-occurrent BPD was compared to Treatment as Usual Cognitive Behavior
and ED, transdiagnostic treatment approaches such as Dia- Therapy (TAU CBT) for BPD and ED comorbid features.
lectical Behavior Therapy (DBT; Linehan 1993a, b) have Participants (N = 118) were women diagnosed with BPD and
been considered adequate treatments for BPD and ED psy- ED [AN, BN, and Eating Disorder Not Otherwise Speci-
chopathologies (Treasure and Schmidt 2002). fied (EDNOS)], assigned to one of the two treatment condi-
Standard DBT (Linehan 1993a, b; Linehan et al. tions (DBT = 71; TAU CBT = 47). DBT, compared to TAU
2015) is an outpatient comprehensive multicomponent CBT, showed a greater decrease in dysfunctional behaviors
intervention developed for people with extreme emotion used to regulate emotions (e.g. substance abuse, impulsive
dysregulation and recurrent suicidal behavior and con- spending, unprotected sex, etc.), non-suicidal self-injuries,
sists of 4 weekly components: individual therapy, group and depressive symptoms, as well as a greater increase in
skills training, therapist consultation team, and as-needed cognitive reappraisal and global functioning (Navarro-Haro
between-session telephone coaching. Strategies drawn et al. 2018). Neither of these studies presented long-term
from cognitive and behavioral interventions (e.g., behav- follow-up results.
ioral assessment, contingency management, exposure, and Regarding long-term outcomes of standard DBT for adults
skills training) to dialectics and the acceptance strategies with BPD, to our knowledge, follow-up studies have con-
(e.g. validation and mindfulness), that are used across all sisted of a maximum of 2-year periods (e.g. Linehan et al.
four DBT components. 2006; McMain et al. 2012). However, a shorter version of
DBT has been suggested as an efficacious interven- DBT for BPD was evaluated long term in a 10-year follow-
tion for a wide range of disorders with symptoms that are up study conducted in Spain. Participants were BPD outpa-
functionally similar to those of BPD (e.g. substance use tients (N = 64) who had participated in a previous clinical trial
disorder, anxiety disorders, eating disorders), and emotion comparing olanzapine plus DBT vs. placebo plus DBT for
dysregulation has been proposed as the core etiological 12 weeks (Soler et al. 2005). Significant improvements were
and transdiagnostic factor (Neacsiu et al. 2014). Although reported on BPD domains (affect, impulse action patterns, and
more research is needed, DBT is currently the psychologi- interpersonal relationships), as well as significant decreases in
cal treatment for BPD with the most evidence supporting BPD criteria, self-harm, and suicidal behavior, but social and
it (Stoffers et al 2012), and there is also some evidence of occupational functioning continued to be impaired over time,
DBT adaptations to treat EDs without BPD (e.g. Bankoff and there was still comorbidity with other mental disorders
et al. 2012; Ben-Porath et al. 2020). Specifically, a recent (Álvarez-Tomás et al. 2017). Furthermore, several longitudinal
review (Ben-Porath et al. 2020) reported that the Stan- studies have evaluated the course of BPD after treatment, but
ford Model (Chen and Safer 2010; Safer et al. 2017) has they have not controlled for the treatment approach. Findings
the most rigorous and numerous studies demonstrating indicated that over a period of 10–16 years, BPD was asso-
its efficacy and effectiveness for people diagnosed with ciated with low rates of relapse and high rates of remission
of BPD acute symptoms (e.g. self-harm, suicide attempts),

13
Author's personal copy
Cognitive Therapy and Research

but less remission of temperamental symptoms (e.g., chronic The previous study was a multiple site, non-randomized,
anger, intolerance of aloneness) and severe and persistent controlled trial conducted in a naturalistic setting, and it was
impairments in social functioning (e.g. Gunderson et al. 2011; approved by the clinical research ethics review board of the
Zanarini et al. 2016). Results of these studies are consistent clinical center. Moreover, the research project was funded
with the long-term research conducted in Spain. by a national agency and went through an ethical review
To our knowledge, there are no published studies with long- process. Written informed consent was obtained from all
term outcomes comparing Standard DBT (including the four the participants. The complete procedure for the clinical trial
treatment modes: individual psychotherapy, skills training, can be found in the cited study. A summary of the clinical
phone calls, and a consultation team) to other interventions trial procedure is presented as follows.
specifically for the treatment of comorbid BPD and ED. There- Ten clinicians with training and experience in structured
fore, the main purpose of this study was to compare long- interviews for personality and eating disorders assessed
term treatment outcomes of Standard DBT vs. TAU CBT for whether patients met the diagnosis of BPD and ED and
individuals with BPD and ED (AN, BN, and EDNOS) in a ensured that the inclusion criteria were met. Then, the
naturalistic setting. Given DBT focus on transdiagnostic emo- researchers informed eligible participants about the study
tion dysregulation, we expected DBT to be more effective than goal. If they agreed to participate, they signed an informed
TAU CBT during the follow-up periods in decreasing clinical consent and were assigned to one of the two treatment condi-
outcomes related to emotion dysregulation (depression, anger, tions (Standard DBT = 64 vs. Cognitive Behavior Therapy;
emotional eating, expressive suppression, and impulsivity) and TAU CBT = 45). Assignment to the treatment conditions
increasing adaptive emotion regulation strategies (cognitive was conducted based on two main criteria: (1) therapist
reappraisal). trained in DBT and (2) type of treatment setting (outpatient
or day hospital). Therefore, participants who were assigned
Methods to DBT-trained therapists (according to the therapist’s work-
load) received DBT, and those who were assigned to thera-
Participants pists not trained in DBT received TAU CBT. Number of
participants from the different settings (outpatient or day
Participants were recruited from three private outpatient and hospital) was equivalent between conditions.
day-hospital clinics in the Valencian community (Spain). Regarding therapists, ten clinicians participated in the
These clinics receive referrals from heterogeneous practice study (five of them administered DBT, and the other five
settings ranging from private practice to the public mental administered TAU CBT). One of the DBT therapists (author
health system. Before starting the treatment, advisors of the A G-P) had received training in DBT and DBT adherence
clinics carried out a screening process to assess whether par- coding at the University of Washington from Dr. Linehan’s
ticipants met the inclusion/exclusion criteria for the study. team and trained the other four therapists in DBT. Training
Inclusion criteria were: (1) meeting the DSM-IV diagnostic consisted of 40 h of DBT seminars and supervised practice
criteria for BPD, as assessed by the Structured Clinical Inter- over the course of 6 months. The therapists conducting TAU
view for the DSM-IV Axis II Disorders (SCID-II; First et al. CBT had received training in CBT for BN (Wilson et al.
1997); (2) meeting the DSM-IV diagnostic criteria for an eat- 1997) and AN (Garner et al. 1997) protocols. They were
ing disorder (BN, AN, or EDNOS), assessed by the clinician also supervised during the 6 months of the treatment by the
using the Structured Clinical Interview for the DSM-IV Axis senior clinicians of the center, who had more than 25 years
I Disorders (SCID-I; First et al. 1996). Only diagnoses scored of experience in clinical practice and research in CBT.
as full threshold on the SCID-I were considered; and (3) age
18 years or older. Exclusion criteria were: (1) a diagnosis of Follow‑up Study
psychotic disorder and/or bipolar I disorder; (2) alcohol or
other substance dependence; or (3) organic disease that could The current follow-up study had two time periods. The out-
interfere with the psychological treatment. Characteristics of come measures were followed prospectively for 6 years after
the sample that participated in the follow-up are described in the interventions, with two assessment points: 4 years (T2)
the results section. and 6 years (T3). Participants in the follow-up assessment
points were contacted via email to answer a survey (using
Study Design and Procedure Survey Monkey, following the ethical standards) that con-
tained the study measures described below. Before filling
The current research is a prospective study with long-term out the measures, participants were given a description of
outcomes of the previous pre-post clinical controlled trial the study and a consent form. Participants who were not
(Navarro-Haro et al. 2018). reached by email were contacted by phone by the clinic’s

13
Author's personal copy
Cognitive Therapy and Research

consultants and if they agreed to participate, completed the nitive reappraisal (6 items) and expressive suppression (4
questionnaires over the phone. items). Cognitive reappraisal is a form of cognitive change
that involves construing a potentially emotion-eliciting situ-
Instruments ation in a way that changes its emotional impact. Expressive
suppression is a type of response modulation that involves
Pre‑intervention inhibiting ongoing emotion-expressive behaviors. Scores
range from 10 to 70 for the whole scale: 6–42 for cognitive
The demographic and clinical characteristics of the sam- reappraisal and 4–28 for Expressive suppression. Gross and
ple were assessed using the BPD Clinical Data Inventory John (2003) found adequate psychometric properties for this
(García-Palacios 2005, unpublished manuscript). The BPD measure, with alpha reliabilities of 0.79 for reappraisal, 0.73
clinical data inventory is a clinical document that was for suppression. The Spanish version presented adequate
designed by our research team and used by the clinician internal consistency (α = 0.75 for suppression, and α = 0.79
to gather relevant and specific demographic and clinical for reappraisal; Cabello et al. 2013).
information. The demographic information collected was:
age, marital status (single, in a relationship, married, or Impulsivity The Barratt Impulsiveness Scale (BIS-11; Bar-
divorced), education level (no formal education, elementary, rat 1995; Spanish version; Oquendo et al. 2001) is one of
middle, higher), and employment status (student, unskilled the most commonly administered self-reports for the assess-
worker, skilled worker, unemployed, housewife, disability, ment of impulsiveness (a multidimensional personality trait
sick leave/retired). Clinical information selected for this related to the control of emotions and behavior; Barratt et al.
study included: multiaxial diagnosis (DSM-IV-TR, APA 2004) in both general and clinical settings. The BIS-11 con-
2000), previous psychological treatment, use of substances, sist of 30 items with 4 response options. Higher mean scores
frequency of maladaptive eating behaviors, dysfunctional indicate greater impulsiveness. Exploratory component
impulsive behaviors (e.g. impulsive sex, etc.), non-suicidal analysis of the items identified three subscales: Attentional
self-injuries in the past week, and frequency of suicide Impulsiveness, Motor Impulsiveness, and Non-planning
attempts and hospitalization in the past 6 months. Impulsiveness. For this study, only the total score was used.
Alpha coefficients for the total BIS total score ranged from
Main Outcome Measures 0.79 to 0.83 in clinical populations (Patton et al. 1995), and
the total score has shown high predictive validity in assess-
The outcome measures selected for the follow-up were those ing high-risk behaviors in both adults and adolescents (e.g.
that allowed the four time periods to be compared. The main Salvo and Castro 2013; Stanford et al. 2009; von Diemen
outcome measures for this study were: depression, impulsiv- et al. 2007). The reliability of the total score for the Spanish
ity, anger, emotional eating, emotional regulation strategies, version was also high (α = 0.81; Oquendo et al. 2001).
and resilience. Participants were assessed using standardized
and validated self-report measures, as follows. Anger The State-Trait Anger Expression Inventory-2
(Spielberger 1999; Spanish version; Tobal et al. 2001) is
Depression The Beck Depression Inventory-II (BDI-II; one of the most widely used self-report measures to assess
Beck et al. 1996, Spanish version; Sanz et al. 2003) is one of the experience, expression, and control of anger in research
the most widely used self-report measures to assess depres- and clinical settings. The STAXI-2 comprises 49 items with
sive symptoms. It contains 21 items answered on a Likert- a Likert-type 4-point response scale, and it is divided into
type response scale ranging from 0 to 3. Scores range from 0 three scales: (a) how angry the examinee currently feels
to 63, with higher scores reflecting greater depressive symp- (state), (b) how angry the examinee generally feels (trait),
tomatology. Internal consistency for clinical population was and (c) how the examinee reacts when angry (control). In
0.89 for the Spanish version (Sanz et al. 2005), which is this study, only the state anger and trait anger scales were
similar to the alpha found in other studies (e.g. Aasen 2001; used. The state anger scores range from 15 to 60; and the
Hunt et al. 2003). trait anger scores range from 10 to 40. The internal con-
sistency of the STAXI-2 showed Cronbach’s alphas for the
Emotion Regulation The Emotion Regulation Questionnaire scales ranging from 0.73 to 0.93 (Spielberger 1999). The
(ERQ, Gross and John 2003, Spanish version; Cabello et al. Spanish validation of the scale also showed good internal
2013) is a self-report measure to evaluate two commonly consistency (Cronbach’s alpha of 0.89 for state anger and
used emotion regulation strategies: cognitive reappraisal 0.82 for trait anger; Tobal et al. 2001).
and expressive suppression. It contains 10 items with a Lik-
ert-type response scale ranging from 1 (strongly disagree) to Emotional Eating The Emotional Eating Scale (EES;
7 (strongly agree) and it is divided into two subscales: cog- Arnow et al. 1995) asks participants to rate the extent to

13
Author's personal copy
Cognitive Therapy and Research

which different feelings lead them to feel an urge to eat, Linehan’s 1993b manual and its version translated into
using a 5-point scale ranging from “no desire to eat” to “an Spanish (Linehan 2003). The phone coaching mode was
overwhelming urge to eat”. Higher scores indicate a greater applied to generalizing skills to daily life and learning
desire/urge to eat in response to a specific feeling. This scale how to ask for help in crisis situations. The consultation
has 25 items divided into 3 subscales: Anger/Frustration, team met weekly with the aim to support the therapists and
Anxiety, and Depression. All three subscales correlated ensure adherence to the treatment program.
highly with measures of binge eating, providing evidence of Treatment as usual is a cognitive behavioral program
the “emotional eating” construct. Only the total score was (TAU CBT) focused mainly on addressing ED psycho-
used in this study. The original coefficient alpha for the total pathology (education of the disorder, self-monitoring,
scale ranged from 0.81 (Arnow et al. 1995) to 0.93 (Waller establishing regular eating, reducing dysfunctional eat-
and Osman 1998), indicating acceptable internal consist- ing behaviors, and changing misinterpretations of body
ency. The adaptation of this scale for children and adoles- image). The TAU CBT program included components of
cents has been validated in the Spanish population, showing CBT for BN (Wilson et al. 1997) and AN (Garner et al.
good internal consistency (Perpiñá et al. 2011). 1997). The program also targeted other symptoms that are
more related to the personality psychopathology (self-
Resilience The Resilience Scale (RS; Wagnild and Young harm, substance use, etc.), using CBT strategies. In order
1993) is a self-report measure of the extent individual resil- to match the dose of therapy received in the two treatment
ience, conceptualized as a positive personality characteristic conditions, participants in TAU CBT received one weekly
that enhances successful adaptation when facing adversity individual therapy session lasting one hour and one weekly
(Gail and Heather 1993). The current study used the short- group session lasting approximately two hours. The TAU
ened 15-item version (RS15), with Likert-type responses CBT was adapted to a group format by the clinical team.
on a 7-point scale ranging from disagree to agree. Possible The treatment programs lasted 6 months. The DBT
scores range from 15 to 105, and higher mean scores indi- program was adapted to 6 months, instead of 12 months,
cate greater perceived resilience. A preliminary factor anal- to match the TAU CBT’s length and because research
ysis of the RS15 showed a unidimensional global resilience applying DBT for 6 months shows good outcomes (e.g.
factor, with factor loadings ranging from 0.52 to 0.75. Its Brassington and Krawitz 2006; McMain et al. 2017).
15 items accounted for 44% of the variance (Neill and Dias The main difference between the two treatments is that
2001). Both the original RS and RS15 have shown good the DBT program focused on emotion dysregulation and
internal consistency, reporting Cronbach’s alphas of around included acceptance-based strategies, whereas the CBT
0.90 (Gail and Heather 1993; Neill and Dias 2001). The RS TAU program aimed to change eating psychopathology
has shown good internal consistency in Spanish clinical and related symptoms (e.g. perfectionism). Dysfunctional
samples (α = 0.88) (Becoña Iglesias et al. 2013). eating behaviors in DBT are conceptualized as attempts
by individuals to mitigate emotions when experiencing
Interventions affective dysregulation and nutritional vulnerability caused
by caloric deprivation or indulgence (Bankoff et al. 2012).
The interventions conducted during the pre-post study are Most of the participants received pharmacological
described briefly (for a more extended description, see Nav- treatment (87%) during the pre-post trial. Medication was
arro-Haro et al. 2018). constant during the study in most cases, and medication
Standard Dialectical Behavior Therapy (DBT) (Line- changes were made in exceptional cases. There is still not
han, 1993a, b; Linehan et al. 2015) included four inter- enough evidence about pharmacological treatment for
vention modes: individual psychotherapy, skills training, BPD (i.e., Stoffers, et al. 2010), therefore medication was
phone calls, and a consultation team. Individual psycho- co-adjutant or auxiliary (Linehan 1993a, b, p. 105) to the
therapy was provided in one-hour weekly sessions with the psychological treatment, the primary treatment based on
aim of improving awareness and reducing specific prob- clinical guidelines for BPD (e.g. American Psychological
lem behaviors. Individual therapy followed the principles Association; APA; 2006). Participants in outpatient and
and target hierarchy of standard DBT (Linehan 1993a, b). day hospital settings received the assigned treatment con-
Skills training consisted of weekly group sessions last- dition (DBT or TAU CBT), but the individuals attending
ing approximately 2 h. The aim of the skills training was the day hospital also attended other ancillary therapeutic
to increase skills related to acceptance and awareness activities that were part of the day hospital routine (e.g.
(mindfulness, distress tolerance) and to behavioral change normalization of eating habits). Both DBT and CBT pro-
(emotion regulation and interpersonal effectiveness). This grams accept auxiliary treatments as a complement to their
training lasted 24 sessions, and contents were taken from protocols.

13
Author's personal copy
Cognitive Therapy and Research

Statistical Analysis the treatment, for each treatment condition. Calculation of


the RCI resulted in a z-score (standard score). A reliable
The baseline sociodemographic and clinical characteristics change at a 95% confidence level was achieved for values
of participants were described using means (and standard equal or higher than ±1.96.
deviations) for the continuous variables, and frequencies All statistical analyses were computed using SPSS ver-
(and percentages) for the categorical variables. To compare sion 22.0 software for Windows. All tests were performed
significant baseline differences in sociodemographic and using a two-sided approach, with a significance level set at
clinical characteristics between the DBT and TAU CBT con- 0.05.
ditions, Chi-square statistics were performed on categorical
variables, whereas Student’s t tests were used for continuous
variables. Missing Data
Changes in outcome measures from pre-treatment to
the follow-ups (T0–T1, T0–T2 and T0–T3), and during the As normally occurs in longitudinal research, not all par-
follow-up period (T1–T2, and T2–T3), were evaluated sepa- ticipants reported information at all the time points. Partici-
rately for each treatment condition using one factor repeated pants were assessed four times: before the treatment (T0;
measures ANOVA. The Greenhouse–Geisser correction was n = 109), after the treatment (T1; n = 69), 4 years later (T2;
used if Mauchly’s test indicated a violation of the sphericity n = 15), and 6 years later (T3; n = 15). Missing values were
assumption. Furthermore, to reduce chances of type 1 statis- less than 5% at T0, less than 38% at T1, and 83.5% at T2
tical errors, Bonferroni adjustment for multiple comparisons and T3. As recommended (Graham 2009; van Ginkel et al.
was applied to the p-values. The mean and the standard devi- 2020), missing data were multiple imputed, one of the best
ation were used to summarize the results at each time point. methods currently available to deal with missingness. We
To investigate if changes in outcome measures across the employed multiple imputation in SPSS to create and analyze
four time points (intrasubject factor: pre-treatment, post- imputed datasets (m = 100) using the main outcome meas-
treatment, and 4- and 6-years follow-ups) differed signifi- ures (Graham et al. 2007). In addition, we also included
cantly between the two treatment conditions (intersubject auxiliary variables in the missing data model (Allison 2001;
factor: DBT vs. TAU CBT), mixed factor repeated ANOVA Collins et al. 2001). Consistent with suggestions by Hardt
tests for the two factors (intrasubject and intersubject fac- et al. (2012), the number of auxiliary variables included in
tors) were conducted. Treatment condition, time and the the imputation could not exceed 1/3 of the number of com-
interaction between treatment condition and time (treat- pleters. Thus, we included five auxiliary variables used at
ment condition × time) were included as fixed effects in the pre-treatment: (1) frequency of maladaptive eating behaviors
model for each of the outcome’s measures. The interaction in the past week, (2) frequency of dysfunctional impulsive
of treatment condition × time tested if changes over time dif- behaviors in the past week, (3) frequency of hospitalization
fered significantly between the DBT and TAU CBT groups. in the past 6 months, (4) frequency of non-suicidal self-inju-
Previously, the assumption of homogeneity of covariance ries in the past week, and (5) frequency of suicide attempts
was examined using Box’s M test and, the most robust cri- in the past 6 months. The comparison of the original and
terion, Pillai’s trace, was used (instead of Wilk’s lambda) imputed databases of outcomes at pre-treatment revealed
to evaluate the multivariate significance of the interaction no significant sample differences in the analyzed variables.
(Tabachnick and Fidell 2007). The effect size was measured Thus, the results from the imputed database were reported.
using partial eta squared (η2). Considering Cohen’s guide-
lines, 0.01 was interpreted as a small effect, 0.06 a medium
effect and 0.14 a large effect (Cohen 1988).
Finally, reliable change for the outcome measures from Results
pre-treatment to the follow-ups (T0–T1, T0–T2 and T0–T3),
and during the follow-up periods (T1–T2, and T2–T3), was Participants’ Characteristics
also calculated separately for each treatment condition using
the Reliable Change Index (RCI) by Jacobson and Truax’s One hundred nine women (age 27.38 ± 8.81 years) partici-
(1991). The RCI determines if the change observed within pated in the study. Table 1 presents participants’ charac-
each patient is likely to be in excess of change that could be teristics at pretreatment for the total sample and by treat-
accounted for measurement error alone. In practical terms, ment condition. The majority of the participants were single
the RCI indicates whether a given difference score reflects (67%), had mid-level education or less (74.3%), and had an
a statistically reliable treatment effect. Thus, the RCI exam- EDNOS (60.7%). There were no statistically significant dif-
ined the percentage of participants that made significant and ferences at baseline between the two treatment conditions
clinically meaningful change at various time periods during on any of the sociodemographic or psychological outcomes.

13
Author's personal copy
Cognitive Therapy and Research

Table 1  Demographic and clinical characteristics of the participants at pre-treatment (baseline)


Total sample (N = 109) DBT (n = 64) TAU CBT (n = 45) Test p

Age, mean (SD) 27.38 (8.81) 28.23 (9.12) 26.22 (8.33) t = 1.16 .248
Marital status, n (%) χ2 = 3.49 .480
Single 73 (67) 45 (70.3) 28 (62.2)
In a relationship 6 (5.5) 3 (4.7) 3 (6.7)
Married 11 (10.1) 5 (7.8) 6 (13.3)
Divorcied 13 (11.9) 9 (14.1) 4 (8.9)
Not reported 6 (5.5) 2 (3.1) 4 (8.9)
Education level, n (%) χ2 = 3.87 .276
No formal education 3 (2.8) 2 (3.1) 1 (2.2)
Elementery education 25 (22.9) 19 (29.7) 6 (13.3)
Middle education 53 (48.6) 28 (43.8) 25 (55.6)
Higher education 23 (21.1) 14 (21.9) 9 (20)
Not reported 5 (4.6) 1 (1.6) 4 (8.9)
Employment status, n (%) χ2 = 9.83 .132
Student 31 (28.4) 19 (29.7) 12 (26.7)
Unskilled worker 7 (6.4) 5 (7.8) 2 (4.4)
Skilled worker 11 (10.1) 9 (14.1) 2 (4.4)
Unemployed 9 (8.3) 4 (6.3) 5 (11.1)
Housewife 6 (5.5) 5 (7.8) 1 (2.2)
Disability 4 (3.7) 1 (1.6) 3 (6.7)
Sick leave 5 (4.6) 5 (7.8) 0 (0.0)
Not reported 36 (33) 16 (25) 20 (44.4)
Axis I primary disorder, n (%) χ2 = 1.20 .550
Bulimia nervosa 24 (22.6) 16 (25) 8 (17.8)
Anorexia nervosa 18 (16.5) 9 (14.1) 9 (20)
Eating disorder not otherwise specified 67 (61.5) 39 (60.9) 28 (62.2)
Axis II primary disorder, n (%)
Bordeline personality disorder 109 (100) 64 (100) 45 (100)
Substance use, n (%) χ2 = 0.003 .957
Yes 48 (44) 29 (45.3) 19 (42.2)
No 41 (37.6) 25 (39.1) 16 (35.6)
Not reported 20 (18.3) 10 (15.6) 10 (22.2)
Previous psychological treatment, n (%) χ2 = 0.97 .324
Yes 69 (63.3) 40 (62.5) 29 (64.4)
No 23 (21.1) 16 (25) 7 (15.6)
Not reported 17 (15.6) 8 (12.5) 9 (20)
GAF (EJE V), mean (SD) 48.73 (13.59) 49.25 (13.29) 47.8 (14.26) t = 0.47 .64
Hospitalization (last 6 months), mean (SD) 1.25 (2.29) 1.12 (2.18) 1.45 (2.45) t = −0.66 .513
Suicide attempt (last 6 months), mean (SD) 0.60 (1.20) 0.68 (1.38) 0.45 (0.85) t = 0.87 .386
NSSI (last 6 months) 1.82 (4.13) 2.23 (5.02) 1.18 (1.97) t = 1.14 .256
Disfunctional behavior (last week), mean (SD) 4.24 (2.29) 4.36 (2.28) 4.05 (2.32) t = −0.61 .539
Disfunctional eating beahavior (last week), mean (SD) 1.40 (1) 1.38 (0.95) 1.41 (1) t = −0.12 .903
BDI-II, mean (SD) 28.96 (15.06) 30.53 (15.69) 26.75 (13.99) t = 1.28 .204
ERQ, mean (SD)
Cognitive reappraisal 20.67 (7.54) 19.98 (7.46) 21.61 (7.62) t = −1.09 .278
Expressive suppression 13.06 (5.97) 13.33 (5.89) 12.68 (6.11) t = 0.55 .582
Resilience 52.27 (20) 51.11 (20.53) 53.91 (19.34) t = −0.71 .481
Impulsivity 42.01 (10.05) 43.54 (9.83) 39.38 (10.05) t = 1.80 .076
STAXI, mean (SD)
State 25.14 (12.04) 25.41 (12.62) 24.76 (11.30) t = 0.28 .781
Trait 27.12 (7.41) 27.15 (7.43) 27.07 (7.46) t = 0.06 .950
Emotinal eating, mean (SD) 50.11 (24.38) 51.94 (25.82) 47.48 (22.16) t = 0.92 .361

13
Author's personal copy
Cognitive Therapy and Research

Table 1  (continued)
DBT Dialectical Behavior Therapy, TAU Treatment As Usual, t Student t test, χ2 Chi square test, p statistical significance, N number of partici-
pants, SD standard deviation, GAF Global Assessment of Functioning, BDI-II Beck Depression Inventory, ERQ Emotion Regulation Question-
naire, STAXI State-Trait Anger Expression Inventory-2

Attrition Bias Assessment there were statistically significant improvements in most of


the study variables from the pre-treatment assessment to the
As is common in longitudinal research, not all the partici- follow-up assessments, except for State Anger and Cognitive
pants supplied data at the four time points. Main treatment Reappraisal. In addition, contrasts between T1 and T2, and
outcome data were obtained for 69 participants at post- between T2 and T3, showed that there was a trend toward
test (DBT = 38, TAU CBT = 31) and for 15 participants continued improvement on the Resilience and Emotional
in the first and second follow-up periods (DBT = 10, TAU Eating scores from the post-treatment assessment to the fol-
CBT = 5). The TAU CBT condition retained fewer partici- low-up assessments. Moreover, comparisons of T1 and T2
pants at post-treatment and in the follow-up periods than the revealed that there was an improvement on the BDI-II and
DBT condition, but these differences were not statistically impulsivity scores from the post-treatment assessment to the
significant (p = 0.310; p = 0.501; respectively). first follow-up assessment. Lastly, comparisons of T2 and T3
To assess attrition bias, we compared participants who revealed that there was an improvement on the Expressive
dropped out of the study (T0–T3; n = 93) with those who suppression and Trait Anger scores from the first follow-up
completed all the time points (T0–T3; n = 16) on the mean assessment to the second follow-up assessment.
scores on the primary outcomes at pre-treatment, using Stu- In the TAU CBT condition (see Table 3), comparisons of
dent’s t test for independent samples. No statistically sig- T0 and T2, and T0 and T3, revealed that there were statis-
nificant differences between completers and dropouts were tically significant improvements in the BDI-II, Resilience,
found on depression (t = −1.35, p = 0.181), cognitive reap- and Trait Anger scores from the pre-treatment assessment
praisal of emotion regulation (t = 0.92, p = 0.359), expressive to the follow-up assessments. Moreover, there were sta-
suppression of emotion regulation (t = −1.03, p = 0.305), tistically significant improvements in the Expressive sup-
resilience (t = 1.28, p = 0.202), impulsivity (t = −0.52, pression scores from the pre-treatment assessment to the
p = 0.605), or trait anger (t = −0.18, p = 0.858). There were second follow-up assessment (T0–T3). Comparisons of
statistically significant differences between completers T1 and T2, and T2 and T3, showed that the Resilience and
and dropouts at pre-treatment on emotional eating scores Trait Anger scores improved during the follow-up periods,
(t = −3.98, p < 0.001) and state anger (t = −1.85, p = 0.075), although the improvement in the Trait Anger scores between
although the difference in state anger scores was only mar- T1 and T2 was only marginally significant (p = 0.065). In
ginally significant. Thus, we performed the analyses on the addition, comparisons of T1 and T2 revealed that there was
imputed database. an improvement in the scores on the BDI-II and Cognitive
Reappraisal from the post-treatment assessment to the first
Pre–post Analysis for Each Treatment follow-up assessment.

Pre–post analyses were performed based on the imputed Between‑subjects Comparisons


database. Tables 2 and 3 display means and standard devia-
tions for the outcome measures at pre-treatment, post-treat- Mixed factor repeated ANOVA tests were performed based
ment, and follow-up periods for the DBT and TAU CBT on the imputed database to examine if changes in outcome
conditions, respectively. In the DBT condition, participants measures across the four time points (pre-treatment, post-
showed an improvement on the BDI-II, Resilience, and Trait treatment, and 4- and 6-years follow-up assessments) dif-
Anger scores at the post-treatment assessment (see Table 2), fered significantly between DBT and TAU CBT groups. The
although the improvement in Resilience was only margin- interaction of group × time was not statistically significant
ally significant (p = 0.057); whereas participants in the TAU on BDI-II (Pillai’s trace = 0.06, F[3, 105] = 2.24, p = 0.088,
CBT condition did not exhibit pre-post improvements in any η2 = 0.06), Cognitive Reappraisal (Pillai’s trace = 0.06,
variable (see Table 3). F[3, 105] = 2.30, p = 0.082, η2 = 0.06), Expressive Sup-
pression (Pillai’s trace = 0.04, F[3, 105] = 0.14, p = 0.937,
Follow‑up Comparisons for Each Treatment η2 = 0.01), Resilience (Pillai’s trace = 0.02, F[3, 105] = 0.72,
p = 0.543, η2 = 0.02), Impulsivity (Pillai’s trace = 0.05, F[3,
Follow-up analyses were performed based on the imputed 105] = 1.82, p = 0.147, η2 = 0.05), State Anger (Pillai’s
database. For the DBT condition, as Table 2 shows, contrasts trace = 0.01, F[3, 105] = 0.04, p = 0.988, η2 = 0.00), Trait
between T0 and T2, and between T0 and T3, revealed that Anger (Pillai’s trace = 0.03, F[3, 105] = 0.93, p = 0.429,

13
Author's personal copy
Cognitive Therapy and Research

η2 = 0.03), and Emotional Eating scores (Pillai’s trace = 0.07,

DBT Dialectical Behavior Therapy, T0 pre-treatment, T1 post-treatment, T2 follow up 1, T3 follow up 2, F intrasubject ANOVA test, η2 partial eta squared, p value statistical significance, BDI-II
p value
T2–T3

<.001
F[3, 105] = 2.48, p = 0.065, η 2 = 0.07), indicating that

.047

.366

.001

.010
.001

1
changes over time did not differ between the DBT and TAU
p value CBT groups on any variable at any time.
T1–T2

<.001
.007

.309

.002
Reliable Change Index

.02
Table 2  Comparison of means scores (standard deviations) in pre-treatment, post-treatment and follow ups with post hoc Bonferroni correction for the DBT condition (n = 64)


1

1
Reliable Change scores in the outcome measures for each
p value
T0–T3

<.001

<.001
<.001

<.001
treatment condition across all the time assessments were
.143

.043

.001
calculated based on the imputed database. Table 4 displays


Reliable Change Index-Improvement scores for each treat-
ment condition across the time assessments. In general, the
p value
T0–T2

<.001

<.001

<.001
.009
.334

.048

.005
DBT group showed the highest proportion of participants

indicating reliable change for depression (32.8–57.8%),


resilience (21.9–64.1%) and cognitive reappraisal (around
p value
T0–T1

30%) from pre-treatment to the follow-ups. Over one fifth of


.026

.105
.057

.002

the participants (around 25–60%) showed reliable change for



1

state and trait anger in both conditions from pre-treatment


to the follow-ups.
.01
.19

.98
.11
.33
.08

.19
.20
η2

Beck Depression Inventory, ERQ Emotion Regulation Questionnaire, STAXI State-Trait Anger Expression Inventory 2

Discussion
15.14***

7.63***
30.33***
5.40***

14.47***
15.46***
4.52**

0.31
F

The main purpose of this study was to compare long-term


treatment outcomes of two interventions, standard DBT vs.
20.70 (10.10)

73.33 (13.01)

TAU CBT, to treat BPD and ED comorbidity in a naturalis-


21.50 (4.24)
22.55 (3.59)

39.94 (2.49)

24.70 (7.06)
9.92 (2.76)

tic setting. Our main hypothesis was that, in the long term,
38 (8.03)
M (SD)

DBT would be superior to CBT TAU in improving variables


T3

related to emotion dysregulation (depression, anger, impul-


sivity, emotional eating, and emotion regulation strategies).
In the DBT condition, there was a statistically significant
67.61 (10.29)

22.81 (3.31)
17.89 (7.36)

23.59 (4.16)
11.82 (2.93)

39.64 (3.68)

24.39 (6.13)

40.41 (7.85)

improvement in most of the study variables (depression,


M (SD)

emotional eating, trait anger, impulsivity, resilience, and


expressive suppression) from pre-treatment to the follow-
T2

up periods (T0–T2 and T0–T3), except for state anger and


cognitive reappraisal. In addition, there was a trend toward
25.35 (16.28)

57.88 (18.76)

51.26 (19.80)
24.07 (7.82)
21.65 (7.08)
11.45 (5.57)

41.88 (6.74)

24.15 (8.93)

continued improvement on resilience, and the emotional


eating scores. In the TAU CBT condition, there was a sta-
M (SD)

tistically significant improvement in depression, resilience,


Levels of significance: *p < .05, **p < .01, ***p < .001
T1

and trait anger scores from the pre-treatment assessment to


the follow-up assessments (T0–T2 and T0–T3). There was
30.36 (15.49)

51.18 (20.57)

25.41 (12.52)

51.80 (25.47)

a trend toward continued improvement on the resilience and


27.02 (7.46)
19.97 (7.52)
13.25 (5.79)

43.07 (9.14)

trait anger scores.


M (SD)

To our knowledge, this is the first study to test emotional


T0

eating in individuals with BPD and EDs. Emotional eating


has been defined as the tendency to eat in order to regu-
late negative emotions, without attending to physiological
Expressive suppression
Cognitive reappraisal

hunger needs (López-Montoyo and Cebolla 2016). From a


DBT perspective, maladaptive eating behaviors are forms
Emotional eating

of emotion regulation used by individuals in response to


Impulsivity

emotions that are difficult to tolerate (Bankoff et al. 2012).


Resilience

STAXI

These results indicate that an ED factor related to emotion


BDI-II

State
Trait
ERQ

dysregulation decreased after a DBT intervention, and the

13
Author's personal copy
Cognitive Therapy and Research

Table 3  Comparison of means scores (standard deviations) in pre-treatment, post-treatment and follow ups with post hoc Bonferroni correction
for the TAU CBT condition (n = 45)
T0 T1 T2 T3 F η2 T0–T1 T0–T2 T0–T3 T1–T2 T2–T3
M (SD) M (SD) M (SD) M (SD) p value p value p value p value p value

BDI-II 26.90 (13.87) 27.67 (16.78) 18.05 (3.38) 18.95 (3.41) 12.84*** .23 1 .001 .001 .003 1
ERQ
Cognitive reappraisal 21.65 (7.54) 19.85 (7.04) 23.40 (1.33) 23.62 (2.22) 5.87** .12 .631 .791 .588 .009 1
Expressive suppression 12.72 (6.05) 11.54 (4.95) 11.59 (1.85) 9.87 (0.96) 5.07** .10 .762 1 .015 1 <.001
Resilience 54 (19.12) 56.90 (17.79) 67.89 (4.75) 75.54 (5.55) 35.25*** .45 1 <.001 <.001 .001 <.001
Impulsivity 39.68 (8.79) 41.75 (7.21) 40.13 (3.06) 40.48 (2.56) 1.50 .03 – – – – –
STAXI
State 24.76 (11.31) 23.73 (8.45) 23.67 (2.02) 23.72 (2.69) 0.28 .01 – – – – –
Trait 27.07 (7.46) 25.57 (8.62) 22.24 (2.07) 20.80 (2.18) 15.73*** .26 .348 .001 <.001 .065 <.001
Emotional eating 46.69 (21.99) 44.93 (18.30) 42.91 (7.76) 39.48 (7.71) 2.43 .05 – – – – –

TAU CBT Treatment As Usual Cognitive Behavior Therapy, T0 pre-treatment, T1 post-treatment, T2 follow up 1, T3 follow up 2, F intrasubject
ANOVA test, η2 partial eta squared, p value statistical significance, BDI-II Beck Depression Inventory, ERQ Emotion Regulation Questionnaire,
STAXI State-Trait Anger Expression Inventory 2
Levels of significance: *p < .05, **p < .01, ***p < .001

Table 4  Reliable Change Index-Improvement: number of individuals (percentage) surpassing 1.96 on RCI
T0–T1 T0–T2 T0–T3 T1–T2 T2–T3
DBT TAU-CBT DBT TAU-CBT DBT TAU-CBT DBT TAU-CBT DBT TAU-CBT
n (%) n (%) n (%) n (%) n (%) n (%) n (%) n (%) n (%) n (%)

BDI-II 21 (32.8) 10 (22.2) 37 (57.8) 20 (44.4) 34 (53.1) 16 (35.6) 26 (40.6) 18 (40) 1 (1.6) 1 (2.2)
ERQ
Cognitive reappraisal 18 (28.1) 4 (8.9) 21 (32.8) 10 (22.2) 18 (28.1) 11 (24.4) 17 (26.6) 12 (26.7) 2 (3.1) 2 (4.49)
Expressive suppression 14 (21.9) 8 (17.8) 13 (20.3) 10 (22.2) 18 (28.1) 12 (26.7) 6 (9.4) 5 (11.1) 4 (6.3) 1 (2.2)
Resilience 14 (21.9) 8 (17.8) 35 (54.7) 20 (44.4) 41 (64.1) 24 (53.3) 22 (34.4) 18 (40) 3 (4.7) 1 (2.2)
Impulsivity 6 (9.4) 2 (4.4) 9 (14.1) 1(2.2) 8 (12.5) 1(2.2) 2 (3.1) 3 (6.7) 1(1.6) 0 (0.0)
STAXI
State 19 (29.7) 10 (22.2) 22 (34.4) 13 (28.9) 22(34.4) 14 (31.1) 18 (28.1) 8 (17.8) 3 (4.7) 2 (4.4)
Trait 22 (34.4) 12 (26.7) 28 (43.8) 20 (44.4) 33 (51.6) 26(57.8) 22 (34.4) 15 (33.3) 2 (3.1) 2 (4.4)
Emotional eating 6 (9.4) 4 (8.9) 25 (39.1) 13 (28.9) 27 (42.2) 15 (33.3) 18 (28.1) 8 (17.8) 1 (1.6) 0 (0.0)

T0 pre-treatment, T1 post-treatment, T2 follow up 1, T3 follow up 2. DBT Dialectical Behavior Therapy, TAU​Treatment As Usual, BDI-II Beck
Depression Inventory, ERQ Emotion Regulation Questionnaire, STAXI State-Trait Anger Expression Inventory 2

improvement was maintained in the long term. Regarding any condition. Due to the emotional instability of the BPD
depression, the improvement found with both interventions population, it is difficult to analyze state measures.
is consistent with previous studies using shorter follow-ups According to the biosocial theory (Linehan 1993a, b;
to evaluate treatments for BPD (e.g. McMain et al. 2012). Crowell et al. 2009), poor impulse control and emotional
In a recent literature review on the effectiveness of DBT sensitivity are early biological vulnerabilities for BPD. A
for EDs, medium to large effect sizes were noted in treat- child born with heightened biological sensitivity to emo-
ing depression symptoms (Lenz et al. 2014). Furthermore, tional cues encounters emotionally aversive experiences
both treatments improved trait anger over time (although the (e.g., emotional neglect, invalidation) and consequently
improvement between T1 and T2 in the TAU CBT condi- develops biological and psychological alterations of the
tion was only marginally significant), which is a promising emotion regulation system (e.g. Distel et al. 2011). The
outcome because previous studies show that personality psychological alterations manifest in adulthood involve
traits, such as chronic anger, are more resistant over time maladaptive or insufficient knowledge in how to understand,
(Álvarez-Tomás et al. 2017; Gunderson et al. 2011; Zanar- label, regulate, or tolerate emotional responses effectively
ini et al. 2016). However, state anger did not improve in (Neacsiu et al. 2014).

13
Author's personal copy
Cognitive Therapy and Research

The results of this study are promising because they sug- interpersonal effectiveness, mindfulness practice, and real-
gest a good outcome on two fundamental etiological factors ity acceptance skills; Linehan et al., 2015). The change in
of emotional vulnerability in BPD according to the bioso- resilience found in this study may indicate that DBT could
cial theory, impulsivity and emotion dysregulation (Crowel help to develop a protective factor against psychiatric dis-
et al. 2009). Specifically, the results show an improvement in orders in the long term in individuals with severe emotion
emotional suppression, a strategy aimed to escape or avoid dysregulation.
undesired internal experiences. One way of dealing with Contrary to our hypotheses, there were no statistically
aversive and intense emotions for BPD patients is to sup- significant differences between DBT and TAU CBT in the
press them. This can be achieved by the use of impulsive analyzed variables over time. Moreover, the RCI improve-
behaviors like non-suicidal self-injuries (Navarro-Haro et al. ment scores also provided useful supplemental data for
2015). Emotional suppression also appears to be a signifi- evaluating the treatment programs. In general, the percent-
cant mediator between undesired affect reactivity and inten- ages of participants showing a clinically significant change
sity and BPD symptomatology, even after controlling for a (improvement) over time were high in the DBT condition for
history of childhood sexual abuse (Rosenthal et al. 2008). depression, resilience, and cognitive reappraisal. These find-
Another emotion regulation strategy is cognitive reap- ings indicate that a great number of participants with BPD
praisal, a form of cognitive change that involves reinterpret- and ED improved over time in the DBT condition, which is a
ing the meaning of a potentially emotion-eliciting situation good indicator of clinical significance. We also would like to
and thereby changing the trajectory of an emotional response mention that the TAU CBT condition retained fewer partici-
(Lazarus and Alfert 1964). However, cognitive reappraisal pants at post-treatment and in the follow-up periods than the
did not significantly increase after treatment. Fruzzetti and DBT condition, but these differences were not statistically
Shenk (2020) suggested that when we are highly emotionally significant. This result is consistent with previous studies
aroused, we demonstrate less cognitive capacity, self-aware- showing that DBT has high retention rates after treatment
ness and the ability to solve problems. Furthermore, some and at follow-up in BPD and ED populations (e.g. Linehan
of the characteristics of pervasive emotion dysregulation in et al. 2006; Navarro-Haro et al. 2018; Safer et al. 2010),
BPD are related with impairment in cognitive reappraisal which may improve long-term cost-effectiveness.
(difficulties drawing attention away from emotional stimuli, We expected that DBT would show significantly higher
failures in information processing, and problems organizing improvements in the outcomes more related to emotion
activities addressed to non-mood-dependent goals) (Crowell regulation over time. However, our results indicate that the
et al. 2009). A recent laboratory study has suggested that TAU CBT program showed a comparable maintenance of
individuals with BPD may have more difficulties with learn- several treatment outcomes over a 6-year period. The TAU
ing cognitive reappraisal (Schulze et al. 2011). Thus, further CBT program is a well-established treatment in the clinical
practice on strategies proposed to address cognitive change center, based in evidence-based programs and tailored to
(e.g. checking the facts, reality acceptance; Neacsiu et al. the characteristics of the population they assist (severe ED
2014) might have helped to improve cognitive reappraisal patients with personality disorder comorbidity). What our
after the treatment. study indicates is that a new program delivered in the center
Furthermore, DBT showed an increase in resilience (standard DBT) is also effective compared to a well-estab-
scores across all of the time periods. This result is interest- lished CBT program over time. Therefore, it was feasible to
ing from our point of view. Resilience is a broad concept that establish standard DBT in a clinical center for the BPD and
refers to the ability to maintain wellbeing despite adversity ED sample with good results over time. In fact, the program
(Masten 2001) and has been associated with positive adjust- has been running since we conducted the first study (Navarro
ment in difficult and stressful situations, such as the ability et al. 2018) and it has become routine practice in the clini-
to problem solve or accept the results of change (Reivich cal center, serving as an example of the implementation of
and Shatte 2002) instead of resisting or denying the change. DBT in Spain.
Furthermore, emotion-oriented coping has been associated Despite these findings, the study has several limitations.
with low resilience (Campbell-Sills et al. 2006). Along First, randomization of participants was not carried out.
these lines, a qualitative study (Paris et al. 2014) compared Therefore, this study has limitations related to internal
pairs of sisters, one with BPD and the other without BPD, validity, and so we cannot interpret the results in terms
who had experienced severe abuse and neglect. The sisters of treatment efficacy. Given that many RCTs have been
with BPD reported that they were unable to use strategies conducted to test the efficacy of DBT, our main goal was
related to resilience (e.g. seeking social support, manag- to evaluate how effective these treatments were in the field
ing negative emotional experiences, accepting the past). of routine psychotherapeutic practice. Another possible
These abilities are similar to the essential strategies taught limitation is the difference in the number of participants
in DBT (e.g. problem-solving strategies, emotion regulation, assigned to the different conditions (64 participated in

13
Author's personal copy
Cognitive Therapy and Research

DBT and only 45 in TAU CBT) at pre-treatment, due to References


the workload of the therapists. Nonetheless, results showed
that there were no differences between groups at baseline Aasen, H. (2001). An empirical investigation of depression symptoms:
on clinical and demographic variables. Furthermore, the norms, psychometric characteristics and factor structure of the
Beck Depression Inventory-II. Bergen, Norway: The University
fact that some patients were taking psychotropic medica- of Bergen.
tions and receiving auxiliary therapy activities is also a Allison, P. D. (2001). Missing data. Thousand Oaks, CA: Sage.
limitation because we did not study the effects of these Álvarez-Tomás, I., Soler, J., Bados, A., Martín-Blanco, A., Elices, M.,
additional treatments on the study outcomes in the long Carmona, C., et al. (2017). Long-term course of borderline per-
sonality disorder: a prospective 10-year follow-up study. Journal
term. Finally, although long-term outcomes were statisti- of Personality Disorders, 31(5), 590–605.
cally valid, the sample sizes at the follow-up points were American Psychiatric Association. (2000). Diagnostic and statistical
small. Randomized controlled trials with bigger sample manual of mental disorders (4th ed.) Text Revision: DSM-IV-TR.
sizes at follow-up are needed to confirm the long-term Washington, DC: American Psychiatric Association.
Arnow, B., Kenardy, J., & Agras, W. S. (1995). The emotional eating
efficacy of these treatments. scale: the development of a measure to assess coping with nega-
In conclusion, results of this study support the prelimi- tive affect by eating. International Journal of Eating Disorders,
nary long-term effectiveness of standard DBT for comor- 18(1), 79–90.
bid BPD and ED in naturalistic settings, and they contrib- Bankoff, S., Karpel, M., Forbes, H., & Pantalone, D. (2012). A system-
atic review of dialectical behavioral therapy for eating disorders.
ute to the research on the efficacy of these treatments in the Eating Disorders, 20, 196–215.
field of routine psychotherapeutic practice. DBT may be a Barratt, E. S. (1995). Impulsiveness and aggression. Chicago: The Uni-
good treatment to improve long-term impulsivity and emo- versity of Chicago Press.
tion regulation in people suffering from a severe mental Barratt, R. D., Orozco-Cabal, L. F., & Moeller, F. G. (2004). Impul-
sivity and sensation seeking: a historical perspective on current
condition. Longitudinal studies with larger sample sizes challenges. On the psychobiology of personality: essays in honor
are needed to confirm these findings. of Marvin Zuckerman (pp. 3–17). Amsterdam: Elsevier Science.
Beck, A. T., Steer, R. A., & Brown, G. K. (1996). BDI-II. Beck depres-
Acknowledgements This research was supported by the Gobierno de sion inventory-second edition manual. San Antonio, TX: The Psy-
Aragón (Group reference: S31_20D) and by Feder 2014–2020 “Con- chological Corporation.
struyendo Europa desde Aragón”. Ben-Porath, D., Duthu, F., Luo, T., Gonidakis, F., Compte, E. J., &
Wisniewski, L. (2020). Dialectical behavioral therapy: An update
Author contributions All authors contributed to the study conception and review of the existing treatment models adapted for adults
and design. Material preparation, data collection and analysis were per- with eating disorders. Eating Disorders, 28(2), 101–121.
formed by VGB, LBR, LB. The first draft of the manuscript was written Ben-Porath, D. D., Wisniewski, L., & Warren, M. (2009). Differential
by MVNH and AG and all authors commented on previous versions treatment response for eating disordered patients with and without
of the manuscript. All authors read and approved the final manuscript. a comorbid borderline personality diagnosis using a dialectical
behavior therapy (DBT)-informed approach. Eating Disorders,
17, 225–241.
Funding The research presented in this paper was funded by Ministerio Brassington, J., & Krawitz, R. (2006). Australasian dialectical behav-
de Economía y Competitividad, Spain, “Proyectos de investigación fun- iour therapy pilot outcome study: effectiveness, utility and feasi-
damental no orientada” (PSI2010-21423/PSIC), “Plan de Formación bility. Australasian Psychiatry, 14(3), 313–319.
de la investigación en la Universitat Jaume I” (P11B2005-32) and by Cabello, R., Salguero, J. M., Fernández-Berrocal, P., & Gross, J. J.
Generalitat Valenciana, Redes de Excelencia ISIC (ISIC/2012/012). (2013). A Spanish adaptation of the Emotion Regulation Ques-
tionnaire. European Journal of Psychological Assessment, 29,
Compliance with Ethical Standards 234–240.
Campbell-Sills, L., Cohan, S. L., & Stein, M. B. (2006). Relationship
Conflict of Interest The authors declare that they have no conflict of of resilience to personality, coping, and psychiatric symptoms in
interest. young adults. Behaviour Research and Therapy, 44(4), 585–599.
Carmona, C., Pascual, J. C., Elices, M., Navarro, H., Martin, B. A., &
Ethical approval The study was approved by the appropriate institu- Soler, J. (2018). Factors predicting early dropout from dialecti-
tional and/or national research ethics committee (University Jaume I of cal behaviour therapy in individuals with borderline personality
Castellón, Spain) and certify that the study was performed in accord- disorder. ActasEspañolas de Psiquiatria, 46(6), 226–233.
ance with the ethical standards as laid down in the 1964 Declaration Chen, E., Brown, M., Harned, M., & Linehan, M. M. (2009). A com-
of Helsinki. parison of borderline personality disorder with and without eating
disorders. Psychiatry Research, 170, 86–90.
Informed consent Informed consent was obtained from all individual Chen, Y., & Safer, L. (2010). Dialectical behavior therapy for bulimia
participants included in the study. nervosa and binge-eating disorder. In C. M. Grilo & J. E. Mitchell
(Eds.), The treatment of eating disorders: a clinical handbook (pp.
Animal Rights This article does not contain any studies with animals 294–317). New York: The Guildford Press.
performed by any of the authors. Cohen, J. (1988). Statistical power analysis for the behavioral sciences
(2nd ed.). Hillsdale: Erlbaum Associates.
Collins, L. M., Schafer, J. L., & Kam, C. M. (2001). A comparison of
inclusive and restrictive strategies in modern missing data proce-
dures. Psychological Methods, 6, 330–351.

13
Author's personal copy
Cognitive Therapy and Research

Crowell, S. E., Beauchaine, T. P., & Linehan, M. M. (2009). A bioso- Kröger, C., Schweiger, U., Sipos, V., Kliem, S., Arnold, R., Schunert,
cial developmental model of borderline personality: elaborating T., & Reinecker, H. (2010). Dialectical behaviour therapy and an
and extending Linehan’s theory. Psychological Bulletin, 135, added cognitive behavioural treatment module for eating disor-
495–510. ders in women with borderline personality disorder and anorexia
Diemen, L. V., Szobot, C. M., Kessler, F., & Pechansky, F. (2007). nervosa or bulimia nervosa who failed to respond to previous
Adaptation and construct validation of the Barratt Impulsiveness treatments. An open trial with a 15-month follow-up. Journal of
Scale (BIS 11) to Brazilian Portuguese for use in adolescents. Behavior Therapy and Experimental Psychiatry, 41(4), 381–388.
Brazilian Journal of Psychiatry, 29, 153–156. Lazarus, R. S., & Alfert, E. (1964). Short-circuiting of threat by experi-
Distel, M. A., Middeldorp, C. M., Trull, T. J., Derom, C. A., Wil- mentally altering cognitive appraisal. The Journal of Abnormal
lemsen, G., & Boomsma, D. I. (2011). Life events and borderline and Social Psychology, 69(2), 195–205.
personality features: the influence of gene–environment interac- Lenz, A. S., Taylor, R., Fleming, M., & Serman, N. (2014). Effective-
tion and gene–environment correlation. Psychological Medicine, ness of dialectical behavior therapy for treating eating disorders.
41(4), 849–860. Journal of Counseling and Development, 92(1), 26–35.
Fairburn, C. G., & Bohn, K. (2005). Eating disorder NOS (EDNOS): an Linehan, M. M. (1993a). Cognitive-behavioral treatment of borderline
example of the troublesome ‘Not Otherwise Specified’ (NOS) cat- personality disorder. New York: Guilford Press.
egory in DSM-IV. Behaviour Research and Therapy, 43, 691–701. Linehan, M. M. (1993b). Skills training manual for treating borderline
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1996). personality disorder. New York: Guilford Press.
Structured clinical interview for DSM-IV axis I disorders, Clini- Linehan, M. M. (2003). Manual de tratamiento de los trastornos de
cian Version (SCID-CV). Washington, D.C.: American Psychiatric personalidadlímite. Barcelona: Paidós.
Press Inc. Linehan, M. M., Comtois, K. A., Murray, A. M., Brown, M. Z., Gallop,
First, M. B., Spitzer, R. L., Gibbon, M., Williams, J. B. W., & Benja- R. J., Heard, H. L., et al. (2006). Two-year randomized controlled
min, L. S. (1997). Structured clinical interview for DSM-IV axis trial and follow-up of dialectical behavior therapy vs. therapy by
II personality disorders, (SCID-II). Washington, D.C.: American experts for suicidal behaviors and borderline personality disorder.
Psychiatric Press Inc. Archives of General Psychiatry, 63(7), 757–766.
Fruzzetti, A. E., & Shenk, C. E. (2020). Fostering validating responses Linehan, M. M., Korslund, K. E., Harned, M. S., Gallop, R. J., Lungu,
in families. In P. D. Hoffman & P. Steiner-Grossman (Eds.), Bor- A., Neacsiu, A. D., et al. (2015). Dialectical behavior therapy for
derline personality disorder: meeting the challenges to successful high suicide risk in individuals with borderline personality dis-
treatment (pp. 215–228). London: Routledge. order: a randomized clinical trial and component analysis. JAMA
Gail, W., & Heather, Y. (1993). Development and psychometric evalu- psychiatry, 72(5), 475–482.
ation of the resilience scale. Journal of Nursing Measurement, López-Montoyo, A., & Cebolla i Martí, A. J. (2016). Comer por abur-
1(2), 165–177. rimiento: relación entre tendencia al aburrimiento y estilos de
García-Palacios. (2005). BPD Clinical Data Inventory [Unpublished ingesta en población general. Agora de Salut III, 3, 227–234.
Manuscript]. Universidad Jaume I, Castellón, Spain. Martinussen, M., Friborg, O., Schmierer, P., Kaiser, S., Øvergård, K.
Garner, D. M., Vitousek, K., & Pike, K. M. (1997). Cognitive-behavio- T., Neunhoeffer, A. L., et al. (2017). The comorbidity of person-
ral therapy for anorexia nervosa. In D. M. Garner & P. E. Garfin- ality disorders in eating disorders: a meta-analysis. Eating and
kel (Eds.), Handbook of treatment for eating disorders (2nd ed., Weight Disorders-Studies on Anorexia, Bulimia and Obesity,
pp. 94–174). New York: Guilford Press. 22(2), 201–209.
Graham, J. W. (2009). Missing data analysis: making it work in the real Masten, A. S. (2001). Ordinary magic: resilience processes in develop-
world. Annual Review of Psychology, 60, 549–576. ment. American Psychologist, 56, 227–238.
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007). How many McMain, S. F., Guimond, T., Barnhart, R., Habinski, L., & Streiner,
imputations are really needed? Some practical clarifications of D. L. (2017). A randomized trial of brief dialectical behaviour
multiple imputation theory. Prevention Science, 8, 206–213. therapy skills training in suicidal patients suffering from border-
Gross, J. J., & John, O. P. (2003). Individual differences in two emo- line disorder. Acta Psychiatrica Scandinavica, 135(2), 138–148.
tion regulation processes: implications for affect, relationships, McMain, S. F., Guimond, T., Streiner, D. L., Cardish, R. J., & Links,
and well-being. Journal of Personality and Social Psychology, P. S. (2012). Dialectical behavior therapy compared with general
85, 348–362. psychiatric management for borderline personality disorder: clini-
Gunderson, J., Stout, R., McGlashan, T., Shea, M., Morey, L., Grilo, C., cal outcomes and functioning over a 2-year follow-up. American
et al. (2011). Ten-year course of borderline personality disorder: Journal of Psychiatry, 169(6), 650–661.
psychopathology and function from the Collaborative Longitudi- Navarro-Haro, M. V., Botella, C., Guillen, V., Moliner, R., Marco,
nal Personality Disorders study. Archives of General Psychiatry, H., Jorquera, M., et al. (2018). Dialectical behavior therapy in
68(8), 827–837. the treatment of borderline personality disorder and eating disor-
Hardt, J., Herke, M., & Leonhart, R. (2012). Auxiliary variables in ders comorbidity: a pilot study in a naturalistic setting. Cognitive
multiple imputation in regression with missing X: a warning Therapy and Research, 42, 636–649.
against including too many in small sample research. BMC Medi- Navarro-Haro, M. V., Wessman, I., Botella, C., & García-Palacios, A.
cal Research Methodology, 12, 184–196. (2015). The role of emotion regulation strategies and dissociation
Hunt, M., Auriemma, J., & Cashaw, A. (2003). Self-report bias and in non-suicidal self-injury for women with borderline personality
underreporting of depression on the BDI-II. Journal of Personal- disorder and comorbid eating disorder. Comprehensive Psychia-
ity Assessment, 80, 26–30. try, 63, 123–130.
Iglesias, E. B., Durán, A. L., & del Río, E. F. (2013). Resiliencia y Neacsiu, A. D., Bohus, M., & Linehan, M. M. (2014). Dialectical
consumo de cannabis, drogas de síntesis y cocaína en jóvenes. behavior therapy: An intervention for emotion dysregulation. In
PsicopatologíaClínica Legal y Forense, 13(1), 59–72. J. J. Gross (Ed.), Handbook of emotion regulation (pp. 491–507).
Jacobson, N. S., & Truax, P. (1991). Clinical significance: a statis- New York: Guilford Press.
tical approach to defining meaningful change in psychotherapy Neill, J. T., & Dias, K. L. (2001). Adventure education and resilience:
research. Journal of Consulting and Clinical Psychology, 59, The double-edged sword. Journal of Adventure Education and
12–19. Outdoor Learning, 1(2), 35–42.

13
Author's personal copy
Cognitive Therapy and Research

Newton, J. R. (2019). Borderline personality disorder and eating disor- study of dialectical behavior therapy plus olanzapine for border-
ders: a trans-diagnostic approach to unravelling diagnostic com- line personality disorder. American Journal of Psychiatry, 162(6),
plexity. Australasian Psychiatry, 27(6), 556–558. 1221–1224.
Oquendo, M. A., Baca-Garcia, E., Graver, R., Morales, M., & Mon- Spielberger, C. D. (1999). Manual for the state-trait anger expression
talvan, V. (2001). Spanish adaptation of the Barratt impulsive- inventory-2. Odessa, FL: Psychological Assessment Resources.
ness scale (BIS-11). The European Journal of Psychiatry, 15(3), Stanford, M. S., Mathias, C. W., Dougherty, D. M., Lake, S. L., Ander-
147–155. son, N. E., & Patton, J. H. (2009). Fifty years of the Barratt impul-
Paris, J., Perlin, J., Laporte, L., Fitzpatrick, M., & DeStefano, J. (2014). siveness scale: an update and review. Personality and Individual
Exploring resilience and borderline personality disorder: a quali- Differences, 47(5), 385–395.
tative study of pairs of sisters. Personality and Mental Health, Stoffers, J., Völl, B. A., Rücker, G., Timmer, A., Huband, N. & Lieb, K.
8(3), 199–208. (2010). Pharmacological interventions for borderline personality
Patton, J. H., Stanford, M. S., & Barratt, E. S. (1995). Factor structure disorder. Cochrane Database of Systematic Reviews: CD005653.
of the barratt impulsiveness scale. Journal of Clinical Psychology, Stoffers, J.M., Völlm, B.A., Rücker, G., Timmer, A., Huband, N., &
51(6), 768–774. Lieb, K. (2012). Psychological therapies for people with bor-
Perpiñá, C., Cebolla, A., Botella, C., Lurbe, E., & Torró, M.I. (2011). derline personality disorder. Cochrane Database of Systematic
Emotional eating scale for children and adolescents: psychometric Reviews, 2, CD005652.
characteristics in a Spanish sample. Journal of Clinical Child & Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics. New
Adolescent Psychology, 40, 3, 424–33. York: Harper Collins.
Reivich, K., & Shatte, A. (2002). The resilience factor: 7 keys to find- Tobal, J., Casado, M., Cano, A., & Spielberger, C. (2001). Manual
ing your inner strength and overcoming life’s hurdles. New York: inventario de expresión de iraestado—rasgo 2. Madrid: TEA
Three Rivers Press. Ediciones.
Rosenthal, M. Z., Gratz, K. L., Kosson, D. S., Cheavens, J. S., Lejuez, Treasure, J. L., & Schmidt, U. (2002). Anorexia nervosa. Clinical Evi-
C. W., & Lynch, T. R. (2008). Borderline personality disorder and dence, 8, 903–913.
emotional responding: a review of the research literature. Clinical van Ginkel, J. R., Linting, M., Rippe, R. C. A., & van der Voort, A.
Psychology Review, 28, 75–91. (2020). Rebutting existing misconceptions about multiple imputa-
Safer, D. L., Robinson, A. H., & Jo, B. (2010). Outcome from a rand- tion as a method for handling missing data. Journal of Personality
omized controlled trial of group therapy for binge eating disorder: Assessment, 102, 3, 297–308.
comparing dialectical behavior therapy adapted for binge eating Wagnild, G. M., & Young, H. (1993). Development and psychometric.
to an active comparison group therapy. Behavior Therapy, 41, Journal of nursing measurement, 1(2), 165–17847.
106–120. Waller, G., & Osman, S. (1998). Emotional eating and eating psycho-
Safer, L., Telch, C., & Chen, Y. (2017). Dialectical behavior therapy pathology among non eating-disordered women. International
for binge eating and bulimia. New York: The Guildford Press. Journal of Eating Disorders, 23, 419–424.
Salvo, L., & Castro, A. (2013). Confiabilidad y validez de la escala de Wilson, T. G., Fairburn, C. G., & Agras, S. (1997). Cognitive-behav-
impulsividad de Barratt (BIS-11) en adolescentes. Revista chilena ioural therapy for bulimia nervosa. In D. M. Garner & P. E. Gar-
de neuro-psiquiatría, 51(4), 245–254. finkel (Eds.), Handbook of treatment for eating disorders (pp.
Sanz, J., García Vera, M.P., Espinosa, R., Fortún, M. & Vázquez, C. 67–93). New York: Guilford Press.
(2005). Adaptación española del Inventario para la Depresión de Zanarini, M. C., Frankenburg, F. R., Reich, D. B., & Fitzmaurice, G.
Beck-II (BDI-II): 3. Propiedades psicométricas en pacientes con M. (2016). Fluidity of the subsyndromal phenomenology of bor-
trastornos psicológicos. Clínica y Salud. Investigación Empírica derline personality disorder over 16 years of prospective follow-
en Psicología, 16(2), 121–42. up. American Journal of Psychiatry, 173(7), 688–694.
Sanz, J., Navarro, M. E., & Vázquez, C. (2003). Adaptaciónespañola Zanarini, M. C., Reichman, C. A., Frankenburg, F. R., Reich, D. B., &
del inventario para la depresión de Beck-II (BDI-II): 1. Propie- Fitzmaurice, G. (2010). The course of eating disorders in patients
dadespsicométricas en estudiantesuniversitarios. Análisis y Modi- with borderline personality disorder: A 10-year follow-up study.
ficación de Conducta, 29, 239–288. The International Journal of Eating Disorders, 43(3), 226–232.
Schulze, L., Domes, G., Krüger, A., Berger, C., Fleischer, M., Prehn,
K., et al. (2011). Neuronal correlates of cognitive reappraisal in Publisher’s Note Springer Nature remains neutral with regard to
borderline patients with affective instability. Biological Psychia- jurisdictional claims in published maps and institutional affiliations.
try, 69(6), 564–573.
Soler, J., Pascual, J. C., Campins, J., Barrachina, J., Puigdemont, D.,
Alvarez, E., & Pérez, V. (2005). Double-blind, placebo-controlled

13

View publication stats

You might also like