TA Mediator of Change 2

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

Clinical Psychology Review 82 (2020) 101921

Contents lists available at ScienceDirect

Clinical Psychology Review


journal homepage: www.elsevier.com/locate/clinpsychrev

Review

Therapeutic alliance as a mediator of change: A systematic review and T


evaluation of research
Allison L. Baier , Alexander C. Kline1, Norah C. Feeny

PTSD Treatment and Research Program, Case Western Reserve University, Department of Psychological Sciences, 11220 Bellflower Road, Cleveland, OH 44106-7123,
USA

HIGHLIGHTS

• We evaluated studies examining the alliance as a mediator of change in psychotherapy.


• Alliance plays an important role pantheoretically.
• Studies displayed methodological and statistical heterogeneity.
• Steps for improving future mediation research are proposed.

ARTICLE INFO ABSTRACT

Keywords: The alliance-outcome relationship has been consistently linked to positive treatment outcomes irrespective of
Alliance psychotherapy modality. However, beyond its general links to favorable treatment outcomes, it is less clear
Mediator whether the alliance is a specific mediator of change and thus a possible mechanism underlying psychotherapy
Mechanism response. This systematic review evaluated research examining the alliance as a potential mediator of symptom
Psychotherapy
change, reviewing study characteristics of 37 relevant articles examining the alliance-outcome relationship and
Systematic review
the extent to which these studies met recommended criteria for mechanistic research. Alliance mediated ther­
apeutic outcomes in 70.3% of the studies. We observed significant heterogeneity across studies in terms of
methodology, including timing of alliance assessment, study design, constructs used in mediation models, and
analytic approaches. Building on recent methodological advancements, we propose directions for future research
examining the putative mediational role of alliance, such as greater uniformity in and attention to study design
and statistical methodology. This review highlights the importance of alliance in therapeutic change and dis­
cusses how adhering to requirements for process research will improve our ability to more precisely estimate
how and to what extent alliance drives therapeutic change.

1. Introduction Institute of Medicine has called for research to identify elements of


therapeutic change to better understand the mechanisms underlying
The past several decades have seen the development and advance­ treatment response (Weissman, 2015). A more nuanced awareness of
ment of a range of psychotherapies, including an increasing number of processes driving therapeutic change would enable clinicians to further
evidence-based psychotherapies with well-defined treatment manuals attend to the therapeutic elements actively contributing to treatment
and effectiveness in treating a range of mental health disorders (Pincus response or nonresponse, thereby optimizing treatments and ultimately
& England, 2015). Despite this, dropout and nonresponse remain sig­ providing more personalized, effective care.
nificant concerns even among the most effective treatments, affecting One hypothesized process underlying treatment response is the
an estimated 20–50% of patients (Nathan & Gorman, 2015; Saxon, therapeutic alliance. Modern definitions of the term center on the al­
Firth, & Barkham, 2017; Wang et al., 2005). Improving patient ad­ liance as a collaborative relationship between therapist and patient that
herence and outcomes in psychotherapy will be aided by a greater is influenced by the extent to which there is agreement on treatment
understanding of how psychotherapy works. In line with this, the goals, a defined set of therapeutic tasks or processes to achieve the


Corresponding author at: Case Western Reserve University, Department of Psychological Sciences, 11220 Bellflower Road, Cleveland, Ohio 44106, USA.
E-mail address: alb184@case.edu (A.L. Baier).
1
Present address: VA San Diego Healthcare System, 3350 La Jolla Village Drive, MC116B, San Diego, CA, USA 92161.

https://doi.org/10.1016/j.cpr.2020.101921
Received 25 November 2019; Received in revised form 6 August 2020; Accepted 14 September 2020
Available online 17 September 2020
0272-7358/ © 2020 Elsevier Ltd. All rights reserved.
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

stated goals, and the formation of a positive emotional bond (Bordin, Scharkow, 2013; MacKinnon, Lockwood, Hoffman, West, & Sheets,
1979, 1994). Stronger alliance is consistently associated with positive 2002; Shrout & Bolger, 2002). Methodologists have put forth a number
treatment outcomes across a range of psychotherapies as evidenced by of alternative approaches to use in conjunction with the major ap­
multiple meta-analyses on the subject, with fairly stable correlations proaches or as new stand-alone methods. These include bootstrap and
between studies (Fluckiger, Del Re, Wampold, & Horvath, 2018: other resampling methods that help deal with violations of the nor­
r = 0.28, k = 295; Horvath & Bedi, 2002: r = 0.21, k = 100; Horvath, mality assumption (Preacher & Hayes, 2004), the extension of single-
Del Re, Flückiger, & Symonds, 2011: r = 0.28, k = 190; Horvath & mediator models to multiple mediator models to examine the potential
Symonds, 1991: r = 0.28; k = 190; Martin, Garske, & Davis, 2000: interactive effects of multiple variables (Hayes, 2013), multilevel
r = 0.22, k = 79). mediation models to handle hierarchical data (Bauer, Preacher, & Gil,
Although alliance has consistently been linked to better outcomes 2006; Krull & MacKinnon, 2001), and longitudinal mediation models to
across psychotherapies, there is ongoing debate with regard to the examine how variables change or remain stable over the course of time
putative nature of alliance as an actual mechanism of change. Some (Cheong, MacKinnon, & Khoo, 2003; Curran & Bauer, 2011; Curran &
argue alliance is simply a precondition necessary for any successful Bollen, 2001; Curran, Lee, Howard, Lane, & MacCallum, 2012). While
therapy (Hatcher & Barends, 2006; Raykos et al., 2014; Weck, there are advantages and disadvantages to each method, multilevel
Grikscheit, Jakob, Höfling, & Stangier, 2015). As a consequence, some longitudinal mediation methods offer the most robust statistical options
methodologists argue alliance is a nonspecific treatment factor that is for examining mediation in treatment data because these models are
important across all psychotherapies and thus is largely independent of equipped to handle the nested nature and time-course of the data. For a
psychotherapy “type”. In contrast, others argue that alliance is a spe­ comprehensive discussion of mediation analysis and the various pros
cific treatment factor that drives therapeutic change itself and may be and cons of different methods, readers are directed to MacKinnon and
of greater significance in some psychotherapies (e.g., relational thera­ colleagues' review (2007).
pies) over others (e.g., cognitive behavioral therapy; Siev, Huppert, & In addition to the mechanics of the mediation analysis, methodol­
Chambless, 2009). Whether a nonspecific or specific factor, therapeutic ogists are increasingly advocating for researchers to disentangle within-
alliance is well studied, with over 306 studies in the most recent meta- patient and between-patient effects in process research (Curran &
analysis on the alliance-outcome relationship alone (Fluckiger et al., Bauer, 2011). That is, how do the intraindividual and interindividual
2018). Although it is well established that strong alliance is generally variation in scores contribute to outcome over the course of time? Re­
associated with better psychotherapy outcomes, the extent to which searchers often make conclusions about within-patient processes from
this process is itself specifically driving therapeutic change remains between-patient data. However, the between-patient relationship be­
unclear. Randomized controlled trials (RCTs) offer one way to examine tween a process variable (e.g., alliance) and outcome (e.g., depression
the question of whether alliance is a specific or nonspecific factor; if symptoms) could in fact be a proxy for some other patient variable (e.g.,
alliance is a specific factor, there should be treatment effects such that diagnosis, personality), creating difficulties when drawing inferential
alliance plays a more prominent role in one therapy over another conclusions (Curran & Bauer, 2011). Thus, an increased focus on
whereas if alliance is a nonspecific factor, studies would find no longitudinal mediation methods that disaggregate the within-patient
treatment effects. A resolution to this debate is important for better and between-patient variation in alliance scores, is an important con­
understanding the therapeutic alliance's impact on psychotherapy sideration for process research that seeks to uncover why and how
outcomes, as well as how this process impacts outcomes. Additionally, a change occurs.
greater understanding of the alliance's role in psychotherapy will en­ In sum, methodological approaches are integral to identifying and
able researchers to examine its potential interactive effects on other assessing proposed mediators. Specifically, the precision and con­
possible mediators, thereby providing greater clarity regarding the fidence of conclusions drawn are closely affected by the types of ana­
mechanistic processes by which treatments lead to change. lyses employed in studying this process.

1.1. Requirements for a mediator 1.2. Advances in assessing mediation

Mediators help to explain why and how change is occurring and are Mediators are an important first step in understanding hypothesized
considered the first step in elucidating potential mechanisms of ther­ change processes; however, the identification of a mediator does not
apeutic change (Laurenceau, Hayes, & Feldman, 2007). Given that a necessarily explain the underlying cause of change (Kazdin & Nock,
subset of patients will drop out or not benefit from even the most ef­ 2003; Laurenceau et al., 2007). In addition to the statistical require­
fective psychological treatments, identifying the processes underlying ment for mediation, Kazdin (2007) proposed six other criteria for
change will help implement treatments in a manner emphasizing the drawing inferential conclusions from studying change processes that
most “essential” treatment components responsible for positive out­ can ultimately yield important clinical information about psy­
comes and also unveil ways to optimize such components for specific chotherapy. First, in addition to statistical mediation, researchers must
patients (Kraemer, Wilson, Fairburn, & Agras, 2002). Notably, while the be mindful of the temporal relationship (termed ‘timeline’; Kazdin,
terms ‘mediator’ and ‘mechanism’ are often used interchangeably, they 2007) between the mediator and outcome, a criterion that has in­
are substantively different in that not all mediators are mechanisms and creasingly been discussed and advocated (Johansson & Høglend, 2007;
researchers cannot necessarily make inferential conclusions from Kazdin, 2007; Kraemer et al., 2002). That is, does the mediator precede
mediation analyses (Kazdin, 2007). and predict the outcome variable over the course of time? Second, re­
A mediator (variable M) is an intervening variable that statistically searchers must rule out other explanations for the observed relationship
explains or accounts for the relationship between two other variables: between the mediator and outcome. For example, what other com­
the independent variable (variable X) and dependent variable (variable peting mediators need to be examined? Could the mediator in question
Y) (MacKinnon, Fairchild, & Fritz, 2007). Three major approaches are simply be a proxy for some other variable or patient trait (e.g., per­
often used to assess mediation including: causal steps (Baron & Kenny, sonality)? Or, if the mediator precedes outcome, might the outcome
1986; Judd & Kenny, 1981), difference in coefficients (Mackinnon & variable also exert an influence over the hypothesized mediator (i.e.,
Dwyer, 1993), and product of coefficients (Alwin & Hauser, 1975). The reverse causality)? Kazdin (2007) refers to this criterion as ‘specificity’.
causal approach outlined by Baron and Kenny (1986) is most widely Third, studies ought to manipulate the hypothesized mediator through
used; however, it is limited by attenuated power and requires as­ experimental designs (termed, ‘experimental manipulation’) to demon­
sumptions and study requirements (e.g., normal distribution, large strate the relationships between the proposed mediator and outcome.
sample sizes) that can be hard to achieve in clinical research (Hayes & Such experimental methods would help determine Kazdin's fourth

2
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

criteria, ‘gradient’, wherein stronger “doses” of the proposed mediator 2. Method


lead to greater change in outcome. Fifth, research findings must fit
within the broader scientific theory (‘plausibility/coherence’), and sixth, 2.1. Search strategy
research must consistently demonstrate a relationship between the
mediator and outcome across replication studies, including different The search process occurred in two phases. First, PsycInfo was
patient populations and varying treatment conditions (‘consistency’; systematically searched for potentially relevant papers published in
Kazdin, 2007). While all criteria are important to the study of mediators peer-review journals. Limiters applied in the search were publication
in the quest of identifying mechanisms of change, some experts suggest date (January 1, 1980 and July 15, 2020), language (English only), and
that in statistical mediation, temporality, specificity, and experimental age group (adulthood, defined as 18 years and older). The following
manipulation should be considered the most important (Kazdin, 2007; search terms were used: “alliance” OR “therapeutic alliance” OR
Kazdin & Nock, 2003). Accordingly, studies and reviews of mediation “helping alliance” OR “working alliance” AND “psychotherapy” OR
research have begun to focus on these particular criteria (e.g., Lemmens “therapy” OR “cognitive (behavior(u)ral) therapy” OR “psychological
et al., 2017). treatment(s)/intervention(s)” OR “Interpersonal (psycho)therapy” OR
In addition to the criteria for studying mediators, researchers have “psychodynamic/analytic therapy” OR “client centered therapy” OR
put forth recommended designs for process research, including rando­ “acceptance commitment therapy” AND “mechanism” OR “mechanisms
mized controlled trials (RCTs), comparisons with an adequate control of change/action” OR “working mechanisms (of psychotherapy)” OR
group, sufficient power (e.g., sample size), and spaced repeated mea­ “processes of therapy” OR “process research” OR “change” OR “med­
sures (e.g., assessments at different timepoints throughout treatment) to iation” OR “mediator” OR “mediating effects”. Following the initial
allow for adequate assessment of temporality (Kazdin, 2007; Kazdin & search, reference lists of prior meta-analyses of the alliance-outcome
Nock, 2003; Laurenceau et al., 2007). Researchers have begun to relationship (e.g., Fluckiger et al., 2018; Horvath et al., 2011) were
evaluate the state of the literature with regard to these recommenda­ reviewed as well as reference lists of potentially suitable papers.
tions for process research for both posttraumatic stress disorder
(Cooper, Clifton, & Feeny, 2017) and depression treatments (Lemmens 2.2. Inclusion criteria
et al., 2017). Clinically, such reviews provide greater specificity re­
garding treatment processes that appear to be most effective in driving Studies were eligible for inclusion if they met the following criteria:
therapeutic change. These reviews also shape future research on med­ (a) the study consisted of adult patients; (b) the study was empirical and
iation by assessing limitations in research to date and articulating re­ quantitative (i.e., reviews, commentaries, theoretical essays, meta-
search recommendations (e.g., study design, statistical methodology) to analyses, systematic reviews, and qualitative studies were excluded);
better understand mediators in psychotherapy. (c) the study was not a case report; (d) patients received in-person,
To date, meta-analyses have examined the alliance-outcome re­ outpatient, individual psychotherapy (i.e., group, inpatient, and tele­
lationship as well as potential moderators of the relationship, such as health modalities were excluded); (e) the analytic method of the study
treatment type and patient characteristics (Fluckiger et al., 2018; included statistical mediation with the alliance as the hypothesized
Horvath et al., 2011; Horvath & Bedi, 2002; Horvath & Symonds, 1991; mediating variable; (f) the study included a validated clinical symptom
Martin et al., 2000). In a re-analysis (Flückiger, Del Re, Wampold, outcome measure as the dependent variable in the mediation model(s)
Symonds, & Horvath, 2012) of data included in a previous meta-ana­ (e.g., Beck Depression Inventory; Beck, Steer, Ball, & Ranieri, 1996); (g)
lysis (Horvath et al., 2011; k = 190 studies), the authors used multi­ the study used a validated measure of therapeutic alliance (e.g.,
level, longitudinal meta-analytic procedures to examine moderators of Working Alliance Inventory; Hatcher & Gillaspy, 2006); and (h) the
the alliance-outcome correlations over the course of therapy (e.g., de­ study was reported in English. Inclusion criteria adhered to the pre­
sign characteristics, therapy type). While moving toward better un­ cedent of prior alliance reviews examining in-person, individual psy­
derstanding the nuance of the alliance-outcome relationship, like all chotherapy (e.g., Smith, Msetfi, & Golding, 2010) and reviews of pro­
other meta-analyses on the subject, the authors examined moderators of cess mediation research (e.g., Lemmens et al., 2017). Given that the
the alliance-outcome correlation. Beyond this relationship, the extent to goal of this review was to evaluate the state of the literature, studies
which alliance serves as a potential mediator of change in psychother­ were not excluded for poor study quality (Cuijpers, van Straten,
apy—and whether alliance may be a specific or nonspecific factor—­ Bohlmeijer, Hollon, & Andersson, 2010; Hedges & Pigott, 2004); how­
remains unclear, reflecting a critical next step in more precisely un­ ever, if more than one study used an identical dataset, we chose to
derstanding the specific change processes occurring in treatment. include the study with the strongest methodology and study quality as
defined by our coding criteria below.

1.3. Aims of current review 2.3. Coding procedures

The primary aim of this study was to provide a systematic review of Key study characteristics and variables related to process research
research on the potential role of the therapeutic alliance as a mediator were coded by the first author (ALB) and a trained, independent rater.
of change in psychotherapy. As therapy change processes are better Interrater reliability between coders was excellent (κ = 0.93), and
understood, clinicians will be better equipped to optimize these minimal differences in coding were resolved by consensus. Study
“treatment drivers,” which ultimately should improve patient out­ characteristics included: psychotherapy intervention type(s), primary
comes. Studies were selected that examined the therapeutic alliance as diagnosis of the sample, setting of study, validated measure of the
a mediator between an independent variable and treatment outcome therapeutic alliance, validated clinical symptom outcome measure,
with a statistical test of mediation (e.g., Baron & Kenny, 1986). In an statistical method(s) used to examine mediation, and main study find­
effort to better understand whether alliance is a specific factor on ings. Additionally, papers were assessed on whether or not they met key
nonspecific factor, a broad range of in-person, individual, outpatient criteria for process research following the methodology of Lemmens
psychotherapy was included. The resulting review presents the char­ et al. (2017) including: the use of an RCT design, use of a control group,
acteristics of 37 studies examining alliance as a mediator of change and sufficient sample size for mediation analyses (defined as n ≥40 in line
the extent to which alliance is supported as a possible mediator of with other reviews evaluating process research), examination of mul­
therapeutic change. tiple mediators within one study, assessment of temporality (defined as
2 or more assessments of the therapeutic alliance during the treatment
phase that were examined over the course of time, not as an average),

3
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

Unique records identified Additional records identified


Identification through PsycINFO database through reference lists of other
searching with initial screening reviews, meta-analyses, and
criteria manuscripts
(n = 1,613) (n = 59)

Records after duplicates removed and


screened on the basis of title (n = 1,651)

Records excluded (n = 287):


Screening

- No mediation (n = 28)
- Case study (n = 38)
Records screened on basis
- Group treatment (n = 7)
of abstract
- Not adult (n = 14)
(n = 479)
- Not empirical (n = 137)
- Not psychotherapy (n = 59)
- Telehealth (n = 4)
Eligibility

Full-text articles excluded (n = 155):


Full-text articles assessed - No mediation (n = 77)
for eligibility - Case study (n = 1)
(n = 192) - Group treatment (n = 13)
- Inpatient treatment (n = 4)
- No validated alliance measure (n =
5)
- Not adult (n = 3)
- No validated symptom outcome
measure (n = 13)
Included

- Not empirical (n = 17)


- Not psychotherapy (n = 4)
Studies included in present - Telehealth (n = 8)
review - Same data as another study (n =
(n = 37) 10)

Fig. 1. PRISMA flow diagram of study identification and selection process.

and direct experimental manipulation of alliance. We chose to follow 3. Results


guidelines outlined by Lemmens and colleagues in an effort to maintain
consistency with the literature; however, we also wanted to ensure 3.1. Study selection
maximum relevancy of criteria to the study of alliance as a mediator of
change. Consequently, we chose to collapse two criteria—RCT design Study selection followed PRISMA guidelines (Moher, Liberati,
and use of a control group—into one criterion due to overlap (i.e., all Tetzlaff, Altman, & The, 2009) and is presented in Fig. 1. The initial
studies in the review with a control group were also an RCT). As pre­ PsycINFO search yielded 1613 citations, which were screened on the
viously stated, the direct comparison of two treatments can yield in­ basis of title. Reference lists from meta-analyses and studies deemed
teresting information regarding whether alliance is a specific or non­ potentially eligible for inclusion were also reviewed, which provided an
specific mediator of change. Additionally, we elected to add in a additional 59 citations for review. Following this initial screening, a
criterion regarding whether or not researchers adequately disentangled total of 479 studies with potential to meet inclusion criteria were re­
within and between-patient effects specifically for the mediation ana­ tained. Each abstract was then closely reviewed, followed by the full
lysis, bringing the total criteria to six. Studies were rated as either text (n = 192) if necessary to determine eligibility. A total of 442
meeting the criteria (1) or not (0). studies were excluded, with the most common reasons for exclusion
including lack of empirical study and lack of mediation. Ultimately, 37
studies met full inclusion criteria and are denoted with asterisks in the
references.

4
Table 1
Characteristics and results of 37 identified studies aimed at examining the potential role of the therapeutic alliance as a mediator of treatment outcomes and the extent to which they meet requirements for process
research.
A.L. Baier, et al.

Study Characteristics and Results Requirements for Process Research

Primary Author, Date Setting & Intervention(s)* Diagnosis Alliance Timepoint of Statistical Main Finding(s) RCT Disentangled N≥40 Multiple Temporality Manipulation
Measure Alliance Measure Mediation Effects Mediator
Method

DeRubeis & Feeley, Outpatient Center; CT MDD PHAS Session 2 plus Temporal No significant correlation 0 0 0 1 1 0
1990 (n = 25) (observer) one tape from correlations between alliance and
each of the subsequent change or prior
following change scores.
periods: weeks
4–6; 7–9; 10–12

Feeley, DeRubeis, & RCT data; Combined MDD PHAS Same as Temporal No significant correlation 0a 0 0 1 1 0
Gelfand, 1999 sample: CT & CT + ADM (observer) DeRubeis & correlations between alliance and
(n = 25) Feeley, 1990 subsequent change or prior
change scores.

Barber et al., 2000 Combined data from four Mixed CALPAS End of sessions 2, Temporal Alliance predicted symptom 0 0 1 1 1 0
open trials; Supportive- (patient) 5, 10, and each correlations change. Depression predicted
Expressive Dynamic 5th session late alliance but not early
Therapy (n = 88) thereafter alliance.
a
Zuroff et al., 2000 RCT data; Combined MDD VTAS Sessions 3 & 15 Causal steps Increase in alliance partially 0 0 1 0 1 0
sample: IPT, CBT, (observer) mediated the relationship
ADM + CM & placebo + between perfectionism and
CM (n = 149) outcome.

5
Wilson, Fairburn, RCT data; Combined BN HRQ (patient) End of session 4 Causal steps Alliance did not mediate the 1 0 1 1 0 0
Agras, Walsh, & sample: CBT & IPT relationship between treatment
Kraemer, 2002 (n = 154) type and outcome.

Klein et al., 2003 RCT data; CBASP (n = 169) MDD WAI- Weeks 2 (after Mixed effects Early alliance predicted change 1 0 1 1 1 0
vs. CBASP + ADM Abbreviated 4- 3–4 sessions), 6 growth modeling in depressive symptoms, no
(n = 198) items (patient) (after 8–12 treatment moderation. The
sessions), and 12 reverse relationship was not
(after 16–20 observed.
sessions)

Baldwin, Wampold, & Naturalistic database Mixed WAI (patient) Prior to session 4 Multilevel Therapist variability in alliance, 0 1 1 0 0 0
Imel, 2007 collected from 45 mediation model but not patient variability,
University counseling accounted for the relationship
centers; Various between pretreatment scores
psychotherapy treatment and outcome.
(n = 331)

Spinhoven, Giesen- RCT data; SFT (n = 44) vs. BPD WAI-SF After 3, 15, and Longitudinal Alliance predicted change in 1 0 0 1 1 0
Bloo, van Dyck, TFP (n = 34) (patient and 33 months multilevel model symptoms. The reverse
Kooiman, & Arntz, therapist) relationship was not observed.
2007

Forbes et al., 2008 Academic treatment center; PTSD WAI-SF 3 weeks post Causal steps Alliance did not mediate the 0 0 1 1 0 0
Unspecified psychotherapy (patient and intake relationship between anger at
treatment (n = 103) therapist) intake and post treatment
symptoms

Byrd, Patterson, & Naturalistic database from a Mixed WAI-SF After session 3, 4, Causal steps with Alliance mediated the 0 0 1 0 0 0
Turchik, 2010 University training clinic; (patient) or 5 Sobel test relationship between comfort
Various psychotherapy with closeness (attachment)
treatment (n = 66) and outcome
Clinical Psychology Review 82 (2020) 101921

(continued on next page)


Table 1 (continued)

Study Characteristics and Results Requirements for Process Research


A.L. Baier, et al.

Primary Author, Date Setting & Intervention(s)* Diagnosis Alliance Timepoint of Statistical Main Finding(s) RCT Disentangled N≥40 Multiple Temporality Manipulation
Measure Alliance Measure Mediation Effects Mediator
Method

Crits-Christoph, Data from a study on MDD CALPAS After sessions Longitudinal Alliance predicted next session 0 0 1 1 1 0
Gibbons, Hamilton, training therapists; (patient) 3–16 multilevel model symptom change. The reverse
Ring-Kurtz, & Alliance-Fostering Therapy relationship was observed only
Gallop, 2011 (n = 45) in later treatment sessions.

Owen et al., 2011 Naturalistic database from Mixed ITASr-SF End of academic Causal steps with Alliance mediated the 0 0 1 0 0 0
University counseling (patient) quarter bootstrap method relationship between clients'
center; Various perceptions of microaggressions
psychotherapy treatment and therapy outcomes
(n = 232)

Webb et al., 2011 RCT data; CT (n = 105) MDD WAI-SF Session 3 and 3rd Multiple Early alliance significantly 0 0 1 0 1 0
(observer) to last session regressions with predicted depressive symptom
change scores improvement

Hirsh, Quilty, Bagby, & Subsample RCT data; DBT BPD WAI-SF Baseline, 4, 8, Causal steps with Alliance mediated the 1 0 1 0 1 0
McMain, 2012 (n = 43) vs. GPM (n = 44) (patient) and 12 months product of relationship between
coefficient agreeableness and outcome in
method DBT only
a
Strunk, Cooper, Ryan, RCT data; CT + ADM arm MDD WAI-SF Sessions 1–3 Longitudinal Alliance scores did not predict 0 0 1 1 1 0
DeRubeis, & (n = 176) (observer) model subsequent symptom change
Hollon, 2012

6
Falkenström, Primary Care; Various Mixed WAI-SF After every Longitudinal Within-patient alliance 0 1 1 1 1 0
Granström, & psychotherapy treatment (patient) session multilevel model predicted next session symptom
Holmqvist, 2013 including supportive, change and vice versa. There
psychodynamic, and CBT was no treatment moderation.
(n = 646)

Patterson et al., 2014 University training clinic; Mixed WAI-SF After session 3 Causal steps with Alliance did not mediate the 0 0 1 0 0 0
Unspecified psychotherapy (patient) Sobel test relationship between treatment
(n = 68) expectancy and outcome

Yoo, Hong, Sohn, & Data from 13 University Mixed WAI-SF After the 3rd Multilevel Alliance mediated the 0 0 1 0 0 0
O'Brien, 2014 counseling centers, 4 (patient) session mediation model relationship between treatment
community counseling with bootstrap expectancy and outcome
centers, and 7 private method
practices; Various
psychotherapy treatment
(n = 284)

Zilcha-Mano, Dinger, RCT data; SET (n = 49) vs. MDD WAI (patient) Weeks 2, 4, 8, AR longitudinal Alliance predicted subsequent 1 0 1 1 1 0
McCarthy, & CM + ADM (n = 51) vs. and 16 multilevel model symptom levels, an effect not
Barber, 2014 CM + PBO (n = 49) moderated by treatment type.
a
Burns et al., 2015 RCT data; Combined Chronic Pain WAI-SF Week 4 and week Cross-lagged Alliance was associated with 0 0 1 1 1 0
sample: Enhanced CBT & (patient) 8 panel subsequent symptom change.
CBT (n = 94) correlations

McClintock, Anderson, Naturalistic database from Mixed WAI-SF Average of Causal steps with Alliance mediated the 0 0 1 1 0 0
& Petrarca, 2015 University clinic; Various (patient) Sessions 3–9 bootstrap method relationship between
psychotherapy treatment expectancy and outcome
(n = 116)
(continued on next page)
Clinical Psychology Review 82 (2020) 101921
Table 1 (continued)

Study Characteristics and Results Requirements for Process Research


A.L. Baier, et al.

Primary Author, Date Setting & Intervention(s)* Diagnosis Alliance Timepoint of Statistical Main Finding(s) RCT Disentangled N≥40 Multiple Temporality Manipulation
Measure Alliance Measure Mediation Effects Mediator
Method

Xu & Tracey, 2015 Naturalistic sample from Mixed WAI-SF Prior to each Latent change Alliance predicted subsequent 0 0 1 0 1 0
university training clinic; (patient) session starting score modeling symptom improvement and vice
Various psychotherapy with session 3 versa
treatment (n = 638)

Falkenström, Ekeblad, RCT data from community- MDD WAI-SR After every Dynamic panel Alliance predicted next session 1 1 1 1 1 0
& Holmqvist, 2016 based psychiatric clinic; (patient) & session data model symptom change. Results were
CBT (n = 43) vs. IPT WAI-SF not moderated by treatment
(n = 41) (therapist) and the reverse relationship
was not observed.

Klug, Zimmermann, & Data from comparative trial MDD HAQ (patient Every 3 months Multilevel Alliance did not mediate the 1 0 0 1 0 0
Huber, 2016 in outpatient university and therapist) (CBT) and mediation model relationship between treatment
clinic; PA (n = 35) vs. 6 months (PA, type and outcome
PD (n = 31) vs. CBT PD)
(n = 34)

Kushner, Quilty, RCT data; ADM (n = 74) vs. MDD CALPAS 3rd and 12th Serial multiple Alliance mediated the 1 0 1 0 1 0
Uliaszek, McBride, IPT (n = 65) vs. CBT (patient and session mediation model relationship between
& Bagby, 2016 (n = 70) therapist) with bootstrap agreeableness and symptom
method change, an effect not moderated
by treatment

7
Maitland et al., 2016 RCT data; FAP (n = 11) vs. Mixed WAI-SF Average of Causal steps with Alliance mediated the 1 0 0 0 0 0
WW (n = 11) (patient) sessions 1–3 bootstrap method relationship between treatment
condition symptom change.
a
Sasso et al., 2016 RCT data; CT arm (n = 60) MDD WAI-SF Sessions 1–4 Longitudinal Within-patient and between- 0 1 1 1 1 0
(observer) model patient alliance scores did not
predict subsequent symptom
change early in treatment

Lawson, Stulmaker, & University training clinic; PTSD ITA-RS Session 3 or 4 Causal steps with Alliance mediated the 0 0 1 0 0 0
Tinsley, 2017 Integrated Relationship and (patient) bootstrap method relationship between baseline
Trauma-Based CBT interpersonal problems and
(n = 76) dissociation posttreatment, but
not between interpersonal
problems and trauma symptoms
posttreatment
a
Zilcha-Mano & RCT data; Various Mixed WAI (patient) Sessions 1–4 Multilevel Early alliance development 0 0 1 0 1 0b
Errázuriz, 2017 psychotherapy treatment mediation model predicted treatment outcome
(n = 166) with therapists for patients with pretreatment
randomized to different interpersonal problems
feedback conditions

Renner et al., 2018 Specialized care facility; MDD SRS (patient) After every AR longitudinal Alliance did not predict change 0 0 0 1 1 0
SFT (n = 20) session multilevel model in depressive symptoms nor
vice versa.

Sauer-Zavala et al., RCT data; UP (n = 77) vs. Mixed WAI-SF After session 4 Causal steps with Alliance mediated the 1 0 1 0 0 0
2018 SDP (n = 76) Anxiety (patient) bootstrap method relationship between treatment
Disorders expectancy and change in
symptoms in SDP but not UP.
(continued on next page)
Clinical Psychology Review 82 (2020) 101921
Table 1 (continued)

Study Characteristics and Results Requirements for Process Research


A.L. Baier, et al.

Primary Author, Date Setting & Intervention(s)* Diagnosis Alliance Timepoint of Statistical Main Finding(s) RCT Disentangled N≥40 Multiple Temporality Manipulation
Measure Alliance Measure Mediation Effects Mediator
Method

Brattland et al., 2019 Naturalistic RCT; various Mixed WAI-SF At Session 1 and Multilevel Alliance mediated the 1 0 1 0 0 0
psychotherapy treatment (patient) after 2 months of mediation model relationship between treatment
with patients randomized to treatment condition and outcome.
TAU (n = 74) or ROM
(n = 69)

Rubel et al., 2019 RCT data; CBT (n = 57) GAD WAI-SF After every Dynamic Within-patient alliance scores 1 1 0 0 1 0
with patients randomized to (patient) session structural were associated with reduction
three different priming equation in anxiety and increase in
conditions (n = 19 per modeling coping experiences during the
condition) following session. Results were
not moderated by condition.

Santoft et al., 2019 RCT data; CBT (n = 40) vs. Exhaustion WAI-SF After every Multilevel Therapeutic alliance did not 1 0 1 1 1 0
RTW-I (n = 42) Disorder (patient) session mediation model mediate the relationship
between condition and burnout.

Gómez Penedo et al., RCT data; EBCT (n = 70) MDD WAI-SF After every Hybrid random Within-patient and between- 1 1 1 0 1 0
2020 vs. CBT (n = 71) (patient) session effects model patient alliance predicted next
session symptomatology even
when adjusting for treatment
condition

8
Leibovich, Front, RCT data; combined sample MDD WAI-SF Session 4 Causal steps with Alliance mediated the 0a 0 1 0 0 0
McCarthy, & of supportive therapy vs (patient) bootstrap method relationship between
Zilcha-Mano, 2020 supportive-expressive supportive techniques and
therapy (n = 61) outcome

Sullivan, Lawson, & Naturalistic database from a Mixed ITA-RS Early (session 3 Causal steps with Alliance did not mediate the 0 0 1 1 0 0
Akay-Sullivan, University training clinic; or 4); middle bootstrap method relationship between early
2020 trauma-based CBT and (between interpersonal distress and
relational-based CBT sessions 6–8); outcome
(n = 137) late (between
sessions 16–24)

Note: Column Headings: RCT = Randomized Controlled Trial; n ≥40 = Sample size per treatment arm is at least 40 or, combined is at least 40 if study did not examine treatment effects; Control = Control Group;
Multiple Mediators = Study included more than alliance as a potential mediator; Temporality = Study included two or more assessments of alliance during treatment phase; Manipulation = Manipulation of Alliance;
0 = Absent/No; 1 = Present/Yes. *Denotes reported sample size used in analysis; a Denotes data comes from RCTs but authors do not make use of RCT design in analyses such as by looking at treatment moderation; b
Study randomized clinicians to different kind of feedback pertaining to the alliance but did not examine this manipulation in the analyses. Interventions: CT = Cognitive Therapy; ADM = Antidepressant Medication;
IPT = Interpersonal Therapy; CBT = Cognitive Behavioral Therapy; EBCT = Exposure-Based Cognitive Therapy; CM = Clinical Management; CBASP = Cognitive Behavioral Analysis System of Psychotherapy;
SFT = Schema Focused Therapy; TFP = Transference Focused Psychotherapy; PA = Psychoanalytic; PD = Psychodynamic; DBT = Dialectical Behavior Therapy; GPM = General Psychiatric Management;
FAP = Functional Analytic Psychotherapy; WW = Watchful Waiting; UP = Unified Protocol; SDP = Single Disorder Protocols (empirically supported); RTW-I = Return to Work Intervention; ROM = Routine Outcome
Monitoring. Diagnosis: MDD = Major Depressive Disorder; BN = Bulimia Nervosa; BPD = Borderline Personality Disorder; PTSD = Posttraumatic Stress Disorder; GAD = Generalized Anxiety Disorder. Alliance
Measures: WAI = Working Alliance Inventory; WAI-SF = Working Alliance Inventory Short Form; WAI-SR = Working Alliance Inventory Scale Revised; CALPAS = California Psychotherapy Alliance Scale;
PHAS = Penn Helping Alliance Scale; VTAS = Vanderbilt Therapeutic Alliance Scale; HRQ = Helping Relationship Questionnaire; HAQ = Helping Alliance Questionnaire; HAQ-R = Helping Alliance Questionnaire-
Revised; HAq-II = Helping Alliance Questionnaire-II; ITASr-SF = Individual Treatment Alliance Scale Revised-Short Form; ITA-RS = Individual Therapy Alliance Revised/Shortened; SRS = Session Rating Scale.
AR = autoregressive.
Clinical Psychology Review 82 (2020) 101921
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

3.2. Study characteristics Over the course of time, in line with advances in methodology,
statistical methods used in the identified studies became more sophis­
Table 1 provides an overview of study characteristics and the extent ticated and included multilevel mediation (Krull & MacKinnon, 2001),
to which each study met predetermined criteria for process research. growth modeling (Cheong et al., 2003), and various forms of long­
Thirty-seven studies were included in the review with data from 5530 itudinal modeling (Curran & Bollen, 2001). Indeed, ten of the 17 studies
patients. Studies were published between 1990 and 2020 with sample published in the past five years (including 2015) used one of these
sizes ranging between 20 and 646 (median = 103; M = 149; methods (e.g., Falkenström et al., 2016; Renner et al., 2018; Santoft
SD = 144.1). The majority of studies were conducted in the United et al., 2019). Of the 20 studies using more advanced statistical meth­
States (59.5% vs. 24.3% in Europe, and 16.2% in other parts of the odology (e.g., multilevel and longitudinal modeling compared to simple
world). Study settings were mixed with 10 studies (27.0%) utilizing mediation models), the majority (15/20) found at least some evidence
data from training clinics or counseling centers and the remaining supporting alliance as a potential mediator. As presented in Table 1,
studies utilizing data from RCTs, hospitals, and/or specialized treat­ studies were substantially different from one another in terms of design
ment centers. Almost half (17 studies; 45.9%) were published in the last (e.g., different populations, psychopathology, treatment-type) as well
five years, including the years 2015 to 2020. Eighteen of the 37 studies as the extent to which they met requirements for process research.
examined the alliance within the context of cognitive therapy (CT), Furthermore, studies differed with how they handled missing data.
cognitive behavioral therapy (CBT), or a combined sample that in­ Studies largely used available data (20/37), often in conjunction with
cluded at least one arm of CT or CBT. Ten studies examined various imputation methods and in line with analytic requirements or theore­
forms of psychotherapy, often in the context of community mental tical rationale (e.g., to be included in analyses, patients needed at least
health clinics or university counseling centers. Other treatments ex­ “x” number of data points or patients needed to attend at least “x”
amined either in isolation or, in a combined sample with CT/CBT in­ number of treatment sessions). Six studies used completer samples. The
cluded Interpersonal Therapy (IPT, k = 4), Supportive Therapy (k = 2), remaining studies did not report how missing data were handled or,
Supportive Expressive Therapy (SET, k = 3), Schema Focused Therapy identifed an intent-to-treat approach (e.g., last observation carried
(SFT, k = 2), Psychoanalytic Therapy (PA, k = 1), Psychodynamic forward) and did not specify if they included patients with no data.
Therapy (PD, k = 1), Cognitive Behavioral Analysis System of Psy­ Conclusions regarding alliance as a mediator even among the most
chotherapy (CBASP, k = 1), Transference Focused Psychotherapy (TFP, statistically advanced studies should thus be interpreted in the context
k = 1), Functional Analytic Psychotherapy (FAP, k = 1), Dialectical of the variability noted across studies.
Behavior Therapy (DBT, k = 1), Unified Protocol (UP, k = 1), Single
Disorder Protocols (SDP, k = 1), and Return to Work Intervention
3.3. Process characteristics
(RTW-I, k = 1). Six studies included a combined treatment or phar­
macologic treatment.
For an overview on the number of studies meeting each of the re­
The most common disorders studied were major depressive disorder
quirements for process research, readers are directed to Table 2. The
(MDD; 15/37 studies, 40.1%) and mixed diagnostic samples (37.8%),
majority of studies (81.1%) had sample sizes greater than 40 patients
followed by posttraumatic stress disorder (PTSD; 5.4%), borderline
and are thus likely sufficiently powered for appropriate inclusion in
personality disorder (BPD; 5.4%), chronic pain (2.7%), and bulimia
systematic reviews or meta-analyses on the basis of sample size and
nervosa (2.7%), and exhaustion disorder (2.7%). Consequently, out­
power (Hedges & Pigott, 2004; Kazdin & Bass, 1989). Fewer than two-
come measures varied widely; the most commonly used outcome
thirds of the studies (59.5%) included more than two assessments of
measure was the self-report Beck Depression Inventory (Beck et al.,
alliance, and only half examined other putative mediators in addition to
1996), used in 11 of the 37 studies. The Working Alliance Inventory or
the alliance (51.4%). While 20 studies (54.1%) examined patients from
one of its short-form or revised versions (Hatcher & Gillaspy, 2006;
RCTs, only 14 studies (37.8%) made use of the RCT design in examining
Horvath & Greenberg, 1989; Tracey & Kokotovic, 1989) was the alli­
differential treatment effects. Finally, six studies (16.2%) adequately
ance measure used most often (25/37 studies; 67.6%) followed by
disentangled within and between-patient effects.
versions of the Helping Alliance (Alexander & Luborsky, 1986;
As noted, mediation analyses alone are not sufficient for drawing
Luborsky et al., 1996; Morgan, Luborsky, Crits-Christoph, Curtis, &
conclusions about change processes. The strength of the argument for
Solomon, 1982), which was used in 4 studies (10.8%). In terms of who
the mediator in question is proportional to the number of criteria met
reported the quality of alliance, the majority of studies (26/37) used
for process research (Kazdin, 2007). No study met all six criteria. Only
patient ratings, six studies used independent observer ratings, and five
one study met five criteria. Falkenström et al. (2016) conducted an RCT
used patient and therapist ratings (e.g., ran two separate models, one
comparing CBT (n = 43) to IPT (n = 41) in a sample of patients with
with patient ratings and one with therapist ratings). The timing of al­
major depressive disorder. The authors utilized multilevel longitudinal
liance assessments also varied widely across studies as can be seen in
models and additionally disaggregated within and between-patient ef­
Table 1.
fects (Curran et al., 2012; Wang & Maxwell, 2015), finding a reciprocal
The three earliest studies (⁎Barber, Connolly, Crits-Christoph,
relationship between the alliance and change in depressive symptoms.
Gladis, & Siqueland, 2000; DeRubeis & Feeley, 1990; Feeley et al.,
That is, alliance predicted next session change in depression scores and
1999) used temporal correlations to examine the relationship between
vice-versa, suggesting mutual influence of alliance and symptoms.
alliance and residualized symptom change at different time points in
therapy. Only one of these three (Barber et al., 2000) found evidence
Table 2
that alliance mediated symptom change. However, the methodology Number (%) of studies meeting criteria for process research (n = 37).
used in these first three studies limits the ability to draw strong con­
clusions about the role of alliance on outcome. The most common Requirement n studies (%)

statistical method used to examine mediation was through a causal step RCT, yes, n (%) 14 (37.8)
approach utilizing linear regressions (Baron & Kenny, 1986). Of the 13 Disaggregated within and between-patient effects, yes, n (%) 6 (16.2)
studies using this method, eight relied on bootstrapping methods to Sample size per condition ≥40, yes, n (%) 30 (81.1)
examine the size of the indirect effect (Preacher & Hayes, 2004) - a Multiple mediators, yes, n (%) 19 (51.4)
Temporality, yes, n (%) 22 (59.5)
method that can account for violation of normality assumptions Manipulation of mediator, yes, n (%) 0 (0.00)
(MacKinnon et al., 2007). Taken together, the majority of studies using
a causal step approach found support for alliance as a mediator (10/13 Note. RCT = randomized controlled trial; n = number of studies, % = percent
studies). of studies.

9
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

These results did not differ between treatments suggesting that the two- (Falkenström et al., 2016; Santoft et al., 2019; Sasso et al., 2016) had
way movement of alliance and symptom change was important across modest sample sizes under 100 patients which may have impacted
both treatment modalities providing support for alliance as a common findings; however, all studies were adequately powered.
factor across treatments. In addition, 9 studies (24.3%) met exactly half of the criteria for
Six studies met four criteria and therefore seem to be promising process research and 14 studies (37.8%) only met two criteria. Finally,
with regard to meeting process research requirements for under­ 7 studies (18.9%) only met one of the six criteria. While the combina­
standing drivers of therapeutic change. Klein et al. (2003) examined tion of criteria met varied between studies, most met the sample size
CBASP (n = 228) to CBASP plus antidepressant medication (n = 227) (30/37 studies) and temporality criteria (22/37 studies). It should be
for the treatment of depression. The authors utilized mixed effects noted that the temporality criterion did not mandate testing for re­
growth modeling on treatment initiators with baseline data to examine ciprocity or reverse causation, but only that the study included two or
the temporal relationship between alliance and change in depressive more assessments of alliance during the active phase of treatment.
symptoms. The study found alliance at week 2 predicted subsequent Taken together, 26 of the 37 studies (70.3%) found some evidence for
improvement in depressive symptoms after controlling for prior change. the mediating role of alliance. Of note, only seven studies (18.9%)
The authors found no evidence of reverse causality (i.e., symptoms could be considered of “highest quality” with respect to meeting at least
predicting improvements in alliance) and treatment condition did not 4 criteria for process research. Given the small number of studies
moderate the findings. meeting these requirements, results should be interpreted with caution.
In a large study of primary care patients (N = 646), Falkenström
et al. (2013) used longitudinal multilevel models to examine whether 4. Discussion
alliance predicted symptom improvement or vice versa. The authors
additionally disentangled effects following procedures recommended Of all papers identified in this systematic review, the majority
by Curran and Bauer (2011) and found that within-patient alliance (70.3%; 26 of 37 studies) found evidence for alliance as a mediator of
predicted next session symptom change and vice versa. While this was a change despite significant heterogeneity between study designs, sta­
naturalistic sample, the authors additionally examined whether the tistical analytic procedures, and overall quality. Although additional,
alliance-outcome relationship differed between treatment type, namely more targeted research is needed to more comprehensively unpack the
supportive, psychodynamic, or CBT finding no difference between alliance-outcome relationship, results of this review reinforce that al­
groups lending support for alliance as a nonspecific factor. liance likely plays an important role pantheoretically in effective psy­
Sasso, Strunk, Braun, DeRubeis, and Brotman (2016) re-examined chotherapy (Weck et al., 2015). The studies were critiqued with regard
data from the CT arm of a treatment trial for depression by dis­ to the extent to which they met six criteria for process research (Kazdin,
aggregating within-patient and between-patient variance in alliance 2007), in line with prior methodology used to evaluate change me­
scores as predictors of session to session symptom change early in chanisms in clinical research (Lemmens et al., 2017) while adapted to
treatment. The authors found that neither within-patient nor between- best meet this particular review. Only seven studies met four or more
patient variation in scores predicted subsequent symptom change. The criteria for process research pointing to clear future directions for the
authors noted their limited sample size (N = 60) as a possible ex­ study of alliance as a change mechanism. Nevertheless, an increasing
planation for their null findings. number of research groups over the past five years made use of robust
In an RCT comparing SET (n = 49) to clinical management (e.g., analytic techniques that adequately deal with assumption violations,
supportive interventions) and pharmacotherapy (n = 51) or clinical hierarchical data, and longitudinal methods to include disaggregating
management and placebo (n = 49) for patients diagnosed with de­ within-patient and between-patient effects, evidencing the promising
pression (Zilcha-Mano et al., 2014), alliance temporally predicted advancements of recent research and methodological approaches.
subsequent symptoms. The reverse relationship (symptom scores pre­ Given the positive alliance-outcome correlation that has con­
dicting next session alliance scores) was not observed. No significant sistently been observed in treatment research, alliance indeed seems to
treatment interaction was observed suggesting alliance was an im­ play some role in promoting symptom reduction, either mechanistically
portant predictor of change across these treatment modalities. or by facilitating mechanistic processes. To answer the question of how
Santoft et al. (2019) compared CBT (n = 40) to RTW-I (n = 42) for the alliance contributes to change, mediation analyses are needed
the treatment of “exhaustion disorders” or burnout, a disorder found in coupled with robust research designs that utilize RCTs to further in­
the International Statistical Classification of Diseases and Related vestigate the question of whether the alliance is a specific or nonspecific
Health Problems (ICD-10; Organization, 2004). Over half of the sample factor of change. If the alliance is a nonspecific factor as the research to
(57.3%) met criteria for a comorbid disorder. The authors used a date supports, then RCTs comparing different therapies should find no
multilevel mediation model, finding no association between the alli­ differences between treatments in the role of alliance on treatment
ance and subsequent symptom changes over time. Additionally, alliance outcome. However, some continue to argue alliance as a specific change
did not mediate the relationship between treatment type and outcome. factor more important for certain psychotherapies (e.g., relational) than
Finally, Gómez Penedo et al. (2020) compared the alliance as a pre­ others (e.g., exposure therapy). Additionally, studies should aim for
dictor of next session symptomatology in exposure-based cognitive large sample sizes to ensure adequate power, multiple assessments of
therapy and CBT for patients with depression. The authors used a hy­ both validated alliance measures and validated outcome measures to
brid random effect model finding both within-patient and between- assess temporality, and the study of multiple constructs in concert. We
patient alliance predicted next session symptomatology even when further acknowledge that given ethical and clinical demands of opti­
adjusting for treatment condition. mizing the therapeutic alliance in treatment, the manipulation of alli­
Thus, of these seven studies scoring highest (4 or 5 out of 6 criteria) ance within a clinical research framework is challenging, if not im­
with regard to meeting requirements for process research, findings are possible. However, the ability to study if the magnitude of the mediator
mixed. Five studies found evidence for the mediating role of alliance influences outcome is a critical step in identifying mechanisms of
whereas two studies did not. Additionally, four studies investigated change. It may be that the alliance is one purported change process that
reciprocity (i.e., alliance predicting symptoms and symptoms predicting will be difficult to unequivocally ascertain as a mechanism, whereas
alliance); two found support for this two-way movement between the other constructs (e.g., Socratic dialogue, exposure activities, behavioral
alliance and symptom change. All five studies finding support for alli­ activation) can be manipulated ethically. However even when omitting
ance as a mediator of change also found support for alliance as a this criterion, of the 37 included papers, less than half (16 studies,
nonspecific or “common” factor suggesting alliance is an important 43.2%) met at least three of the other five requirements, evidencing the
construct irrespective of psychotherapy modality. Three studies paucity of literature adhering to stringent criteria for understanding

10
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

mediators and drivers of treatment change. 2017) in prolonged exposure for posttraumatic stress disorder). The
The 37 studies included in this review varied widely with regard to current review suggests however that, in addition to these specific
the extent to which they met requirements for process research in ad­ treatment components, alliance itself often also contributes to ther­
dition to mediation method used and sample size. Ultimately, research apeutic change for patients. It is thus possible alliance independently
aimed at uncovering possible change processes—including the allian­ drives therapeutic change; however, it is likely more plausible that the
ce—must move toward inclusion of requirements for process research alliance does not act in isolation but rather facilitates other treatment
beginning with mediation analyses. While the statistical methodology processes (Lorenzo-Luaces & DeRubeis, 2018; Rothman, 2013). For
used in the included studies largely improved over the course of time to example, the alliance between a patient and provider likely impacts the
account for more advanced models, future research will need to focus design and assignment of homework, creation of exposure exercises, or
on using methodologically robust methods that are specific to the data receptivity to Socratic dialogue. Finally, in addition to alliance being
in question. For example, most mediation models examine linear particularly salient for symptom change among certain patients, it is
changes; however, change is not always linear (Hayes, Laurenceau, also likely that the alliance may be more relevant for the im­
Feldman, Strauss, & Cardaciotto, 2007). Patients often show sudden plementation of certain techniques rather than others (Tschacher,
gains (Jun, Zoellner, & Feeny, 2013) and experience ruptures and re­ Junghan, & Pfammatter, 2014). Thus, perhaps the quest to resolve the
pairs in the alliance throughout the course of treatment (McLaughlin, debate between whether specific or common factors are responsible for
Keller, Feeny, Youngstrom, & Zoellner, 2014), which may not be ac­ therapeutic change is misguided. Research efforts that consider the
curately reflected in linear models. Notably, we explicitly omitted such complexity of the therapeutic change process between specific and
papers from this review (e.g., Zilcha-Mano, Eubanks, Bloch-Elkouby, & common factors and that capitalize on recent methodological and sta­
Muran, 2020) for methodological consistency and interpretation, as tistical advances would further propel our scientific understanding of
well as our focus in examining the links between outcomes and alliance change processes.
throughout the entire course of therapy. Thus, future studies should Given the importance of the alliance, clinicians should consider
explore the use of nonlinear and curvilinear models, which could help introducing routine and systematic ways of monitoring the alliance
elucidate the temporal patterns associated with change processes. such as with brief, validated patient-rated measures (e.g., WAI;
Perhaps the alliance is critical early in the therapeutic process and less (Horvath & Greenberg, 1989). It is well-documented that there are
susceptible to ruptures later on in treatment. In order to study temporal benefits to monitoring patient progress throughout the course of psy­
patterns, research must make use of repeated measurement of alliance chotherapy to track gains or setbacks and make adjustments to the
and symptoms over the course of treatment. Identifying a time course of therapy as needed (Knaup, Koesters, Schoefer, Becker, & Puschner,
possible mediators, such as the alliance, will help clinicians better un­ 2009; Lambert & Lo Coco, 2013; Lambert & Shimokawa, 2011; Sapyta,
derstand when and where in treatment they might wish to direct their Riemer, & Bickman, 2005). In addition to symptom monitoring, clinical
focus. Indeed, a recent meta-analysis of session-by-session data found outcomes across treatment are bolstered by patient feedback related to
that early in therapy, alliance and symptoms were reciprocally related the alliance (MacDonald, 2014; McClintock, Perlman, McCarrick,
to one another (Fluckiger et al., 2020). Anderson, & Himawan, 2017; Norcross & Wampold, 2011). System­
Identifying mediators ultimately relies on sound study designs in­ atically monitoring the alliance would also assist clinicians' attention to
cluding RCTs and careful assessment of putative mediators to allow for potential therapeutic ruptures, which have been shown not to nega­
an examination of temporality and specificity. It will be important for tively affect outcome so long as they are repaired (McLaughlin et al.,
future research to make use of these study designs. Better under­ 2014). Furthermore, studies have found that alliance scores are not
standing the mechanistic role of alliance will be assisted by research on inflated due to the presence of a therapist or knowing that the scores
alliance that is crafted during study design rather than being a sec­ would be reviewed by a therapist, which should relieve clinician con­
ondary analysis of treatment data. Approaching the study of alliance cerns regarding demand characteristics or social desirability of regular
from the outset will enable researchers to ensure inclusion of important administration of alliance measures within psychotherapy (Reese et al.,
aspects of sound process research such as multiple assessments of alli­ 2013).
ance and other putative change processes that might interact with al­ Key strengths of this review include its systematic search adherent
liance throughout the duration of treatment. to PRISMA guidelines, with a comprehensive examination of ther­
Finally, as the alliance-outcome relationship is better understood, apeutic alliance through mediation analyses and thus a mechanistic
research should continue to examine possible moderators of the re­ viewpoint. A diverse range of patients, primary diagnoses, psy­
lationship, such as therapist effects or patient characteristics. Recent chotherapies, and treatment settings were included enhancing the
research, for example, has demonstrated that impact of alliance on generalizability of the findings. However, findings should be inter­
outcomes may be more relevant for some patients than others. preted in the context of several limitations. As presented in Table 1,
Specifically, the impact of alliance on symptom change in patients re­ study characteristics varied widely which should be considered in the
ceiving treatment for depression has been affected by chronicity of context of this review's conclusions. Given the variability in methodo­
depression, whereby the effects of alliance on outcome were greatest logical design implemented across studies, we elected not to conduct a
among patients with fewer prior depressive episodes (e.g., Lorenzo- meta-analysis. We also note that the variables in the relationships with
Luaces et al., 2017; Lorenzo-Luaces, DeRubeis, & Webb, 2014). It is thus alliance as a mediator (i.e., “X” and “Y” variables) were not uniform.
likely that alliance drives therapeutic change to a greater degree for The heterogeneity of factors precluded the possibility of reliably and
certain patients. meaningfully evaluating the size of effects related to alliance as a
Clinically, cultivation of alliance should be prioritized at the earliest mediator. Advancements in methodology ultimately equate to ad­
stages of treatment. In addition to being broadly associated with op­ vancements in what can be reliably concluded regarding processes of
timal treatment outcomes, a stronger alliance appears to also itself re­ change and, more broadly, how treatments work (Zilcha-Mano, 2019).
flect an independent contributor to symptom reduction and likely be Notably, this review highlights significant advancements in analytic
one of the many processes driving change across therapy types, patient approaches and methodology in recent years, with roughly half of in­
characteristics, and treatment settings. Notably, while alliance appears cluded studies published within the last five years. Recent papers have
to mediate change for some patients, it is also clear that other treatment shifted from correlational analyses taken at a snapshot during treatment
processes and techniques impact outcomes as well. Treatment process to more advanced longitudinal models that provide more precise esti­
research studying psychotherapy mechanisms has consistently im­ mates of the relationship between alliance and outcomes. Additional
plicated the role of specific processes on symptom reduction (e.g., progress in design and methodology will better illuminate the role that
change in posttraumatic cognitions and fear reduction; Cooper et al., alliance plays in driving therapeutic change and enable future meta-

11
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

analytic studies. processes using parallel process latent growth curve modeling. Structural Equation
Results of the current review suggests that alliance itself may be an Modeling, 10(2), 238–262. https://doi.org/10.1207/S15328007SEM1002_5.
Cooper, A. A., Clifton, E. G., & Feeny, N. C. (2017). An empirical review of potential
independent driver of therapeutic change. In the majority of studies mediators and mechanisms of prolonged exposure therapy. Clinical Psychology
included in the current review, alliance mediated symptom reduction, Review, 56, 106–121. https://doi.org/10.1016/j.cpr.2017.07.003.
supporting the alliance as a potential causal process, either in­ *Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011).
The dependability of alliance assessments: The alliance–outcome correlation is larger
dependently or in conjunction with other change processes. This effect than you might think. Journal of Consulting and Clinical Psychology, 79(3), 267–278.
was observed across a broad range of patients, disorders, and settings https://doi.org/10.1037/a0023668.
that were included in this review. Alliance likely impacts psy­ Cuijpers, P., van Straten, A., Bohlmeijer, E., Hollon, S. D., & Andersson, G. (2010). The
effects of psychotherapy for adult depression are overestimated: A meta-analysis of
chotherapy in complex ways, reflecting the need for future targeted study quality and effect size. Psychological Medicine, 40(2), 211–223. https://doi.org/
research to untangle these complex interactions and better elucidate 10.1017/S0033291709006114.
when, how, for whom, and the extent to which alliance serves as a Curran, P. J., & Bauer, D. J. (2011). The disaggregation of within-person and between-
person effects in longitudinal models of change. Annual Review of Psychology, 62,
mediator of outcome.
583–619. https://doi.org/10.1146/annurev.psych.093008.100356.
Curran, P. J., & Bollen, K. A. (2001). The best of both worlds: Combining autoregressive
Contributors and latent curve models. In L. M. Collins, & A. G. Sayer (Eds.). New methods for the
analysis of change (pp. 107–135). Washington, DC: American Psychological
Association.
ALB developed the concept for the study and reviewed the litera­ Curran, P. J., Lee, T., Howard, A. L., Lane, S., & MacCallum, R. (2012). Disaggregating
ture. ACK and NCF consulted on scope of the review and relevant within-person and between-person effects in multilevel and structural equation
methodology such as search terms and inclusion/exclusion criteria. ALB growth models. In J. R. Harring, G. R. Hancock, J. R. Harring, & G. R. Hancock (Eds.).
Advances in longitudinal methods in the social and behavioral sciences (pp. 217–253).
wrote the first draft of the manuscript and all three authors contributed Charlotte, NC, US: IAP Information Age Publishing.
to and have approved the final manuscript. *DeRubeis, R. J., & Feeley, M. (1990). Determinants of change in cognitive therapy for
depression. Cognitive Therapy and Research, 14(5), 469–482. https://doi.org/10.
1007/BF01172968.
Declaration of Competing Interest *Falkenström, F., Ekeblad, A., & Holmqvist, R. (2016). Improvement of the working al­
liance in one treatment session predicts improvement of depressive symptoms by the
next session. Journal of Consulting and Clinical Psychology, 84(8), 738–751. https://
All authors declare that they have no conflicts of interest.
doi.org/10.1037/ccp0000119.
*Falkenström, F., Granström, F., & Holmqvist, R. (2013). Therapeutic alliance predicts
Acknowledgements symptomatic improvement session by session. Journal of Counseling Psychology, 60(3),
317–328. https://doi.org/10.1037/a0032258.
*Feeley, M., DeRubeis, R. J., & Gelfand, L. A. (1999). The temporal relation of adherence
The authors wish to thank Alexandra Bowling for her diligent re­ and alliance to symptom change in cognitive therapy for depression. Journal of
view of articles included in this review. Consulting and Clinical Psychology, 67(4), 578–582.
Fluckiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018). The alliance in adult
psychotherapy: A meta-analytic synthesis. Psychotherapy (Chicago, Ill.), 55(4),
References 316–340. https://doi.org/10.1037/pst0000172.
Fluckiger, Christoph, Rubel, Julian, Del Re, A. C., Horvath, Adam O., Wampold, Bruce E.,
Alexander, L. B., & Luborsky, L. (1986). The Penn helping alliance scales. In L. S. Crits-Christoph, Paul, ... Barber, Jacques (2020). The Reciprocal Relationship
Greenberg, & W. M. Pinsof (Eds.). The psychotherapeutic process: A research handbook Between Alliance and Early Treatment Symptoms: A Two-Stage Individual
(pp. 325–366). New York, NY: Guilford Press. Participant Data Meta-Analysis. Journal of Consulting and Clinical Psychology, 88(9),
Alwin, D. F., & Hauser, R. M. (1975). The decomposition of effects in path analysis. 829–843. https://doi.org/10.1037/ccp0000594.
American Sociological Review, 40(1), 37–47. https://doi.org/10.2307/2094445. Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., & Horvath, A. O. (2012). How
*Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance-outcome central is the alliance in psychotherapy? A multilevel. Journal of Counseling
correlation: Exploring the relative importance of therapist and patient variability in Psychology, 59(1), 10–17. https://doi.org/10.1037/A0025749.
the alliance. Journal of Consulting and Clinical Psychology, 75(6), 842–852. https:// *Forbes, D., Parslow, R., Creamer, M., Allen, N., McHugh, T., & Hopwood, M. (2008).
doi.org/10.1037/0022-006X.75.6.842. Mechanisms of anger and treatment outcome in combat veterans with posttraumatic
⁎Barber, J. P., Connolly, M. B., Crits-Christoph, P., Gladis, L., & Siqueland, L. (2000). stress disorder. Journal of Traumatic Stress, 21(2), 142–149. https://doi.org/10.1002/
Alliance predicts patients’ outcome beyond in-treatment change in symptoms. Journal jts.20315.
of Consulting and Clinical Psychology, 68(6), 1027–1032. https://doi.org/10.1037/ *Gómez Penedo, J. M., Babl, A., Krieger, T., Heinonen, E., Flückiger, C., & Grosse
0022-006X.68.6.1027. Holtforth, M. (2020). Interpersonal agency as predictor of the within-patient alliance
Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in effects on depression severity. Journal of Consulting and Clinical Psychology, 88(4),
social psychological research: Conceptual, strategic, and statistical considerations. 338–349. https://doi.org/10.1037/ccp0000475.
Journal of Personality and Social Psychology, 51(6), 1173–1182. https://doi.org/10. Hatcher, R. L., & Barends, A. W. (2006). How a return to theory could help alliance
1037/0022-3514.51.6.1173. research. Psychotherapy: Theory, Research, Practice, Training, 43(3), 292–299. https://
Bauer, D. J., Preacher, K. J., & Gil, K. M. (2006). Conceptualizing and testing random doi.org/10.1037/0033-3204.43.3.292.
indirect effects and moderated mediation in multilevel models: New procedures and Hatcher, R. L., & Gillaspy, J. A. (2006). Development and validation of a revised short
recommendations. Psychological Methods, 11(2), https://doi.org/10.1037/1082- version of the working Alliance inventory. Psychotherapy Research, 16(1), 12–25.
989X.11.2.142 142–163. (Supplemental). https://doi.org/10.1080/10503300500352500.
Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. (1996). Comparison of Beck depression Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis:
inventories -IA and -II in psychiatric outpatients. Journal of Personality Assessment, A regression-based approach. New York, NY: Guilford Press.
67(3), 588–597. https://doi.org/10.1207/s15327752jpa6703_13. Hayes, A. M., Laurenceau, J.-P., Feldman, G., Strauss, J. L., & Cardaciotto, L. (2007).
Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working Change is not always linear: The study of nonlinear and discontinuous patterns of
alliance. Psychotherapy: Theory, Research & Practice, 16(3), 252–260. https://doi.org/ change in psychotherapy. Clinical Psychology Review, 27(6), 715–723. https://doi.
10.1037/h0085885. org/10.1016/j.cpr.2007.01.008.
Bordin, E. S. (1994). Theory and research on the therapeutic working alliance: New di­ Hayes, & Scharkow, M. (2013). The relative trustworthiness of inferential tests of the
rections. In A. O. Horvath, & L. S. Greenberg (Eds.). The working alliance: Theory, indirect effect in statistical mediation analysis: Does method really matter?
research, and practice (pp. 13–37). Oxford, England: John Wiley & Sons. Psychological Science, 24(10), 1918–1927. https://doi.org/10.1177/
*Brattland, H., Koksvik, J. M., Burkeland, O., Klöckner, C. A., Lara-Cabrera, M. L., Miller, 0956797613480187.
S. D., ... Iversen, V. C. (2019). Does the working alliance mediate the effect of routine Hedges, L. V., & Pigott, T. D. (2004). The power of statistical tests for moderators in meta-
outcome monitoring (ROM) and alliance feedback on psychotherapy outcomes? A analysis. Psychological Methods, 9(4), 426–445. https://doi.org/10.1037/1082-989X.
secondary analysis from a randomized clinical trial. Journal of Counseling Psychology, 9.4.426.
66(2), 234–246. https://doi.org/10.1037/cou0000320. *Hirsh, J. B., Quilty, L. C., Bagby, R. M., & McMain, S. F. (2012). The relationship be­
*Burns, J. W., Nielson, W. R., Jensen, M. P., Heapy, A., Czlapinski, R., & Kerns, R. D. tween agreeableness and the development of the working alliance in patients with
(2015). Specific and general therapeutic mechanisms in cognitive behavioral treat­ borderline personality disorder. Journal of Personality Disorders, 26(4), 616–627.
ment of chronic pain. Journal of Consulting and Clinical Psychology, 83(1), 1–11. https://doi.org/10.1521/pedi.2012.26.4.616.
https://doi.org/10.1037/a0037208. Horvath, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.). Psychotherapy
*Byrd, K. R., Patterson, C. L., & Turchik, J. A. (2010). Working alliance as a mediator of relationships that work: Evidence-based responsiveness (pp. 37–69). New York, NY:
client attachment dimensions and psychotherapy outcome. Psychotherapy: Theory, Oxford University Press.
Research, Practice, Training, 47(4), 631–636. https://doi.org/10.1037/a0022080. Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011). Alliance in individual
Cheong, J., MacKinnon, D. P., & Khoo, S. T. (2003). Investigation of mediational psychotherapy. Psychotherapy, 48(1), 9–16. https://doi.org/10.1037/a0022186.
Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the working

12
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

Alliance inventory. Journal of Counseling Psychology, 36(2), 223–233. https://doi.org/ 0193841X9301700202.


10.1037/0022-0167.36.2.223. MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007). Mediation analysis. Annual
Horvath, A. O., & Symonds, B. D. (1991). Relation between working alliance and outcome Review of Psychology, 58, 593–614. https://doi.org/10.1146/annurev.psych.58.
in psychotherapy: A meta-analysis. Journal of Counseling Psychology, 38(2), 139–149. 110405.085542.
https://doi.org/10.1037/0022-0167.38.2.139. MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A
Johansson, P., & Høglend, P. (2007). Identifying mechanisms of change in psychotherapy: comparison of methods to test mediation and other intervening variable effects.
Mediators of treatment outcome. Clinical Psychology & Psychotherapy, 14(1), 1–9. Psychological Methods, 7(1), 83–104. https://doi.org/10.1037/1082-989X.7.1.83.
https://doi.org/10.1002/cpp.514. *Maitland, D. W. M., Petts, R. A., Knott, L. E., Briggs, C. A., Moore, J. A., & Gaynor, S. T.
Judd, C. M., & Kenny, D. A. (1981). Process analysis: Estimating mediation in treatment (2016). A randomized controlled trial of functional analytic psychotherapy versus
evaluations. Evaluation Review, 5(5), 602–619. https://doi.org/10.1177/ watchful waiting: Enhancing social connectedness and reducing anxiety and avoid­
0193841X8100500502. ance. Behavior Analysis: Research and Practice, 16(3), 103–122. https://doi.org/10.
Jun, J. J., Zoellner, L. A., & Feeny, N. C. (2013). Sudden gains in prolonged exposure and 1037/bar0000051.
sertraline for chronic PTSD. Depression and Anxiety, 30(7), 607–613. https://doi.org/ Martin, D. J., Garske, J. P., & Davis, M. K. (2000). Relation of the therapeutic alliance
10.1002/da.22119. with outcome and other variables: A meta-analytic review. Journal of Consulting and
Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Clinical Psychology, 68(3), 438–450. https://doi.org/10.1037/0022-006X.68.3.438.
Annual Review of Clinical Psychology, 3, 1–27. https://doi.org/10.1146/annurev. *McClintock, A. S., Anderson, T., & Petrarca, A. (2015). Treatment expectations, alliance,
clinpsy.3.022806.091432. session positivity, and outcome: An investigation of a three-path mediation model.
Kazdin, A. E., & Bass, D. (1989). Power to detect differences between alternative treat­ Journal of Clinical Psychology, 71(1), 41–49. https://doi.org/10.1002/jclp.22119.
ments in comparative psychotherapy outcome research. Journal of Consulting and McClintock, A. S., Perlman, M. R., McCarrick, S. M., Anderson, T., & Himawan, L. (2017).
Clinical Psychology, 57(1), 138–147. https://doi.org/10.1037/0022-006X.57.1.138. Enhancing psychotherapy process with common factors feedback: A randomized,
Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and clinical trial. Journal of Counseling Psychology, 64(3), 247–260. https://doi.org/10.
adolescent therapy: Methodological issues and research recommendations. Journal of 1037/cou0000188.
Child Psychology and Psychiatry, 44(8), 1116–1129. https://doi.org/10.1111/1469- McLaughlin, A. A., Keller, S. M., Feeny, N. C., Youngstrom, E. A., & Zoellner, L. A. (2014).
7610.00195. Patterns of therapeutic alliance: Rupture–repair episodes in prolonged exposure for
*Klein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 82(1),
... Keller, M. B. (2003). Therapeutic alliance in depression treatment: Controlling for 112–121. https://doi.org/10.1037/a0034696.
prior change and patient characteristics. Journal of Consulting and Clinical Psychology, Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The, P. G. (2009). Preferred reporting
71(6), 997–1006. https://doi.org/10.1037/0022-006X.71.6.997. items for systematic reviews and meta-analyses: The PRISMA statement. PLoS
*Klug, G., Zimmermann, J., & Huber, D. (2016). Outcome trajectories and mediation in Medicine, 6(7), Article e1000097. https://doi.org/10.1371/journal.pmed.1000097.
psychotherapeutic treatments of major depression. Journal of the American Morgan, R., Luborsky, L., Crits-Christoph, P., Curtis, H., & Solomon, J. (1982). Predicting
Psychoanalytic Association, 64(2), 307–343. https://doi.org/10.1177/ the outcomes of psychotherapy by the Penn helping Alliance rating method. Archives
0003065116644742. of General Psychiatry, 39(4), 397–402. https://doi.org/10.1001/archpsyc.1982.
Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback 04290040013002.
of treatment outcome in specialist mental healthcare: Meta-analysis. The British Nathan, P. E., & Gorman, J. M. (2015). A guide to treatments that work (4th ed.). New York,
Journal of Psychiatry, 195(1), 15–22. https://doi.org/10.1192/bjp.bp.108.053967. NY, US: Oxford University Press.
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and Norcross, J. C., & Wampold, B. E. (2011). Evidence-based therapy relationships: Research
moderators of treatment effects in randomized clinical trials. Archives of General conclusions and clinical practices. Psychotherapy, 48(1), 98–102. https://doi.org/10.
Psychiatry, 59(10), 877–883. https://doi.org/10.1001/archpsyc.59.10.877. 1037/a0022161.
Krull, J. L., & MacKinnon, D. P. (2001). Multilevel modeling of individual and group level Organization, W. H. (2004). ICD-10: International statistical classification of diseases and
mediated effects. Multivariate Behavioral Research, 36(2), 249–277. https://doi.org/ related health problems (tenth revision, 2nd ed.): World Health Organization.
10.1207/S15327906MBR3602_06. *Owen, J., Imel, Z., Tao, K. W., Wampold, B., Smith, A., & Rodolfa, E. (2011). Cultural
*Kushner, S. C., Quilty, L. C., Uliaszek, A. A., McBride, C., & Bagby, R. M. (2016). ruptures in short-term therapy: Working alliance as a mediator between clients’
Therapeutic alliance mediates the association between personality and treatment perceptions of microaggressions and therapy outcomes. Counselling & Psychotherapy
outcome in patients with major depressive disorder. Journal of Affective Disorders, Research, 11(3), 204–212. https://doi.org/10.1080/14733145.2010.491551.
201, 137–144. https://doi.org/10.1016/j.jad.2016.05.016. *Patterson, C. L., Anderson, T., & Wei, C. (2014). Clients’ pretreatment role expectations,
Lambert, M. J., & Lo Coco, G. (2013). Simple methods for enhancing patient outcome in the therapeutic alliance, and clinical outcomes in outpatient therapy. Journal of
routine care: Measuring, monitoring, and feedback. Research in Psychotherapy: Clinical Psychology, 70(7), 673–680. https://doi.org/10.1002/jclp.22054.
Psychopathology, Process and Outcome, 16(2), 93–101. https://doi.org/10.4081/ Pincus, H. A., & England, M. J. (2015). Improving the quality of psychosocial interven­
ripppo.2013.147. tions for mental and substance use disorders: A report from the IOMPsychosocial
Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), interventions for mental health and substance use DisordersPsychosocial interven­
72–79. https://doi.org/10.1037/a0022238. tions for mental health and substance use disorders. Jama, 314(12), 1227–1228.
Laurenceau, J.-P., Hayes, A. M., & Feldman, G. C. (2007). Some methodological and https://doi.org/10.1001/jama.2015.9212.
statistical issues in the study of change processes in psychotherapy. Clinical Preacher, K. J., & Hayes, A. F. (2004). SPSS and SAS procedures for estimating indirect
Psychology Review, 27(6), 682–695. https://doi.org/10.1016/j.cpr.2007.01.007. effects in simple mediation models. Behavior Research Methods, Instruments &
*Lawson, D. M., Stulmaker, H., & Tinsley, K. (2017). Therapeutic alliance, interpersonal Computers, 36(4), 717–731. https://doi.org/10.3758/BF03206553.
relations, and trauma symptoms: Examining a mediation model of women with Raykos, B. C., McEvoy, P. M., Erceg-Hurn, D., Byrne, S. M., Fursland, A., & Nathan, P.
childhood abuse histories. Journal of Aggression, Maltreatment & Trauma, 26(8), (2014). Therapeutic alliance in enhanced cognitive behavioural therapy for bulimia
861–878. https://doi.org/10.1080/10926771.2017.1331941. nervosa: Probably necessary but definitely insufficient. Behaviour Research and
*Leibovich, L., Front, O., McCarthy, K. S., & Zilcha-Mano, S. (2020). How do supportive Therapy, 57, 65–71. https://doi.org/10.1016/j.brat.2014.04.004.
techniques bring about therapeutic change: The role of therapeutic alliance as a Reese, R. J., Gillaspy, J. A., Jr., Owen, J. J., Flora, K. L., Cunningham, L. C., Archie, D., &
potential mediator. Psychotherapy, 57(2), 151–159. https://doi.org/10.1037/ Marsden, T. (2013). The influence of demand characteristics and social desirability
pst0000253. on clients’ ratings of the therapeutic alliance. Journal of Clinical Psychology, 69(7),
Lemmens, L. H. J. M., Galindo-Garre, F., Arntz, A., Peeters, F., Hollon, S. D., DeRubeis, R. 696–709. https://doi.org/10.1002/jclp.21946.
J., & Huibers, M. J. H. (2017). Exploring mechanisms of change in cognitive therapy *Renner, F., DeRubeis, R., Arntz, A., Peeters, F., Lobbestael, J., & Huibers, M. J. H. (2018).
and interpersonal psychotherapy for adult depression. Behaviour Research and Exploring mechanisms of change in schema therapy for chronic depression. Journal of
Therapy, 94, 81–92. https://doi.org/10.1016/j.brat.2017.05.005. Behavior Therapy and Experimental Psychiatry, 58, 97–105. https://doi.org/10.1016/j.
Lorenzo-Luaces, L., & DeRubeis, R. J. (2018). Miles to go before we sleep: Advancing the jbtep.2017.10.002.
understanding of psychotherapy by modeling complex processes. Cognitive Therapy Rothman, A. J. (2013). Exploring connections between moderators and mediators:
and Research, 42(2), 212–217. https://doi.org/10.1007/s10608-018-9893-x. Commentary on subgroup analyses in intervention research. Prevention Science, 14(2),
Lorenzo-Luaces, L., DeRubeis, R. J., & Webb, C. A. (2014). Client characteristics as 189–192. https://doi.org/10.1007/s11121-012-0333-y.
moderators of the relation between the therapeutic alliance and outcome in cognitive *Rubel, J. A., Hilpert, P., Wolfer, C., Held, J., Vîslă, A., & Flückiger, C. (2019). The
therapy for depression. Journal of Consulting and Clinical Psychology, 82(2), 368–373. working alliance in manualized CBT for generalized anxiety disorder: Does it lead to
https://doi.org/10.1037/a0035994. change and does the effect vary depending on manual implementation flexibility?
Lorenzo-Luaces, L., Driessen, E., DeRubeis, R. J., Van, H. L., Keefe, J. R., Hendriksen, M., Journal of Consulting and Clinical Psychology. doi:https://doi.org/10.1037/
& Dekker, J. (2017). Moderation of the Alliance-outcome association by prior de­ ccp0000433.supp (Supplemental).
pressive episodes: Differential effects in cognitive-behavioral therapy and short-term *Santoft, F., Salomonsson, S., Hesser, H., Lindsäter, E., Ljótsson, B., Lekander, M., ...
psychodynamic supportive psychotherapy. Behavior Therapy, 48(5), 581–595. Hedman-Lagerlöf, E. (2019). Mediators of change in cognitive behavior therapy for
https://doi.org/10.1016/j.beth.2016.11.011. clinical burnout. Behavior Therapy, 50(3), 475–488. https://doi.org/10.1016/j.beth.
Luborsky, L., Barber, J. P., Siqueland, L., Johnson, S., Najavits, L. M., Frank, A., & Daley, 2018.08.005.
D. (1996). The revised helping Alliance questionnaire (HAq-II): Psychometric prop­ Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research,
erties. Journal of Psychotherapy Practice & Research, 5(3), 260–271. and practice. Journal of Clinical Psychology, 61(2), 145–153. https://doi.org/10.
MacDonald, J. (2014). 'Formal' feedback in psychotherapy as psychoanalytic technique. 1002/jclp.20107.
Psychodynamic Practice: Individuals, Groups and Organisations, 20(2), 154–163. *Sasso, K. E., Strunk, D. R., Braun, J. D., DeRubeis, R. J., & Brotman, M. A. (2016). A re-
https://doi.org/10.1080/14753634.2013.771566. examination of process–outcome relations in cognitive therapy for depression:
Mackinnon, D. P., & Dwyer, J. H. (1993). Estimating mediated effects in prevention Disaggregating within-patient and between-patient effects. Psychotherapy Research,
studies. Evaluation Review, 17(2), 144–158. https://doi.org/10.1177/ 26(4), 387–398. https://doi.org/10.1080/10503307.2015.1026423.

13
A.L. Baier, et al. Clinical Psychology Review 82 (2020) 101921

*Sauer-Zavala, S., Boswell, J. F., Bentley, K. H., Thompson-Hollands, J., Farchione, T. J., and competent implementation of techniques. British Journal of Clinical Psychology,
& Barlow, D. H. (2018). Expectancies, working alliance, and outcome in transdiag­ 54(1), 91–108. https://doi.org/10.1111/bjc.12063.
nostic and single diagnosis treatment for anxiety disorders: An investigation of Weissman, M. M. (2015). The institute of medicine (IOM) sets a framework for evidence-
mediation. Cognitive Therapy and Research, 42(2), 135–145. https://doi.org/10.1007/ baed standards for psychotherapy. Depression and Anxiety, 32(11), 787–789. https://
s10608-017-9855-8. doi.org/10.1002/da.22434.
Saxon, D., Firth, N., & Barkham, M. (2017). The relationship between therapist effects and *Wilson, G. T., Fairburn, C. C., Agras, W. S., Walsh, B. T., & Kraemer, H. (2002).
therapy delivery factors: Therapy modality, dosage, and non-completion. Cognitive-behavioral therapy for bulimia nervosa: Time course and mechanisms of
Administration and Policy in Mental Health and Mental Health Services Research, 44(5), change. Journal of Consulting and Clinical Psychology, 70(2), 267–274. https://doi.
705–715. https://doi.org/10.1007/s10488-016-0750-5. org/10.1037/0022-006X.70.2.267.
Shrout, P. E., & Bolger, N. (2002). Mediation in experimental and nonexperimental stu­ *Xu, H., & Tracey, T. J. G. (2015). Reciprocal influence model of working alliance and
dies: New procedures and recommendations. Psychological Methods, 7(4), 422–445. therapeutic outcome over individual therapy course. Journal of Counseling Psychology,
https://doi.org/10.1037/1082-989X.7.4.422. 62(3), 351–359. https://doi.org/10.1037/cou0000089.
Siev, J., Huppert, J. D., & Chambless, D. L. (2009). The Dodo Bird, treatment technique, *Yoo, S.-K., Hong, S., Sohn, N., & O’Brien, K. M. (2014). Working alliance as a mediator
and disseminating empirically supported treatments. The Behavior Therapist, 32(4), and moderator between expectations for counseling success and counseling outcome
71–76. among Korean clients. Asia Pacific Education Review, 15(2), 271–281. https://doi.org/
Smith, A. E. M., Msetfi, R. M., & Golding, L. (2010). Client self rated adult attachment 10.1007/s12564-014-9320-2.
patterns and the therapeutic alliance: A systematic review. Clinical Psychology Review, Zilcha-Mano, S. (2019). Major developments in methods addressing for whom psy­
30(3), 326–337. https://doi.org/10.1016/j.cpr.2009.12.007. chotherapy may work and why. Psychotherapy Research, 29(6), 693–708. https://doi.
*Spinhoven, P., Giesen-Bloo, J., van Dyck, R., Kooiman, K., & Arntz, A. (2007). The org/10.1080/10503307.2018.1429691.
therapeutic alliance in schema-focused therapy and transference-focused psy­ *Zilcha-Mano, S., Dinger, U., McCarthy, K. S., & Barber, J. P. (2014). Does alliance predict
chotherapy for borderline personality disorder. Journal of Consulting and Clinical symptoms throughout treatment, or is it the other way around? Journal of Consulting
Psychology, 75(1), 104–115. https://doi.org/10.1037/0022-006X.75.1.104. and Clinical Psychology, 82(6), 931–935. https://doi.org/10.1037/a0035141.
*Strunk, D. R., Cooper, A. A., Ryan, E. T., DeRubeis, R. J., & Hollon, S. D. (2012). The *Zilcha-Mano, S., & Errázuriz, P. (2017). Early development of mechanisms of change as a
process of change in cognitive therapy for depression when combined with anti­ predictor of subsequent change and treatment outcome: The case of working alliance.
depressant medication: Predictors of early intersession symptom gains. Journal of Journal of Consulting and Clinical Psychology, 85(5), 508–520. https://doi.org/10.
Consulting and Clinical Psychology, 80(5), 730–738. https://doi.org/10.1037/ 1037/ccp0000192 (Supplemental).
a0029281 (Supplemental). Zilcha-Mano, S., Eubanks, C. F., Bloch-Elkouby, S., & Muran, J. C. (2020). Can we agree
*Sullivan, J. M., Lawson, D. M., & Akay-Sullivan, S. (2020). Insecure attachment and we just had a rupture? Patient-therapist congruence on ruptures and its effects on
therapeutic bond as mediators of social, relational, and social distress and inter­ outcome in brief relational therapy versus cognitive-behavioral therapy. Journal of
personal problems in adult females with childhood sexual abuse history. Journal of Counseling Psychology, 67(3), https://doi.org/10.1037/cou0000400 315-325.
Child Sexual Abuse: Research, Treatment, & Program Innovations for Victims, Survivors, & (Supplemental).
Offenders, 29(6), 659–676. https://doi.org/10.1080/10538712.2020.1751368. *Zuroff, D. C., Blatt, S. J., Sotsky, S. M., Krupnick, J. L., Martin, D. J., Sanislow, C. A., 3rd,
Tracey, T. J., & Kokotovic, A. M. (1989). Factor structure of the Working Alliance & Simmens, S. (2000). Relation of therapeutic alliance and perfectionism to outcome
Inventory. Psychological Assessment: A Journal of Consulting and Clinical Psychology, in brief outpatient treatment of depression. Journal of Consulting and Clinical
1(3), 207–210. https://doi.org/10.1037/1040-3590.1.3.207. Psychology, 68(1), 114–124.
Tschacher, W., Junghan, U. M., & Pfammatter, M. (2014). Towards a taxonomy of
common factors in psychotherapy—Results of an expert survey. Clinical Psychology & Allison L. Baier, M.A., is a doctoral candidate at Case Western Reserve University. Her
Psychotherapy, 21(1), 82–96. https://doi.org/10.1002/cpp.1822. research interests include understanding mechanisms underlying treatment outcomes and
Wang, L., & Maxwell, S. E. (2015). On disaggregating between-person and within-person effectively increasing dissemination and implementation of evidence-based interventions
effects with longitudinal data using multilevel models. Psychological Methods, 20(1), for PTSD.
63–83. https://doi.org/10.1037/met0000030.
Wang, P. S., Lane, M., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005).
Twelve-month use of mental health services in the United States: Results from the Alexander C. Kline, Ph.D., is a graduate of Case Western Reserve University and current
Postdoctoral Fellow at UCSD/VA San Diego Healthcare System. His research focuses on
National Comorbidity Survey Replication. Archives of General Psychiatry, 62(6),
629–640. https://doi.org/10.1001/archpsyc.62.6.629. interventions for PTSD and related comorbidities, with emphasis on processes and pre­
*Webb, C. A., DeRubeis, R. J., Amsterdam, J. D., Shelton, R. C., Hollon, S. D., & Dimidjian, dictors linked to clinical outcomes.
S. (2011). Two aspects of the therapeutic alliance: Differential relations with de­
pressive symptom change. Journal of Consulting and Clinical Psychology, 79(3), Norah C. Feeny, Ph.D., is a Professor in the Department of Psychological Sciences at Case
279–283. https://doi.org/10.1037/a0023252. Western Reserve University. Her research interests include examining patient preferences,
Weck, F., Grikscheit, F., Jakob, M., Höfling, V., & Stangier, U. (2015). Treatment failure in evaluating interventions for PTSD, and understanding what predicts who will benefit
cognitive-behavioural therapy: Therapeutic alliance as a precondition for an adherent from these treatments.

14

You might also like