Professional Documents
Culture Documents
Further Validation of The Learning Alliance Inventory: The Roles of Working Alliance, Rapport, and Immediacy in Student Learning
Further Validation of The Learning Alliance Inventory: The Roles of Working Alliance, Rapport, and Immediacy in Student Learning
Teaching of Psychology
2015, Vol. 42(1) 19-25
Further Validation of the Learning Alliance ª The Author(s) 2014
Reprints and permission:
sagepub.com/journalsPermissions.nav
Inventory: The Roles of Working Alliance, DOI: 10.1177/0098628314562673
top.sagepub.com
Rapport, and Immediacy in Student Learning
Daniel T. Rogers1
Abstract
This study further examined the reliability and validity of the Learning Alliance Inventory (LAI), a self-report measure designed
to assess the working alliance between a student and a teacher. The LAI was found to have good internal consistency and test–
retest reliability, and it demonstrated the predicted convergence with measures of immediacy and rapport. The LAI enhanced
the prediction of student learning beyond that which was possible only using measures of immediacy and rapport. Path analysis
provided support for immediacy and rapport indirectly impacting student learning via their effects on the working alliance.
Potential uses of the LAI in both research and applied contexts are discussed.
Keywords
alliance, rapport, immediacy, student–teacher interaction
A working alliance occurs when two people engage in colla- Because teaching and learning inherently involve colla-
borative, purposive work where one individual seeks change borative relationships between a student seeking change
and another individual serves as an agent of that change (i.e., new knowledge and acquired skills) and a teacher who
(Bordin, 1979). Scholars and practitioners of psychotherapy facilitates such change, the working alliance concept has rele-
have given the concept much attention. Although theoretical vance. Scholars have explored these links in diverse teaching
applications of the concept to teaching and learning exist, contexts (e.g., Koch, 2004; Myers, 2008; Robertson, 2000;
empirical studies are lacking, perhaps due to there being no Rogers, 2009; Schlosser & Gelso, 2001; Tiberius, Sinai, &
reliable and valid measure of working alliance between Flak, 2002). Growing interest across disciplines in empiri-
students and teachers. In an effort to address this, Rogers cally studying teaching and learning processes has also
(2012) developed the Learning Alliance Inventory (LAI) and primed investigations of student–teacher interactions for their
provided evidence of its reliability, capacity to distinguish impact on learning. But studying the role of the working alli-
between teachers, and relation to students’ grades. However, ance in teaching and learning requires a sound measurement
further validation of the measure is necessary to ascertain its tool. Although multiple measures of the working alliance in
utility for educational research and applications. psychotherapy exist, their content is not easily translatable
to teaching and learning arenas. As a measure of working
alliance between student and teacher, the LAI has potential
Working Alliance to fill that void.
The working alliance concept emerged from psychotherapy
research and theory due to historical interests in the patient–
therapist dynamics and contemporary interests in relational LAI
features of this interaction. Its broad appeal across theoretical The LAI is an 18-item, self-report measure intended to assess
and intervention modalities stems from two causes. First, the the strength and characteristics of the working alliance between
working alliance concept provides a coherent, accessible student and teacher from the student’s perspective (Rogers,
model for understanding patient–therapist interactions and
patient change (Castonguay, Constantino, & Holforth,
1
2006). Second, the strength of the therapist and patient’s Department of Psychology, Kennesaw State University, Kennesaw, GA, USA
working alliance is consistently among the best predictors
Corresponding Author:
of treatment outcome (Horvath, Del Re, Flückiger, & Daniel T. Rogers, Department of Psychology, Kennesaw State University, 1000
Symonds, 2011; Horvath & Symonds, 1991; Martin, Garske, Chastain Road MD# 2202, Kennesaw, GA 30144, USA.
& Davis, 2000). Email: droger29@kennesaw.edu
2012). Of its three scales, the collaborative bond scale exam- Pugh (2010) argued that rapport is distinct in that it encom-
ines the quality of the student–teacher relationship (e.g., my passes the entirety of the positive relationship and is often
teacher genuinely cares about me). The teacher competency based on the reporter’s general impressions, whereas immedi-
scale assesses teacher behaviors relevant to effectively guid- acy is one of many techniques that contribute to rapport and is
ing a course (e.g., my teacher is knowledgeable about the typically linked to specific teacher behaviors.
course material). The student investment scale evaluates stu- Although limited, there is evidence indicating that in the
dent behaviors indicative of engagement with the course (e.g., context of student–teacher interactions, immediacy, rapport,
this course is worthwhile). In development, the three scale and working alliance are related. Wilson et al. (2010) found
and total scores demonstrated good internal and test–retest rapport to be positively correlated with immediacy and det-
reliabilities, and measured levels of working alliance were ermined that in comparison to immediacy alone, rapport
positively correlated with student grades and distinguished improved the prediction of students’ self-reported attitudes,
between teachers. However, the LAI requires further valida- motivation, and learning. Ryan, Wilson, and Pugh (2011) pro-
tion, particularly additional evidence about the connection vided evidence that rapport was also positively correlated
of working alliance to student learning. Scholars and teachers with working alliance as assessed by a subset of items adapted
considering using the measure could also benefit from a better from a measure of alliance in psychotherapy. Just as Wilson
understanding of how working alliance relates to similar con- et al. described rapport as a broader concept that immediacy
structs, such as the concepts of immediacy and rapport. contributes to, working alliance would appear to be the
broadest of the three, with immediacy and rapport being most
similar to the emotional and relational component of working
Immediacy and Rapport alliance typically referred to as bond.
Immediacy and rapport are prominent among dyadic constructs
investigated in student–teacher interactions. Immediacy is the Current Study
psychological availability or nearness of the teacher (Mehra-
bian, 1971). Teachers create immediacy through verbal and Given the increasing interest in the nature of dyadic variables
nonverbal behaviors that promote students feeling heard, in the classroom, and the recent introduction of the LAI as a
included, valued, and known (McCroskey & Richmond, measure of working alliance in educational contexts, further
1992). Given the difficulties in assessing verbal behavior, investigation of the relationships between immediacy, rap-
immediacy is largely conceptualized and measured through port, and working alliance is warranted. The value of further
student ratings of instructors’ nonverbal communication beha- study in this area depends heavily on the relation of these con-
viors (Richmond, McCroskey, & Johnson, 2003). Immediacy is structs to student learning. As such, in this study, I sought to
related to students’ increased compliance (Burroughs, 2007; further validate the LAI as a measure of the working alliance
Kearney, Plax, Smith, & Sorensen, 1988), decreased resistance in student–teacher interactions. I investigated its relation to
(Goodboy & Myers, 2009; Kearney, Plax, & Burroughs, 1991), the immediacy and rapport constructs and explored the rela-
and enhanced motivation (Allen, Witt, & Wheeles, 2006). tionship between the three constructs and student learning
However, evidence of a relationship between immediacy in an undergraduate course. Based on the reviewed literature,
and student learning is mixed (e.g., Hess & Smyth, 2001; I hypothesized the following:
Rodrı́guez, Plax, & Kearney, 1996).
1. The LAI will exhibit good internal and test–retest relia-
Rapport involves positive, synchronous interactions that
bility, comparable to existing measures of immediacy
reflect closeness or connectedness in a relationship. In their
and rapport.
overview of the literature, Murphy and Rodrı́guez-Manzanares
2. The LAI will be positively correlated with measures of
(2012) described rapport as a harmonious, coordinated interac-
immediacy and rapport.
tion based in mutual attention, respect, understanding, and open-
3. The LAI will enhance the prediction of student learning
ness. Measures of rapport tend to focus on specific relational
beyond that obtained through measures of immediacy
contexts of interest, including psychotherapy (Anderson &
and rapport.
Anderson, 1962), business (Gremler & Gwinner, 2008), room-
4. In addition to any direct effects on learning, immediacy,
mates (Carey, Hamilton, & Shanklin, 1986), and medical care
and rapport may have indirect effects where immediacy
(Harrigan & Rosenthal, 1983). Research on student–teacher
fosters elements of rapport and rapport fosters elements
interactions has yielded evidence that rapport is related to stu-
of working alliance.
dents’ enjoyment of and reported willingness to invest in a
course (Benson, Cohen, & Buskist, 2005). Similar findings link
rapport to student motivation (Granitz, Koernig, & Harich, 2009)
and self-reported learning (Frisby & Martin, 2010). Method
Previous research on teacher immediacy has at times made
reference to its relationship with rapport, and the evidence
Participants
suggests that both concepts are related to similar academic- Participants in the study were 280 undergraduate students (76%
supporting student behaviors. However, Wilson, Ryan, and female) enrolled in an introductory psychology course at a
large, comprehensive university. Participants’ ages ranged student, which reflects the proportion of the maximum poten-
from 18 to 66 years (M ¼ 21.32, SD ¼ 5.97). They described tial improvement obtained.
their racial or ethnic background as White or European Amer-
ican (74%), Black or African American (11%), Hispanic or Procedure
Latino or Latina (7%), Korean (1%), Asian Indian (1%), and
Other (6%), with the majority of those describing themselves I recruited introductory psychology students through an
as multiracial. Participants earned credit toward a course online research participation system. Interested students
research experience requirement, which included participation accessed information about the study and, following consent,
and alternative options. completed online versions of the LAI, NIS, and PSRS in
reference to their introductory psychology instructor. Partici-
pants also provided demographic information and responded
Materials to the single item about their learning. As part of consent, par-
Working alliance. In this study, I measured the working alliance ticipants agreed to the release of their numerical course grade
between students and instructors using the LAI (Rogers, and pre- and posttest scores. To ensure that participants felt
2012). The LAI is an 18-item, self-report instrument in which free to express perceptions of their current instructors, partici-
respondents use a 7-point scale (anchored by not at all and pants’ learned during consent that their responses would not
very much) to indicate the frequency with which an item be available to their instructors and would only be identified
occurs or the level at which it is endorsed. In addition to pro- via a coding system to ensure anonymity.
viding an overall measure of the degree of working alliance Given the nature of the self-report measures, participants
present, the LAI has three scales: collaborative bond, teacher needed to have sufficient experience with an instructor prior
competency, and student investment. The LAI has previously to providing their ratings. In addition, ratings provided near the
demonstrated good internal consistency for the total score end of a course could be influenced by students’ certainty of
(Cronbach’s a ¼ .95) as well as the collaborative bond (a ¼ their grade. To address this, I collected data from participants
.94), teacher competency (a ¼ .93), and student investment between the sixth and eighth weeks of their 16-week courses.
(a ¼ .93) scales (Rogers, 2012). Numerical course grades and pre- and posttests were estab-
lished components of the introductory psychology course. I
Nonverbal immediacy. I assessed instructors’ immediacy beha- retrieved these archival data after the end of the semester.
viors using the Nonverbal Immediacy Scale (NIS; Richmond To evaluate the test–retest reliabilities of the LAI, NIS, and
et al., 2003). The NIS is a 26-item, self-report instrument in PSRS, I recruited a subset (N ¼ 35) of the participants to com-
which respondents use a 5-point scale (anchored by never and plete these measures again between the 10th and 12th weeks of
very often) to indicate the frequency with which their instruc- their courses. Participants who completed the original study
tor uses nonverbal behaviors to convey a sense of immediacy received an e-mail notifying them that an extension of the study
(e.g., my instructor ‘‘looks directly at people while talking to was available if they were interested. Time between comple-
them’’). The NIS has previously demonstrated good internal tions ranged from 26 to 45 days (M ¼ 35.11, SD ¼ 4.33).
consistency (a ¼ .90; Richmond et al., 2003).
Table 1. Ranges, Means, and Standard Deviations of Learning and 2012), and the scales accounted for more variance than the
Student–Teacher Interaction Variables. composite score alone for all three measures of learning. I
Variable (possible range) M SD
selected the sequence for entering the variables based on the
order in which the self-report measures were developed as
Amount learned (1 to 5) 3.86 0.89 well as the order in the literature that the concepts of imm-
Course grade (0 to 100) 80.36 13.50 ediacy, rapport, and working alliance have been applied to
Normalized gain score (–1 to 1) 0.36 0.29 student–teacher interactions. This approach would help dis-
LAI–collaborative bond (1 to 7) 4.24 1.29
tinguish if the newer measures are capable of providing infor-
LAI–teacher competency (1 to 7) 6.32 0.74
LAI–student investment (1 to 7) 5.60 1.15 mation about student learning beyond that provided by
LAI–total (1 to 7) 5.39 0.87 existing measures of related constructs. For each of the three
PSRS (1 to 5) 3.47 0.31 measures of learning, the LAI significantly improved the
NIS (1 to 5) 3.91 0.45 prediction.
I conducted a path analysis to examine the possibility that in
Note. N ¼ 280. LAI ¼ Learning Alliance Inventory; PSRS ¼ Professor–Student
Rapport Scale; NIS ¼ Nonverbal Immediacy Scale. addition to direct effects on learning, immediacy, and rapport
may have indirect effects via alliance. The analysis consisted
of a series of regressions examining the assumed hierarchical
Table 2. Internal Consistency and Test–Retest Reliability of Student– relationships among the three measures. I based these assump-
Teacher Interaction Variables. tions on the notions that immediacy may help support the
Variable Cronbach’s aa Test–Retest rb
broader construct of rapport (Wilson et al., 2010), immediacy
and rapport may help support the broader construct of alliance,
LAI–collaborative bond .90 .71 and alliance may have direct effects on learning. The path dia-
LAI–teacher competency .81 .65 gram in Figure 1 illustrates these relationships for the three
LAI–student investment .92 .76 measures of learning. The analysis supported the assumption
LAI–total .92 .83
that alliance had direct effects on learning. For immediacy and
PSRS .80 .63
NIS .83 .88 rapport, direct effects occurred for participants’ self-reported
learning but not for course grade or normalized gain. The anal-
Note. LAI ¼ Learning Alliance Inventory; PSRS ¼ Professor–Student Rapport ysis also supported the assumption that immediacy and rapport
Scale; NIS ¼ Nonverbal Immediacy Scale. All rs are significant at p < .001.
a have indirect effects on learning, with immediacy impacting
N ¼ 280. bN ¼ 35.
rapport and rapport in turn impacting alliance.
Dependent Variables
Self-Reported Amount Learneda Course Gradeb Pre- versus Posttest Normalized Gainc
Note. NIS ¼ Nonverbal Immediacy Scale; PSRS ¼ Professor–Student Rapport Scale; LAI–B ¼ Learning Alliance Inventory (LAI) Collaborative Bond; LAI–TC ¼ LAI
Teacher Competency; LAI–SI ¼ LAI Student Investment. aF(5, 274) ¼ 39.30, p ¼ .000. bF(5, 269) ¼ 2.84, p ¼ .016. cF(5, 227) ¼ 2.00, p ¼ .080.
*p < .05. **p < .01. ***p < .001.
further support to the conceptualization of working alliance as meta-analysis to test a causal model. Communication Education,
the broadest concept of the three, encompassing not only rela- 55, 21–31. doi:10.1080/03634520500343368
tional (i.e., collaborative bond) but also teacher competency Anderson, R. P., & Anderson, G. V. (1962). Development of an
and student investment components. instrument for measuring rapport. Personnel & Guidance Jour-
These results should be considered in light of other poten- nal, 41, 18–24.
tial limitations to the study. As noted, levels of working Benson, T. A., Cohen, A. L., & Buskist, W. (2005). Rapport: Its
alliance, immediacy, and rapport are unlikely to be static. relation to student attitudes and behaviors toward teachers and
Although assessments of these concepts provide useful infor- classes. Teaching of Psychology, 32, 237–239. doi:10.1207/
mation about a student–teacher relationship, those measure- s15328023top3204_8
ments will be susceptible to influence from the student’s Bordin, E. S. (1979). The generalizability of the psychoanalytic con-
immediate experiences with the teacher. In addition, all parti- cept of the working alliance. Psychotherapy: Theory, Research and
cipants were enrolled in an introductory psychology course at Practice, 16, 252–260. doi:10.1037/h0085885
the same institution. It seems likely that the nature and roles of Burroughs, N. F. (2007). A reinvestigation of the relationship of
the working alliance, as well as that of immediacy and rap- teacher nonverbal immediacy and student compliance-resistance
port, will vary with course and institutional variables such with learning. Communication Education, 56, 453–475. doi:10.
as class size, difficulty level, instructional methods, and learn- 1080/03634520701530896
ing objectives. The generalizability of this study is limited Carey, J. C., Hamilton, D. L., & Shanklin, G. (1986). Development of
accordingly. an instrument to measure rapport between college roommates.
The LAI has potential as a measurement tool for investigat- Journal of College Student Personnel, 27, 269–273.
ing the nature of student–teacher interactions. One possible Castonguay, L. G., Constantino, M. J., & Holtforth, M. G. (2006). The
area for future research is examining how student or teacher working alliance: Where are we and where should we go? Psy-
characteristics that are known to impact teaching effectiveness chotherapy: Theory, Research, Practice, Training, 43, 271–279.
or student learning might affect the development of the work- doi:10.1037/0033-3204.43.3.271
ing alliance. Another logical step would be investigating the Frisby, B. N., & Martin, M. M. (2010). Instructor-student and student-
implications of how the working alliance forms and evolves. student rapport in the classroom. Communication Education, 59,
For example, in psychotherapy research, the development of 146–164.
the working alliance is increasingly viewed as complex and Goodboy, A. K., & Myers, S. A. (2009). The relationship between
nonlinear, with variations in the process having implications perceived instructor immediacy and student challenge behavior.
for patient outcomes (Kramer, de Roten, Beretta, Michel, & Journal of Instructional Psychology, 36, 108–112.
Despland, 2009). Patterns in working alliance development, Granitz, N. A., Koernig, S. K., & Harich, K. R. (2009). Now it’s per-
as well as the nature of the alliance at critical time periods, may sonal: Antecedents and outcomes of rapport between business
prove to be better predictors of student outcomes. Additional faculty and their students. Journal of Marketing Education, 31,
research will also help illustrate what applications the concept 52–65. doi:10.1177/0273475308326408
might hold for teachers seeking to improve the quality of their Gremler, D. D., & Gwinner, K. P. (2008). Rapport-building behaviors
interaction with students. Until then, the scales and items of the used by retail employees. Journal of Retailing, 84, 308–324. doi:
LAI provide some insight into the types of teacher behaviors 10.1016/j.jretai.2008.07.001
and student experiences that facilitate the development and Hake, R. R. (1998). Interactive-engagement versus traditional methods:
strengthening of a working alliance. In addition, the LAI pro- A six-thousand-student survey of mechanics test data for introduc-
vides both researchers and teachers with a tool for assessing tory physics courses. American Journal of Physics, 66, 64–74.
these processes in the classroom. doi:10.1119/1.18809
Harrigan, J. A., & Rosenthal, R. (1983). Physicians’ head and body posi-
Declaration of Conflicting Interests tions as determinants of perceived rapport. Journal of Applied Social
Psychology, 13, 496–509. doi:10.1111/j.1559-1816.1983.tb02332.x
The author declared no potential conflicts of interest with respect to
Hess, J. A., & Smythe, M. J. (2001). Is teacher immediacy actually
the research, authorship, and/or publication of this article.
related to student cognitive learning? Communication Studies,
52, 197–219.
Funding Horvath, A., Del Re, A. C., Flückiger, C., & Symonds, D. (2011).
The author disclosed receipt of the following financial support for the Alliance in individual psychotherapy. Psychotherapy, 48, 9–16.
research, authorship, and/or publication of this article: This research doi:10.1037/a0022186
was supported in part by an Incentive Funding Award for Scholarship Horvath, A. O., & Symonds, B. D. (1991). Relation between working
awarded by the Center for Excellence in Teaching and Learning at
alliance and outcome in psychotherapy: A meta-analysis. Journal
Kennesaw State University, GA.
of Counseling Psychology, 38, 139–149.
Kearney, P., Plax, T. G., Smith, V. R., & Sorensen, G. (1988). Effects
References of teacher immediacy and strategy type on college student resis-
Allen, M., Witt, P. L., & Wheeles, L. R. (2006). The role of teacher tance to on-task demands. Communication Education, 37, 54–67.
immediacy as a motivational factor in student learning: Using doi:10.1080/03634528809378703
Kearney, P., Plax, T. G., & Burroughs, N. F. (1991). An attributional Rodrı́guez, J. I., Plax, T. G., & Kearney, P. (1996). Clarifying the rela-
analysis of college students’ resistance decisions. Communication tionship between teacher nonverbal immediacy and student cogni-
Education, 40, 325–342. doi:10.1080/03634529109378858 tive learning: Affective learning as the central causal mediator.
Koch, L. (2004). The student-teaching working alliance in reha- Communication Education, 45, 293–305.
bilitation counselor education. Rehabilitation Education, 18, Rogers, D. T. (2009). The working alliance in teaching and learning:
235–242. Theoretical clarity and research implications. International Jour-
Kramer, U., de Roten, Y., Beretta, V., Michel, L., & Despland, J. nal for the Scholarship of Teaching and Learning, 3. Retrieved
(2009). Alliance patterns over the course of short-term dynamic from http://academics.georgiasouthern.edu/ijsotl/index.htm
psychotherapy: The shape of productive relationships. Psychother- Rogers, D. T. (2012). The Learning Alliance Inventory: Instrument
apy Research, 19, 699–706. doi:10.1080/10503300902956742 development and validation. International Journal for the Scholar-
Martin, D. J., Garske, J. P., & Davis, M. K. (2000). Relation of the ship of Teaching and Learning, 6. Retrieved from http://academics.
therapeutic alliance with outcome and other variables: A meta- georgiasouthern.edu/ijsotl/index.htm
analytic review. Journal of Consulting and Clinical Psychology, Ryan, R. G., Wilson, J. H., & Pugh, J. L. (2011). Psychometric char-
68, 438–450. doi:10.1037/0022-006X.68.3.438 acteristics of the Professor-Student Rapport Scale. Teaching of
McCroskey, J. C., & Richmond, V. P. (1992). Increasing teacher influ- Psychology, 38, 135–141. doi:10.1177/0098628311411894
ence through immediacy. In V. P. Richmond & J. C. McCroskey Schlosser, L. Z., & Gelso, C. J. (2001). Measuring the working alliance in
(Eds.), Power in the classroom: Communication, control, and con- advisor–advisee relationships in graduate school. Journal of Counsel-
cern (pp. 101–119). Hillside, NJ: Erlbaum. ing Psychology, 48, 157–167. doi:10.1037/0022-0167.48.2.157
Mehrabian, A. (1971). Silent messages. Belmont, CA: Wadsworth. Steiger, J. H. (1980). Tests for comparing elements of a correlation
Murphy, E., & Rodrı́guez-Manzanares, M. A. (2012). Rapport in dis- matrix. Psychological Bulletin, 87, 245–251. doi:10.1037/0033-
tance education. International Review of Research in Open and 2909.87.2.245
Distance Learning, 13, 167–190. Tiberius, R. G., Sinai, J., & Flak, E. A. (2002). The role of teacher-
Myers, S. A. (2008). Working alliances in college classrooms. Teach- learner relationships in medical education. In G. R. Norman, C.
ing of Psychology, 35, 29–32. doi:10.1080/00986280701818490 P. M. Van der Vleuten, & D. I. Newble (Eds.), International hand-
Richmond, V. P., McCroskey, J. C., & Johnson, A. D. (2003). Devel- book of research in medical education (pp. 463–497). Dordrecht,
opment of the Nonverbal Immediacy Scale (NIS): Measures of the Netherlands: Kluwer. doi:10.1007/978-94-010-0462-6_19
self- and other-perceived nonverbal immediacy. Communication Wilson, J. H., & Ryan, R. G. (2013). Professor–Student Rapport Scale:
Quarterly, 51, 504–517. Six items predict student outcomes. Teaching of Psychology, 40,
Robertson, D. L. (2000). Enriching the scholarship of teaching: 130–133. doi:10.1177/0098628312475033
Determining appropriate cross-professional applications among Wilson, J. H., Ryan, R. G., & Pugh, J. L. (2010). Professor-Student
teaching, counseling, and psychotherapy. Innovative Higher Edu- Rapport Scale predicts student outcomes. Teaching of Psychology,
cation, 25, 111–125. 37, 246–251. doi:10.1080/00986283.2010.510976