Professional Documents
Culture Documents
Advancing Research On LGBTQ Microaggressions A Psychometric Scoping Review of Measures Fisher2018
Advancing Research On LGBTQ Microaggressions A Psychometric Scoping Review of Measures Fisher2018
To cite this article: Colleen M. Fisher, Michael R. Woodford, Rachel E. Gartner, Paul R. Sterzing
& Bryan G. Victor (2018): Advancing Research on LGBTQ Microaggressions: A Psychometric
Scoping Review of Measures, Journal of Homosexuality, DOI: 10.1080/00918369.2018.1539581
Article views: 2
ABSTRACT KEYWORDS
Understanding the nature and consequences of LGBTQ microag- Microaggressions;
gressions is critical to fostering equity and wellbeing among discrimination; LGBTQ;
sexual and gender minorities. Yet little guidance is available for sexual orientation; gender
identity; measurement;
researchers seeking psychometrically robust measures of subtle
reliability and validity;
LGBTQ slights, invalidations, and insults. To address this gap, we review
conducted a scoping review of multi-item quantitative measures
that included at least one question addressing LGBTQ microag-
gressions. This article reports the study characteristics and psy-
chometric properties of 27 original measures we identified and
their subsequent adaptations. The article concludes with an
assessment of strengths and limitations of LGBTQ microaggres-
sion measurement, highlighting aspects of measurement innova-
tion on which future researchers can build. As microaggressions
remain a powerful and underexplored mechanism of sexual and
gender minority oppression, this review will help to both advance
methodological quality in this critical research area and enhance
our understanding of how microaggressions manifest in the lives
of LGBTQ individuals.
CONTACT Colleen M. Fisher cfisher@umn.edu School of Social Work, University of Minnesota, 269 Peters
Hall, 1404 Gortner Avenue, St. Paul, MN 55108, USA.
© 2018 Taylor & Francis Group, LLC
2 C. M. FISHER ET AL.
Methods
Scoping reviews have become increasingly popular as a means of knowledge
synthesis, which allow researchers to explore concepts, evidence, and poten-
tial gaps in the literature in a particular field (Colquhoun et al., 2014). The
approach for the current scoping review was informed by Arksey and
O’Malley’s (2005) five-stage methodology, which lays out a systematic pro-
cess for searching the academic and gray literature, synthesizing findings, and
increasing the replicability of the study. The five stages are (1) identifying the
research questions, (2) identifying relevant studies, (3) study selection, (4)
JOURNAL OF HOMOSEXUALITY 5
charting the data, and (5) collating, summarizing and reporting the results
(Arksey & O’Malley, 2005). In terms of the distribution of work, the last
author identified the relevant studies, while the first four authors and a
trained research assistant worked to select eligible studies, to chart the data,
and to collate, summarize, and report the results. Discrepancies in coding
were resolved through dialogue and consensus among the entire study team
during regular meetings.
Document identification
Following the specific aims of our study, to better understand the psycho-
metric properties of measures that fully or partially measure LGBTQ micro-
aggressions, we first identified relevant documents (Arksey & O’Malley,
2005). The research team in consultation with a social science librarian
identified the terms and search strategy. The search had three categories of
terms: (1) population (i.e., sexual and/or gender minorities), (2) discrimina-
tion (which included search terms such as “heterosexism,” “homonegativ*,”
and “transphobi*”), and (3) subtle/covert (e.g., terms such as “microaggress*”
or “incivility” or “covert”). We used combinations of terms from each of the
three categories to search prominent databases (an appendix containing all
search terms and specifications is available from the authors). Databases that
index a high rate of social science and health-related journal articles, dis-
sertations, and reports were selected (e.g., PsycINFO, Social Services
Abstracts, ProQuest Dissertations); these databases were searched using two
database aggregators: ProQuest and EbscoHost. In addition, PubMed was
searched independently using the same search specifications. The search was
undertaken on November 16, 2016.
When searching in ProQuest, we used the advanced search interface that
allowed us to identify documents that contained our terms anywhere in the
document text, including title, abstract, references, and keywords, and to
select the following source types given our intent to include both academic
and gray literature: books, dissertations and theses, other sources, reports,
scholarly journals, trade journals, and working papers. Filters were not set for
EbscoHost and PubMed searches. Searches were exported from the database
aggregators as generic text files and document metadata (i.e., title, abstract,
journal, year of publication). BibWrangleR software package for R (Victor,
Perron, & Yochum, 2015) was used to convert files into an analyzable data
frame for review. These initial searches produced 562 unique documents.
During the screening process, Morrison and colleagues’ (2016) psycho-
metric review of sexual orientation discrimination measures was identified.
That study searched the academic literature to identify general measures of
LGB discrimination (i.e., not limited to blatant or subtle forms of discrimi-
nation). Because of its relevance to our own scoping review, we manually
6 C. M. FISHER ET AL.
reviewed the study’s reference list to identify any documents that met our
inclusion criteria but were not identified in our original search (n = 9; for
example, a scale that included an microaggression item among a majority of
blatant discrimination items). Further, during the review process we recog-
nized instances in which we did not have the documents presenting original
scales although we had captured studies in our search that reused or adapted
an original scale (e.g., an original measure published in a dissertation may
have been less discoverable than its more recent adaptation published in a
journal article). In these cases, we identified the documents that contained
the original publication of the scales and, if they met our inclusion criteria,
included them in our scoping review (n = 3).
criteria. For dissertations that were later published as articles, we used the
dissertation version for our study.
We used a two-stage process to screen each document for inclusion: (1)
title and abstract review, and (2) full text review. Each document was
randomly assigned to two members of the research team to review at both
stages. If both of the assigned reviewers agreed, then the document was
included or excluded accordingly. Discrepancies in reviewer decisions were
resolved through consensus among the entire research team. These screening
stages resulted in 126 publications for measurement extraction. To be as
inclusive as possible, when the same measure was used in two or more
publications from the same dataset, we included each publication in our
review. An appendix containing the consort diagram that details each step of
the search and screening process is available from the authors.
Results
Overview of original measures
As detailed in Table 1, our review resulted in the identification of 27 original
measures, with 16 of these measures assessing microaggressions and/or subtle
forms of discrimination exclusively and 11 global measures assessing both
blatant and subtle forms of discrimination. The first measure in our review
was published by Waldo in 1997, but the majority of measures (n = 20)
emerged over the last 8 years (i.e., since 2010). The number of items per
measure ranged from 2 to 135 (x = 24.0, SD = 27.7). Thirteen measures were
multidimensional, with the number of subscales ranging from 2 to 13 (x
= 4.5, SD = 3.4), although not all subscales tapped into microaggressions.
Overall, the measures assessed the following eight microaggression-related
dimensions: (1) direct versus indirect (i.e., witnessed) interpersonal discrimi-
nation; (2) environmental (e.g., public policies) discrimination; (3) different
timeframes (e.g., experiences in past 6 months vs. lifetime); (4) affective
impact; (5) multiple or intersecting marginalized identities; (6) different
contexts (e.g., education, workplace); (7) different types of perpetrators
(e.g., family, heterosexual friends, LGBTQ community); and (8) thematic
content (e.g., assumption of sexual pathology, exoticization).
Table 1. (Continued).
Total
Instrument Name # Target Statusa
(original author) Items Subscales [# items] DiscriminationFormb Sample Characteristicsc Reliabilityd Validitye
LGBQ Microaggressions on Campus 20 (1) Interpersonal [15], SO S1 (n = 14); Age: x= 22 (SD 4); 24% Total: α = n.r. FACE,
Scale [LGBQ-MCS] (2) Environmental [5] Micro POC; (1) α = .94, CONT,
(Woodford et al., 2015a) 100% SM; 14% GIM; 36% F/W (2) α = .81 CONS,
S2 (n = 281); Age: x= 24 (SD n.r.); FACT
24% POC; 100% SM; 0% GIM; 58%
C. M. FISHER ET AL.
W
S3 (n = 580); Age: x= 23 (SD 6);
29% POC; 100% SM; 3% GIM; 54%
W
LGBT People of Color 18 (1) POC Heterosexism [6], SO, GE/GI S1 (n = 53); Age: x= 36 (SD 10); Total: α = .92 CONS,
Microaggressions Scale (2) LGBT Racism [6], Micro 100% POC; 100% SM/GIM; (1) α = .81, CRIT
[LGBT-PCMS] (Balsam et al., 2011) (3) LGBT Relationship Racism [6] S2 (n = 266); Age: x= 32 (SD 10); (2) α = .89,
100% POC; 100% SM; 9% GIM; 55% (3) α = .83
F
S3 (n = 297); Age: x= 33 (SD 10);
87% POC; 100% SM; 11% GIM; 50%
W
Experiences of Homophobic 11 n/a SO (n = 912) α = .75 n.r.
Discrimination [EHD] Global Age: x= 31 (SD n.r.);
(construct measured) 100% POC; 100% SM; 0% F
Díaz et al., 2001)
Gay and Lesbian 49 (1) Couples Issues [4], SO S1 (n = 32); Age: x= 35 (SD n.r); Total: α = n.r. CONT,
Oppressive Situation Inventory- (2) Dangers to Safety [5], Global 25% POC; 100% SM; 41% W (1) α = .63, CONS,
Frequency [GALOSI-F] (3) Exclusion, Rejection, & S2 (n = 607); Age: x= 32 (SD 14); (2) α = .77, CRIT,
(Highlen et al., 2000) Separation [9], (4) Internalized 19% POC; 100% SM; 39% W (3) α = .87, FACT
Homonegativity [10], S3 (n = 293); Age: x= 33 (SD 14); (4) α = .88,
(5) Restricted Opportunities & 27% POC; 100% SM; 41% W (5) α = .69,
Rights [3], (6) Stigmatizing & (6) α = .85,
Stereotyping [11], (7) Verbal (7) α = .77
Harassment & Intimidation [7]
(Continued )
Table 1. (Continued).
Total
Instrument Name # Target Statusa
(original author) Items Subscales [# items] DiscriminationFormb Sample Characteristicsc Reliabilityd Validitye
Anti-Bisexual Experiences Scale [ABES; 17 (1) Sexual Orientation Instability [8] SO S1 (n = 699); Age: x= 32 (SD 11); S1: LG: α = .94 CONT,
ABES-LG; ABES-H] (2) Sexual Irresponsibility [4] Micro 21% POC; 100% SM; 2% GIM; 59% S2: LG: α = .95 CONS,
(Brewster & Moradi, 2010) (3) Interpersonal Hostility [5] W Test-Retest FACT
S2 (n = 176); Age: x= 34 (SD 14); r = .77-.89
20% POC; 100% SM; 11% GIM; 60%
W
Victimization Catalog 76 (1) Hostile Treatment [24] SO (n = 1039) n/a n.r.
(Bachmann & Simon, 2014) (2) Discrimination Incidents [52] Global Age: x= 38 (SD 11); (index/count)
100% SM; 0% W
Sexual Orientation Stigma 8 n/a SO (n = 200) α = .93 n.r.
(construct measured) (Bruce, Stall, Global Age: x= 21 (SD 2)
Fata, & Campbell, 2014) 75% POC; 100% SM; 0% F
Perceived Homophobia among 11 (1) General Community [4] SO (n = 1196) (1) n/a, count CONT
General Community, Heterosexual (2) Heterosexual Friends [3] Global Age: x= 36 (SD n.r.); (2) α = .87,
Friends & Family [PHGGHFF] (3) Family [4]i 100% POC; 100% SM; 0% W (3) α = .82
(constructs measured)
(Choi et al., 2013)
Schedule of 18 n/a SO (n = 449) α = .93 n.r.
Homophobic Events (Fingerhut, Global Age: x= 33 (SD 12);
Peplau, & Gable, 2010)j 15% POC; 100% SM; 44% W
Homophobic Discourse (construct 2 n/a SO (n = 5766) n.r. n.r.
measured) (Peter, Taylor, & Micro Age: x= 17 (SD n.r.);
Chamberland, 2015) 28% POC; 28% SM; 40% F
Two-Spirit 32 n/a SO, GE/GI (n = 221) α = .96 n.r.
Microaggression Scale (Town, 2014) Micro Age: x= 39 (SD n.r.);
100% POC; 100% SM; 0% F
Sexual Orientation Microaggressions 9 n/a SO (n = 76) α = .84 n.r.
in Psychotherapy Scale Micro Age: x= 37 (SD n.r.);
(MacDonald, 2013)k 21% POC; 100% SM; 7% GIM; 69% F
JOURNAL OF HOMOSEXUALITY
(Continued )
12
Table 1. (Continued).
Total
Instrument Name # Target Statusa
(original author) Items Subscales [# items] DiscriminationFormb Sample Characteristicsc Reliabilityd Validitye
LGBT Minority Stress Measure 25 (1) Identity Concealment [4] SO, GE/GI (n = 640); Age: x= n.r.; Total α = .87 CONS,
[LGBT-MSM] (Outland, 2016) (2) Everyday Discrimination/ Global 18% POC; 100% SM; 20% GIM; 36% (1) α = .81, CRIT,
Microaggressions [4] F (2) α = .73, FACT
(3) Rejection Anticipation [4] (3) α = .84,
C. M. FISHER ET AL.
o
Modified version of Meyer, Schwartz, and Frost (2008) “Experiences of Everyday Discrimination” measure, which adapted a measure by Williams et al. (1997) to include sexual
orientation.
13
14 C. M. FISHER ET AL.
minorities only (21 publications) were the primary target population, fol-
lowed by combined sexual and gender minorities (four publications) and
gender minorities only (two publications). Approximately 70% (15 out of 21)
of the sexual minority-only publications failed to report if they included or
excluded gender minority participants. Twelve publications provided sample
percentages on gender minorities: 0% (three publications), 3% to 20% (seven
publications), and 100% (two publications). Seventeen publications used
mixed sex/gender samples—females/women accounting for 21% to 69% of
the overall sample—with 10 publications using single sex/gender samples:
sexual minority females/women (three publications), sexual minority males/
men (six publications), and heterosexual and sexual minority males/men
(one publication). Lastly, the majority of publications included samples
with less than 30% participants of color: 7% to 15% (five publications),
16% to 30% (10 publications), 31% to 75% (five publications), and 86% to
100% non-White individuals (seven publications).
Table 2. Summary of validity testing for the 27 original measures (by publication year).
Measure Subscales FACE CONT CRIT CONS FACT EFA CFA EFA + CFA
WHEQ (Waldo, 1999) 2 X X
GALOSI-F (Highlen et al., 2000) 7 X X X X X
HHRDS (Szymanski, 2006) 3 X X X X
ABES (Brewster & Moradi, 2010) 3 X X X X X X
LGBT-PCMS (Balsam et al., 2011) 3 X X
HMS (Wright &Wegner, 2012) 3 X X X
DHEQ (Balsam et al., 2013) 9 X X X X
PHGCHFF (Choi et al., 2013) 3 X
EM (Woodford et al., 2015c) 2 X X
LGBQ-MCS (Woodford et al., 2015a) 2 X X X X X X X
AB (Hong et al., 2016) 1 X X
LGBT-MSM (Outland, 2016) 7 X X X X
SOMI (Swann et al., 2016) 1 X X
Total - 1 5 6 8 9 7 5 3
response optiona
(Continued )
17
Table 3. (Continued).
18
response option;a Velez, Breslow, Brewster, Cox, and 304 Age: x= 25 (7); 27% POC; α = .89 n.r.
Added/removed items Foster (2016)a,e 90% SM; 100% GIM; 0% F
(1 removed, 1 added)e
Reference group & Friedman (2008)f 83 Age: x= 19 (2) α = .87 FACT
question wording 40% POC; 100% SM; 100% F
inclusive of LGB or Szymanski and Gupta (2009) 178 Age: x= 29 (8) α = .95 n.r.
LGBQ individuals (men 100% POC; 100% SM; 48% F
& women samples)— St. Pierre and Senn (2010) 280 Age: x= n.r. α = .92 n.r.
all studies; 9% POC; 100% SM; 64% F
Removed “more than 70% Szymanski and Sung (2010) 144 Age: x= 31 (9); 100% POC; α = .91 n.r.
of the time” from last 100% SM; 4% GIM; 57% F
response option;a Lehavot and Simoni (2011)a 1381 Age: x= 34 (12) α = .90 n.r.
Changed reference 26% POC; 100% SM; 100% F
period (lifetime);b Corpus (2012)b 167 Age: x= n.r. α = .92 n.r.
Used selected subscales 100% POC; 100% SM; 100% F
(Harassment & Feinstein, Goldfried, and Davila 467 Age: x= 31 (12) α = .93 n.r.
Rejection);c,a (Workplace (2012) 24% POC; 100% SM; 47% F
& School Discrimination; Fritz (2012)c,a 188 Age: x= n.r.; 37–42% POC; α = .82 n.r.
Other Discrimination);c,b 77% SM; 2–10% GIM; 0–90% Fd
Modified response set Bandermann and Szymanski (2014) 423 Age: x= 33 (15); 18% POC; α = .90 n.r.
(0 = Never in past year to 100% SM; 6% GIM; 52% F
6 = Almost every week);f Cogger (2014)a 371 Age: x= 30 (10); 22% POC; α = .92 n.r.
100% SM; 8% GIM; 93% F
Denton, Rostosky, and Danner 564 Age: x= 35 (13) α = .92 n.r.
(2014)a 16% POC; 100% SM; 48% F
Feinstein, Wadsworth, Davila, and 414 Age: x= 31 (12) α = .94 n.r.
Goldfried (2014) 21% POC; 100% SM; 48% F
(Continued )
Table 3. (Continued).
Instrument Modifications Study N Sample Demographicsa Reliabilityb Validityc
cb
Mereish (2014) 155
Age: x= 41 (16) α = .95 n.r.
31% POC; 100% SM; 100% F
Brewster, Velez, Foster, Esposito, 143 Age: x= 39 (15); 29% POC; α = .90 n.r.
and Robinson (2016)a 100% SM; 15% GIM; 36% F
Detwiler (2015) 189 Age: x= 60 (8); 10% POC; α = .88 n.r.
100% SM; 41% GIM; 62% F
Figueroa and Zoccola (2015)b 277 Age: x= n.r. α = .89 n.r.
22% POC; 100% SM; 47% F
Liao, Kashubeck-West, Weng, and 265 Age: x= 34 (13); 21% POC; α = .78-.86 n.r.
Deitz (2015) 100% SM; 6% GIM; 56% F (for 3 subscales)
Mason and Lewis (2015)a,b 164 Age: x= n.r. α = .76-.81 n.r.
38% POC; 100% SM; 100% F (for 3 subscales)
Mereish and Poteat (2015) 719 Age: x= 42 (15); 38% POC; α = .95 n.r.
100% SM; 3% GIM; 55% F
Sandil, Robinson, Brewster, Wong, 142 Age: x= 32 (8); 100% POC; α = .89 n.r.
and Geiger (2015)a 100% SM; 3% GIM; 30% F
Velez, Breslow, Brewster, Cox, and 173 Age: x= 31 (11); 100% POC; α = .90 n.r.
Foster (2016)a 100% SM; 7% GIM; 43% F
Szymanski and Mikorski (2016) 361 Age: x= 28 (13); 25% POC; α = .89 n.r.
100% SM; 11% GIM; 59% F
Wright (2016) 232 Age: x= 31 (14); 25% POC; α = .88 n.r.
100% SM; 8% GIM; 34% F
Notes:
a
Race/Ethnicity: POC = People of Color (non-White); Sexual Orientation: SM = Sexual Minority (non-heterosexual); Gender Identity: GIM = Gender Identity Minority (non-cisgender);
Sex/Gender: F = Female/W = Women-identified (per terminology used in each article); For studies with 100% GIM samples, we report % with TransWomen (TransW) and other
Gender Nonconforming (GNC) identities.
b
All alphas reported are Internal Consistency Reliability and represent total scale scores unless otherwise indicated.
JOURNAL OF HOMOSEXUALITY
c
FACE = Face Validity, CONT = Content Validity, CONS = Construct Validity (includes: discriminant, convergent, known-group), CRIT = Criterion-Related Validity (includes: concurrent,
predictive, incremental), FACT = Factor Structure (includes: EFA and CFA testing).
d
Demographic characteristics (race, gender identity, sex) were presented by sexual orientation sub-group rather than for overall sample.
19
20
Table 4. Published modifications to other sexual orientation and gender identity microaggression measures.
Instrument Modifications Study N Sample Demographicsa Reliabilityb Validityc
Workplace Heterosexist Experiences Questionnaire [WHEQ]
(Waldo, 1999) Modified in 10 publications
Changed reference period from 24 to 12 months Smith and Ingram 97 Age: x= 34.7 (10); 18% POC; 100% SM; 41% α = .92 n.r.
(2004) F
Carter II, Mollen, 165 Age: x= 37.9 (SD 12.2); 24.2% POC; 100% α = .93 n.r.
and Smith (2014) SM; 39.4% F
Reed and Leuty 135 Age: x= 32.8 (SD 10.9); 29.6% POC; 100% α = .89 n.r.
C. M. FISHER ET AL.
Table 4. (Continued).
Instrument Modifications Study N Sample Demographicsa Reliabilityb Validityc
Used one subscale [Family Rejection]; 6-point response set Zimmerman, 843 Age: x= 21.4 (SD 2.1) 45.8% POC; 100% SM; Time 1 α = .81 Time 2 n.r.
[never to almost everyday]; eliminated reference period Darnell, Rhew, Lee, 100% W α = .82
and Kaysen (2015)
Used 6 trans*-related subscales identity [gender expression, Lehavot, Simpson, 212 Age: x= 49.3 (SD 14.9) 10.4% POC; 100% α = .93 n.r.
vigilance, discrimination/harassment, vicarious trauma, family and Shipherd GIM; 88.7% TransW4
C. M. FISHER ET AL.
Discussion
This psychometric scoping review identified 27 original measures. Of these
measures, 16 exclusively measured LGBTQ microaggressions, while the
others were global measures containing items addressing both microaggres-
sive and blatant discrimination. Our findings suggest that while a consider-
able number of measures are now available to researchers interested in the
quantitative assessment of LGBTQ microaggressions, the extent to which the
psychometric properties of these measures have been tested is highly variable.
Thus while researchers may increasingly recognize the importance of asses-
sing these subtle minority stressors, either specifically or as part of broader
discrimination constructs, the rigor with which they are measured may call
resultant claims about their prevalence and impact into question. Lilienfeld
(2017) recently raised this measure validity issue when expressing concern
about the state of microaggression research, calling on researchers to ensure
that measures are psychometrically robust and that claims about microag-
gressions’ effects are thoroughly tested. While the vast majority of researchers
with articles included in this sample reported the internal consistency of their
original scales, fewer than half of the measures in the current review reported
any type of validity testing.
Reliability
Assessing internal consistency is a critical component of measurement devel-
opment as this provides evidence of the homogeneity of items meant to
reflect the intended latent construct (DeVellis, 2012). The original microag-
gression-specific measures we identified, with few exceptions (i.e., Woodford
et al., 2015a), reported internal consistency reliability that exceeded the
commonly accepted alpha level of .70. This was also the case for the global
measures and/or their subscales (exception: Highlen et al., 2000).
Among our sample, only one study tested another type of reliability: test-
retest (Brewster & Moradi, 2010). Test-retest reliability is challenging to
assess for several reasons, such as contaminated responses at the retest
because participants previously completed the measures and the timing of
the retest (DeVellis, 2012). Brewster and Moradi (2010) conducted their
retest two weeks after the initial test and found evidence supporting the
test-retest reliability of their measure. Test-retest reliability may be particu-
larly difficult to assess for LGBTQ microaggressions and global
24 C. M. FISHER ET AL.
Validity
Consistent with Morrison et al.’s (2016) review of global LGB discrimination
measures, our study reported a substantial lack of validity testing for mea-
sures of LGBTQ microaggressions. Without adequate validity testing, the
extent to which a named microaggression measure actually assesses micro-
aggressive experiences remains unknown (Singleton & Straits, 2017), and
researchers risk misclassifying experiences or failing to capture the breadth
of the experience under investigation.
Although the importance of face validity has been questioned by some
scholars (DeVellis, 2012), ensuring that a measure at least seems to assess the
intended phenomenon is a valuable initial step, as is the process of assessing
content validity by engaging experts and potential respondents. Both of these
were notably absent for the overwhelming majority of measures reviewed in
this study, however. With respect to the studies that examined criterion-
related validity, predictive validity was the only form examined. No study
examined incremental validity, which is a form of validity that Lilienfeld
(2017) emphasized as being necessary to substantiate claims about the effects
of microaggressions. Simply put, incremental validity involves testing “the
extent to which [the new measure] contributes meaningful information
above and beyond extant measures (Lilienfeld, 2017, p. 157, citing Meehl,
1959; Sechrest, 1963). Testing this form of validity for microaggression
measures is particularly important given theoretical claims about their
unique effects. Future research is needed to integrate incremental validity
testing into their psychometric testing of LGBTQ microaggressions measures.
The lack of thorough testing leaves the field of microaggressions research
open to the critique that the construct is under-conceptualized, lacking in the
measurement rigor to advance this area of inquiry (Lilienfeld, 2017).
Another notable finding from this scoping review was the virtual absence
of validity testing among the adapted versions of the original measures.
JOURNAL OF HOMOSEXUALITY 25
Issues with validity stemming from the original measures, as described above,
are compounded when these scales are adapted in subsequent studies without
undergoing psychometric testing. Even in cases where the validity of an
original scale was established, subsequent modifications (e.g., revising ques-
tion wording or response option) can alter question meaning and interpreta-
tion and thus nullify the psychometric testing performed on the original
measure. Although the considerable modifications to original measures
observed in this review suggests that researchers are readily adapting avail-
able measures to meet study, population, and contextual needs—presumably
a sign of a dynamic and growing field of research—the consequence of this
approach is that the overwhelming majority of current quantitative research
on LGBTQ microaggressions has been carried out using unvalidated
measures.
Adaptations
In addition to concerns about the lack of robust psychometric testing for
adapted measures, we noted that the term adapted itself ranged in meaning
from a small number of modifications (e.g., changes to reference period only)
to numerous changes (e.g., changing stem, item wording, response set,
reference period, and adding new items). This wide spectrum of adaptation
raises the question of what constitutes a measure that has been modified but
retains sufficient characteristics to reflect the original instrument and what
indicates modifications substantive enough that the measure should be
understood as an entirely new scale—and thus require full psychometric
testing. The second challenge in this area was that many adaptations were
not clearly described in the literature. We sought adapted measures when
possible and used all available details in each publication but noted the
persistent challenge that many adapted measures were simply not thoroughly
explained.
Limitations
This review has several limitations. First, measures published after November
16, 2016, were not included, nor were measures that lacked sufficient details
about the items in the identified document or in cases when the original scale
was not available (including from authors, when contacted). Thus the review
is not necessarily exhaustive of all existing measures. Second, because of the
constantly evolving language used to describe sexual and gender minorities
and related systems of oppression, our search terms may have failed to
capture all articles in this area leading to the unintentional exclusion of
some measures. Hence, selection bias may have impacted review findings.
Third, we relied on the information reported by authors, including details
26 C. M. FISHER ET AL.
Conclusion
Microaggressions derive much of their power as a minority stressor from
their chronicity and ambiguity (Sue, 2010; Woodford et al., 2014b). These
factors often incite vigilance, distrust, and stress among LGBTQ individuals
across contexts such as the workplace, college campuses, the home, or when
seeking mental or physical health care (Sue, 2010; Woodford et al., 2014b,
2015b). The ubiquitous nature of microaggressions may also make them
particularly challenging to evaluate with cross-sectional research designs;
however, with emerging studies speaking to their negative association with
self-esteem and sexual minority identity development (Wright & Wegner,
2012) and positive association with anxiety, depressive symptoms, and sui-
cidality (Ratliff, Sterzing, & Gartner, Under Review; Woodford et al., 2014b),
it is crucial that researchers and clinicians address the pressing issue of
microaggressions measurement (Lilienfeld, 2017). The growing field of
LGBTQ microaggressions research has made significant strides, presenting
important opportunities to advance our understanding of these everyday
discriminatory experiences.
The current psychometric scoping review synthesized the depth, breadth,
and rigor of measurement tools available to LGBTQ microaggression
researchers. This review identified important gaps in measurement of
LGBTQ microaggressions broadly but also raises issues regarding the applic-
ability of measures for specific LGBTQ subpopulations. Some groups (e.g.,
JOURNAL OF HOMOSEXUALITY 27
Disclosure statement
No potential conflict of interest was reported by the authors.
References
Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework.
International Journal of Social Research Methodology, 8, 19–32. doi:10.1080/
1364557032000119616
Bachmann, A. S., & Simon, B. (2014). Society matters: The mediational role of social
recognition in the relationship between victimization and life satisfaction among gay
men. European Journal of Social Psychology, 44(3), 195–201. doi:10.1002/ejsp.2007
Balsam, K. F., Beadnell, B., & Molina, Y. (2013). The Daily Heterosexist Experiences
Questionnaire: Measuring minority stress among lesbian, gay, bisexual, and transgender
28 C. M. FISHER ET AL.
DeBlaere, C., Brewster, M. E., Bertsch, K. N., DeCarlo, A. L., Kegel, K. A., & Presseau, C. D.
(2014). The protective power of collective action for sexual minority women of color: An
investigation of multiple discrimination experiences and psychological distress. Psychology
of Women Quarterly, 38(1), 20–32. doi:10.1177/0361684313493252
Denton, F. N., Rostosky, S. S., & Danner, F. (2014). Stigma-related stressors, coping self-
efficacy, and physical health in lesbian, gay, and bisexual individuals. Journal of Counseling
Psychology, 61(3), 383. doi:10.1037/a0036707
Detwiler, B. P. (2015). Minority stress in the sexual minority older adult population: exploring
the relationships among discrimination, mental health, and quality of life. (Theses and
Dissertations, Lehigh University). Retrieved from: http://preserve.lehigh.edu/etd/2571
DeVellis, R. F. (2012). Scale development: Theory and applications (3rd ed.). Thousand Oaks,
CA: Sage.
Diaz, R. M., Ayala, G., Bein, E., Henne, J., & Marin, B. V. (2001). The impact of homophobia,
poverty, and racism on the mental health of gay and bisexual Latino men: Findings from 3
US cities. American Journal of Public Health, 91(6), 927–932.
Drazdowski, T. K., Perrin, P. B., Trujillo, M., Sutter, M., Benotsch, E. G., & Snipes, D. J.
(2016). Structural equation modeling of the effects of racism,LGBTQ discrimination, and
internalized oppression on illicit drug use in LGBTQ people of color. Drug & Alcohol
Dependence, 159, 255–262. doi:10.1016/j.drugalcdep.2015.12.029
Durso, L. E., & Meyer, I. H. (2013). Patterns and predictors of disclosure of sexual orientation
to healthcare providers among lesbians, gay men, and bisexuals. Sexuality Research and
Social Policy, 10(1), 35–42. doi:10.1007/s13178-012-0105-2
Feinstein, B. A., Goldfried, M. R., & Davila, J. (2012). The relationship between experiences of
discrimination and mental health among lesbians and gay men: An examination of
internalized homonegativity and rejection sensitivity as potential mechanisms. Journal of
Consulting and Clinical Psychology, 80(5), 917. doi:10.1037/a0029425
Feinstein, B. A., Wadsworth, L. P., Davila, J., & Goldfried, M. R. (2014). do parental
acceptance and family support moderate associations between dimensions of minority
stress and depressive symptoms among lesbians and gay men? Professional Psychology:
Research and Practice, 45(4), 239. doi:10.1037/a0035393
Figueroa, W. S., & Zoccola, P. M. (2015). Individual differences of risk and resiliency in
sexual minority health: The roles of stigma consciousness and psychological hardiness.
Psychology of Sexual Orientation and Gender Diversity, 2(3), 329. doi:10.1037/sgd0000114
Fingerhut, A. W., Peplau, L. A., & Gable, S. L. (2010). Identity, minority stress and psycho-
logical well-being among gay men and lesbians. Psychology & Sexuality, 1(2), 101–114.
doi:10.1080/19419899.2010.484592
Finneran, C., & Stephenson, R. (2014). Intimate partner violence, minority stress, and sexual
risk-taking among US men who have sex with men. Journal of Homosexuality, 61(2), 288–
306. doi:10.1080/00918369.2013.839911
Friedman, C. K. (2008). Sexual minority college women’s experiences with discrimination:
Relations with identity and collective action (Doctoral dissertation). University of
California, Santa Cruz, CA.
Fritz, S. M. H. (2012). Heterosexist harassment and rejection, emotional social support and
perceived stress in a lesbian, gay and bisexual sample. University of North Texas.
Galupo, M. P., Henise, S. B., & Davis, K. S. (2014). Transgender microaggressions in the
context of friendship: Patterns of experience across friends’ sexual orientation and gender
identity. Psychology of Sexual Orientation and Gender Diversity, 1, 461–470. doi:10.1037/
sgd0000075
30 C. M. FISHER ET AL.
Gartner, R. E., & Sterzing, P. R. (2017). Social ecological correlates of family-level interper-
sonal and environmental microaggressions toward sexual and gender minority adolescents.
Journal of Family Violence, 1–16. doi:10.1007/s10896-017-9937-0
Gattis, M. N., Woodford, M. R., & Han, Y. (2014). Discrimination and depressive symptoms
among sexual minority youth: Is gay-affirming religious affiliation a protective factor?
Archives of Sexual Behavior, 43(8), 1589–1599. doi:10.1007/s10508-014-0342-y
Gottlieb, S. R. (2015). Differentiating distress associated with overt and covert discrimination in
lesbian bisexual and queer women (Doctoral dissertation). St. John’s University, New York, NY.
Highlen, P. S., Bean, M. C., & Sampson, M. G. (2000). Preliminary development of the Gay
and Lesbian Oppressive Situations Inventory-Frequency and Effect (GALOSI-F &-E) (ERIC
Number: ED449229). Retrieved from https://eric.ed.gov/?id=ED449229
Hong, J. S., Woodford, M. R., Long, L. D., & Renn, K. A. (2016). Ecological covariates of
subtle and blatant heterosexist discrimination among LGBQ college students. Journal of
Youth and Adolescence, 45(1), 117–131. doi:10.1007/s10964-015-0362-5
Johnson, D. E. (2014). The impact of microaggressions in therapy on transgender and gender-
nonconforming clients: a concurrent nested design study (Doctoral dissertation). The
University of the Rockies.
Kelleher, C. (2009). Minority stress and health: Implications for lesbian, gay, bisexual,
transgender, and questioning (LGBTQ) young people. Counselling Psychology Quarterly,
22(4), 373–379. doi:10.1080/09515070903334995
Kleiman, S., Spanierman, L. B., & Smith, N. G. (2015). Translating oppression: Understanding
how sexual minority status is associated with white men’s racial attitudes. Psychology of
Men & Masculinity, 16(4), 404. doi:10.1037/a0038797
Klonoff, E. A., & Landrine, H. (1995). The schedule of sexist events: A measure of lifetime
and recent sexist discrimination in women's lives. Psychology of Women Quarterly, 19(4),
439–470. doi:10.1111/j.1471-6402.1995.tb00086.x
Konik, J., & Cortina, L. M. (2008). Policing gender at work: Intersections of harassment
based on sex and sexuality. Social Justice Research, 21(3), 313–337. doi:10.1007/s11211-
008-0074-z
Konik, J. A. (2005). Harassment as a system for policing traditional gender norms in the
workplace: The structure and process of sexual harassment and heterosexist harassment
(Doctoral dissertation). http://hdl.handle.net/2027.42/124844
Lambe, J. N. (2013). Well-being and relationship satisfaction among bisexual women in same-
and other-gender couple relationships: The impact of minority stress (Doctoral dissertation).
Alliant International University, CA.
Lau, M. Y., & Williams, C. D. (2010). Microaggressions research: Methodological review and
recommendations. In D. W. Sue (Ed.), Microaggressions and marginality: Manifestation,
dynamics and impact (pp. 313–336). New York, NY: John Wiley & Sons.
Lehavot, K., & Simoni, J. M. (2011). The impact of minority stress on mental health and
substance use among sexual minority women. Journal of Consulting and Clinical
Psychology, 79(2), 159. doi:10.1037/a0022839
Lehavot, K., Simpson, T. L., & Shipherd, J. C. (2016). Factors associated with suicidality
among a national sample of transgender veterans. Suicide & Life-Threatening Behavior, 46
(5), 507–524. doi:10.1111/sltb.12233
Leskinen, E. A. (2012). Deviating, but not Deviant: Conformity to Gender Norms and Sex-
Based Harassment at Work (Doctoral dissertation). University of Michigan, Ann Arbor,
MI.
Liao, K. Y. H. Kashubeck-West, S., Weng, C. Y., & Deitz, C. (2015). Testing a mediation
framework for the link between perceived discrimination and psychological distress among
JOURNAL OF HOMOSEXUALITY 31
Smith, N. G., & Ingram, K. M. (2004). Workplace Heterosexism and Adjustment Among
Lesbian, Gay, and Bisexual Individuals: The Role of Unsupportive Social Interactions.
Journal of Counseling Psychology, 51(1), 57. doi:10.1037/0022-0167.51.1.57
St. Pierre, M., & Senn, C. Y. (2010). External barriers to help-seeking encountered by
Canadian gay and lesbian victims of intimate partner abuse: An application of the barriers
model. Violence and Victims, 25(4), 536. doi:10.1891/0886-6708.25.4.536
Sterzing, P. R., Gartner, R. E., Woodford, M. R., & Fisher, C. M. (2017). Sexual orientation,
gender, and gender identity microaggressions: Toward an intersectional framework for
social work research. Journal of Ethnic & Cultural Diversity in Social Work, 26(1–2), 81–94.
doi:10.1080/15313204.2016.1263819
Sue, D. W. (2010). Microaggressions in everyday life: Race, gender, and sexual orientation.
Hoboken, NJ: John Wiley & Sons, Inc.
Sutter, M., & Perrin, P. B. (2016). Discrimination, mental health, and suicidal ideation among
LGBTQ people of color. Journal of Counseling Psychology, 63(1), 98. doi:10.1037/
cou0000126
Swank, E., Woodford, M. R., & Lim, C. (2013). Antecedents of pro-LGBT advocacy among
sexual minority and heterosexual college students. Sexuality Research and Social Policy, 10
(4), 317–332. doi:10.1007/s13178-013-0136-3
Swann, G., Minshew, R., Newcomb, M. E., & Mustanski, B. (2016). Validation of the sexual
orientation microaggression inventory in two diverse samples of LGBTQ youth. Archives of
Sexual Behavior, 45(6), 1289–1298. doi:10.1007/s10508-016-0718-2
Szymanski, D. M. (2006). Does internalized heterosexism moderate the link between hetero-
sexist events and lesbians' psychological distress? Sex Roles, 54(3–4), 227–234. doi:10.1007/
s11199-006-9340-4
Szymanski, D. M. (2009). Examining potential moderators of the link between heterosexist
events and gay and bisexual men’s psychological distress. Journal of Counseling Psychology,
56(1), 142–151. doi:10.1037/0022-0167.56.1.142
Szymanski, D. M., Dunn, T. L., & Ikizler, A. S. (2014). Multiple minority stressors and
psychological distress among sexual minority women: The roles of rumination and mala-
daptive coping. Psychology of Sexual Orientation and Gender Diversity, 1(4), 412–421.
doi:10.1037/sgd0000066
Szymanski, D. M., & Gupta, A. (2009). Examining the relationships between multiple
oppressions and Asian American sexual minority persons’ psychological distress. Journal
of Gay & Lesbian Social Services, 21(2–3), 267–281. doi:10.1080/10538720902772212
Szymanski, D. M., & Henrichs-Beck, C. (2014). Exploring sexual minority women’s experi-
ences of external and internalized heterosexism and sexism and their links to coping and
distress. Sex Roles, 70(1–2), 28–42. doi:10.1007/s11199-013-0329-5
Szymanski, D. M., & Ikizler, A. S. (2013). Internalized heterosexism as a mediator in the
relationship between gender role conflict, heterosexist discrimination, and depression
among sexual minority men. Psychology of Men & Masculinity, 14(2), 211. doi:10.1037/
a0027787
Szymanski, D. M, Ikizler, A. S, & Dunn, T. L. (2016). Sexual minority women’s relationship
quality: Examining the roles of multiple oppressions and silencing the self. Psychology of
Sexual Orientation and Gender Diversity, 3(1), 1–10. doi:10.1037/sgd0000145
Szymanski, D. M., & Meyer, D. (2008). Racism and heterosexism as correlates of psycholo-
gical distress in African American sexual minority women. Journal of LGBTQ Issues in
Counseling, 2(2), 94–108. doi:10.1080/15538600802125423
Szymanski, D. M., & Mikorski, R. (2016). External and internalized heterosexism, meaning in
life, and psychological distress. Psychology of Sexual Orientation and Gender Diversity, 3(3),
265. doi:10.1037/sgd0000182
34 C. M. FISHER ET AL.
Szymanski, D. M., & Sung, M. R. (2010). Minority Stress and Psychological Distress Among
Asian American Sexual Minority Persons 1Ψ7. The Counseling Psychologist, 38(6), 848–
872. doi:10.1177/0011000010366167
Tebbe, E. A., & Moradi, B. (2016). Suicide risk in trans populations: An application of
minority stress theory. Journal of Counseling Psychology, 63(5), 520–533. doi:10.1037/
cou0000152
Town, M. A. (2014). Racism, Heterosexism, Depression, and HIV Risk Behaviors of Native
Men Who Have Sex with Men: Findings from The HONOR Project. (Doctoral disserta-
tion). Portland State University. doi:10.15760/etd.1946
Truong, N. (2010). The role of masculinity-based stress and minority stress in the mental
health of Asian and Pacific Islander gay and bisexual men in the U.S. (Order No. 3396494,
City University of New York). ProQuest Dissertations and Theses, 161.
Velez, B. L., Breslow, A. S., Brewster, M. E., Cox, R., & Foster, A. B. (2016). Building a
pantheoretical model of dehumanization with transgender men: Integrating objectification
and minority stress theories. Journal of Counseling Psychology, 63(5), 497–508. doi:10.1037/
cou0000136
Velez, B. L., Breslow, A. S., Brewster, M. E., & Foster, A. B. (2016). Building a pantheoretical
model of dehumanization with transgender men: Integrating objectification and minority
stress theories. Journal of Counseling Psychology, 63(5), 497. doi:10.1037/cou0000136
Victor, B. G., Perron, B. E., & Yochum, C. J. (2015). BibWrangleR: Software tool for converting
bibliographic text files to an analyzable data frame. Zenodo. doi:10.5281/zenodo.31039
Waldo, C. R. (1999). Working in a majority context: A structural model of heterosexism as
minority stress in the workplace. Journal of Counseling Psychology, 46(2), 218–232.
doi:10.1037/0022-0167.46.2.218
Watson, L. B., Grotewiel, M., Farrell, M., Marshik, J., & Schneider, M. (2015). Experiences of
sexual objectification, minority stress, and disordered eating among sexual minority
women. Psychology of Women Quarterly, 39(4), 458–470. doi:10.1177/0361684315575024
Wegner, R. (2014). Homonegative Microaggressions and their Impact on Specific Dimensions of
Identity Development and Self-esteem in LGB Individuals. (Doctoral dissertation).
Columbia University, New York, NY.
Whicker, D. R. (2016). Masculinity matters: Perceptions of one’s own gender status and the
effects on psychosocial well being among gay men (Doctoral dissertation). Marquette
University, Marquette, MI.
Williams, D. R., Yu, Y., Jackson, J. S., & Anderson, N. B. (1997). Racial differences in physical
and mental health: Socioeconomic status, stress, and discrimination. Journal of Health
Psychology, 2(3), 335–351. doi:10.1177/135910539700200305
Wong, G., Derthick, A. O., David, E. J. R., Saw, A., & Okazaki, S. (2014). The what, the why,
and the how: A review of racial microaggressions research in psychology. Race and Social
Problems, 6(2), 181–200. doi:10.1007/s12552-013-9107-9
Woodford, M. R., Chonody, J. M., Kulick, A., Brennan, D. J., & Renn, K. (2015a). The LGBQ
microaggressions on campus scale: A scale development and validation study. Journal of
Homosexuality, 62(12), 1660–1687. doi:10.1080/00918369.2015.1078205
Woodford, M. R., Han, Y., Craig, S., Lim, C., & Matney, M. M. (2014a). Discrimination and
mental health among sexual minority college students: The type and form of discrimina-
tion does matter. Journal of Gay & Lesbian Mental Health, 18(2), 142–163. doi:10.1080/
19359705.2013.833882
Woodford, M. R., Howell, M. L., Silverschanz, P., & Yu, L. (2012). “That’s so gay!”:
Examining the covariates of hearing this expression among gay, lesbian, and bisexual
college students. Journal of American College Health, 60(6), 429–434. doi:10.1080/
07448481.2012.673519
JOURNAL OF HOMOSEXUALITY 35
Woodford, M. R., Joslin, J. Y., Pitcher, E. N., & Renn, K. A. (2017). A mixed-methods inquiry
into trans* environmental microaggressions on college campuses: Experiences and out-
comes. Journal of Ethnic & Cultural Diversity in Social Work, 26(1–2), 95–111. doi:10.1080/
15313204.2016.1263817
Woodford, M. R., & Kulick, A. (2015). Academic and social integration on campus among sexual
minority students: The impacts of psychological and experiential campus climate. American
Journal of Community Psychology, 55(1–2), 13–24. doi:10.1007/s10464-014-9683-x
Woodford, M. R., Kulick, A., & Atteberry, B. (2015b). Protective factors, campus climate, and
health outcomes among sexual minority college students. Journal of Diversity in Higher
Education, 8(2), 73. doi:10.1037/a0038552
Woodford, M. R., Kulick, A., Sinco, B. R., & Hong, J. S. (2014b). Contemporary heterosexism
on campus and psychological distress among LGBQ students: The mediating role of self-
acceptance. American Journal of Orthopsychiatry, 84(5), 519–529. doi:10.1037/ort0000015
Woodford, M. R., Paceley, M. S., Kulick, A., & Hong, J. S. (2015c). The LGBQ social climate
matters: Policies, protests, and placards and psychological well-being among LGBQ emer-
ging adults. Journal of Gay & Lesbian Social Services, 27(1), 116–141. doi:10.1080/
10538720.2015.990334
Wright, A. J., & Wegner, R. T. (2012). Homonegative microaggressions and their impact on
LGB individuals: A measure validity study. Journal of LGBT Issues in Counseling, 6(1), 34–
54. doi:10.1080/15538605.2012.648578
Wright, M. C. (2016). Heterosexist discrimination and posttraumatic symptoms among lesbian,
gay, and bisexual adults (Doctoral dissertation). Long Island University, Brooklyn, NY.
Order No. 10127575). Available from ProQuest Dissertations & Theses A&I; ProQuest
Dissertations & Theses Global. (1798895846)
Yost, M. R., & Gilmore, S. (2011). Assessing LGBTQ campus climate and creating change.
Journal of Homosexuality, 58(9), 1330–1354. doi:10.1080/00918369.2011.605744
Zimmerman, L., Darnell, D. A., Rhew, I. C., Lee, C. M., & Kaysen, D. (2015). Resilience in
community: A social ecological development model for young adult sexual minority
women. American Journal of Community Psychology, 55(1–2), 179–190. doi:10.1007/
s10464-015-9702-6