Professional Documents
Culture Documents
Bakker Lelkes Malka 2021 Apsr
Bakker Lelkes Malka 2021 Apsr
doi:10.1017/S0003055421000605 © The Author(s), 2021. Published by Cambridge University Press on behalf of the American Political
Science Association. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://
creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the
original work is properly cited.
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
R
esearch on personality and political preferences generally assumes unidirectional causal influence
of the former on the latter. However, there are reasons to believe that citizens might adopt what they
perceive as politically congruent psychological attributes, or at least be motivated to view
themselves as having these attributes. We test this hypothesis in a series of studies. Results of preregistered
panel analyses in three countries suggest reciprocal causal influences between self-reported personality
traits and political preferences. In two two-wave survey experiments, a subtle political prime at the
beginning of a survey resulted in self-reported personality traits that were more aligned with political
preferences gauged in a previous assessment. We discuss how concurrent assessment within the context of a
political survey might overestimate the causal influence of personality traits on political preferences and
how political polarization might be exacerbated by political opponents adopting different personality
characteristics or self-perceptions thereof.
T
o understand the psychological foundations of causal influence of political preferences on self-reports
political differences in the general public, social of personality, this would have important implications.
scientists have examined relationships between Theoretically, this would require scholars to reconsider
personality traits—defined as stable tendencies to the extent to which political differences are rooted in
think, feel, and behave in particular ways—and political deep-seated personality traits. Empirically, this would
preferences, such as policy attitudes, political values, mean that models specifying unidirectional influence of
and partisan and ideological identities. This area of personality on political preferences—that is, almost all
research has received a great deal of scholarly attention the analytic models in this research area—overestimate
over the last two decades (for an overview, see Federico the magnitude of this causal influence. And norma-
and Malka 2018). Moreover, its key findings have been tively, an effect of political preferences on self-reported
covered frequently in the news media, often to inform personality traits would suggest that political polariza-
discussion of the nature and consequences of political tion may be exacerbated by political opponents adopt-
polarization (e.g., McAdams 2016; Edsall 2020). ing, or perceiving themselves as possessing, opposite
Studies in this area have mainly used cross-sectional personality attributes.
designs in which personality traits and political prefer- Based on these considerations, we report the results
ences are measured within the same political survey. In of five studies that seek to gauge the causal influence of
almost all cases, this work has implicitly or explicitly political preferences on self-reported personality traits.
assumed that associations between personality and pol- This includes longitudinal studies from three different
itical preferences reflect unidirectional causal influence countries—two of which were preregistered—and two
of the former on the latter. However, recent work has preregistered survey experiments. In the preregistered
raised questions about this assumption and has intro- analyses of panel and experimental data, we find evi-
duced the possibility that political preferences might dence that self-reports of personality are to some extent
influence personality, or at least self-perceptions thereof endogenous to political preferences. Although the esti-
(Boston et al. 2018; Fatke 2017; Hatemi and Verhulst mated causal influence of political preferences on per-
2015; Ludeke, Tagar, and DeYoung 2016; Luttig 2021). sonality traits is small, these estimates are not much
If part of the well-documented associations between different in magnitude from those of the effect of
personality traits and political preferences reflect a personality traits on political preferences—the causal
direction that is generally presumed to explain person-
ality–politics associations. We discuss theoretical,
Bert N. Bakker , Associate Professor, Amsterdam School of methodological, and normative implications.
Communication Research, University of Amsterdam, Netherlands,
b.n.bakker@uva.nl.
Yphtach Lelkes , Associate Professor, Annenberg School for
Communication, University of Pennsylvania, United States, ylelkes@
upenn.edu. WHY MIGHT POLITICS INFLUENCE
Ariel Malka , Associate Professor, Department of Psychology,
Yeshiva University, United States, a.malka@yu.edu.
PERSONALITY?
Received: August 18, 2020; revised: March 15, 2021; accepted: The most common inference drawn from personality-
June 09, 2021. First published online: August 26, 2021. politics research is that left versus right ideological
1482
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
differences are caused, in part, by a set of traits per- The second mechanism has to do with identity and
taining to a closed, rigid, and structure-seeking versus motivated self-perception. Left- and right-wing people
open, flexible, and ambiguity-tolerant experiential pat- often become aware of the traits associated with stereo-
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
tern (Federico and Malka 2018; Johnston, Lavine, and types of their ideological groups (Ahler and Sood 2018;
Federico 2017). Three frequently studied individual Rothschild et al. 2019). In political contexts, such as
differences within this family of “closed versus open” political surveys or political discussions, people might
traits are conscientiousness, openness to experience, be motivated to represent themselves as similar to
and authoritarianism. stereotypical others in their ideological group
Openness and conscientiousness come from the Big (Ludeke, Tagar, and DeYoung 2016; Ludeke, Weis-
Five taxonomy, which represents the structure of broad berg, and DeYoung 2013; Turner 1985). Moreover, in
traits that efficiently summarize a wide range of per- the context of a political survey, they might assign
sonality differences. Right-wing political preferences greater weight to memories of acting and experiencing
are found to correlate positively with conscientiousness in an ideologically “consistent” way when responding
and negatively with openness to experience (Gerber to personality trait items (Zaller and Feldman 1992).
et al. 2010; Sibley, Osborne, and Duckitt 2012). This is A few longitudinal studies to date have examined
said to be because conscientiousness reflects, in part, a whether specific psychological attributes assumed to
need for order and structure, which is satisfied by right- cause political preferences are, at least to some extent,
leaning political policy. In contrast, openness to experi- caused by political preferences. Analyses of panel data
ence reflects an inclination toward variety-seeking, from Australia and the United States (1–3.5 year inter-
intellectual, and artistic styles that attract people to vals) have provided evidence consistent with political
the political left. Meanwhile, dispositional authoritar- ideology exerting a causal influence on “binding moral
ianism—a widely studied trait reflecting variation in foundations,” reflecting values of group loyalty, respect
preference for obedience, conformity, and order—has for authority, and purity/sanctity (Hatemi, Crabtree,
tended to correlate positively with certain right-wing and Smith 2019; Smith et al. 2017). And analyses of
political preferences (Feldman and Stenner 1997; Sten- panel data from New Zealand (1-year interval) and
ner 2005). This association between right versus left Belgium (6-year interval) were consistent with egali-
political preferences and traits such as conscientious- tarian political attitudes exerting a positive causal influ-
ness, openness, and authoritarianism suggests that the ence on empathy (Sidanius et al. 2013). These studies
primary dimension of political conflict is psychologic- show the potential of political preferences to influence
ally deep-seated and, therefore, difficult to mitigate psychological attributes. However, because of the types
through mutual understanding and compromise of psychological constructs they measure, these studies
(Hibbing, Smith, and Alford 2014). provide limited information about the dominant
A core assumption in the personality-politics litera- emphasis in personality-politics research—the relation-
ture is that personality traits are stable dispositions that ship between the broad open versus closed family of
shape how people respond across situations. Indeed, traits and left versus right political preferences.
personality traits display high rank-order stability To the best of our knowledge, there are four longi-
(Roberts and DelVecchio 2000), have sizable heritable tudinal studies that more directly address this matter.
components (Vukasović and Bratko 2015), and predict First, in a six-wave American panel spanning 22 months,
a wide range of behavioral criteria and life outcomes increased approval of President Obama and decline in
(Soto 2019). However, personality traits can change approval of a Republican-controlled Congress pre-
over a persons’ life time (Damian et al. 2019), and some dicted increases in self-reported openness to experience
interventions have succeeded in changing people’s (Boston et al. 2018). Second, Luttig (2021) found recip-
levels of personality traits (Magidson et al. 2014; Stie- rocal relationships between authoritarianism and sup-
ger et al. 2020). This raises the possibility that in port for the Republican party. Third, using Australian
addition to causing political preferences, personality panel data spanning 10 years, no lagged effect of polit-
traits might, in part, be a consequence of political ical ideology on openness to experience was found
preferences. After all, even demographically based (Hatemi and Verhulst 2015). Fourth, using panel data
identities—such as religiosity and sexual orientation from New Zealand spanning nine years, no effects of
—appear to be influenced in part by political prefer- political ideology on openness to experience were found
ences (Egan 2020; Margolis 2018). This might be true (Osborne and Sibley 2020).1
for personality traits as well. Though informative, these studies possess methodo-
There are two broad mechanisms by which political logical features that limit the conclusions one may draw
preferences might causally influence people’s self- from their findings. The first and second studies
reported personality traits. The first has to do with (Boston et al. 2018; Luttig 2021) focused exclusively
right-wing and left-wing people’s tendency to surround on presidential and congressional approval and did not
themselves disproportionately with politically like-
minded others (Boutyline and Willer 2017; Huber and
Malhotra 2017). Given the powerful influence of group 1
Studies by Bakker, Hopmann, and Persson (2015), Bakker et al.
norms on behavior (Terry and Hogg 1996), people may (2016), Bloeser et al. (2015), and Ekstrom and Federico (2019) rely
come to adopt the behavioral and experiential tenden- on panel data with repeated measures of political preferences but
cies of politically like-minded others, which would regis- only one measure of personality; thus, they cannot address the
ter in self-report measures of personality traits. reciprocal relationship.
1483
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
directly assess political policy preferences. The third a control condition, would subsequently report levels of
study (Hatemi and Verhulst 2015) used different meas- conscientiousness and openness to experience (Big Five
ures of openness and political preferences across the experiment) or authoritarianism (Authoritarianism
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
two measurement occasions, precluding direct com- experiment) that are more consistent with the political
parisons of people’s personality traits and political preferences that they had reported in an earlier assess-
preferences across the waves. The third (Hatemi and ment.
Verhulst 2015) and fourth (Osborne and Sibley 2020) With these two distinct approaches to diagnosing
studies focused only on openness to experience and did causal influence, our study is the first to combine large
not address other traits relevant to the open versus population-based panel data from multiple countries
closed family of indicators. And most importantly, with experimental data to gauge the potential effects of
while panel studies offer Granger causal evidence, political preferences on self-reported personality traits.
internal validity threats still loom because theorized
causal variables are not exogenously manipulated.
TESTS USING CROSS-LAGGED PANEL
MODELS
THE PRESENT RESEARCH
We conducted tests of the hypothesis that increases in
Prior work leaves unclear the matter of whether polit- right-wing (conservative) political preferences cause a
ical preferences in part influence self-reports of person- more “closed” personality—that is, high conscientious-
ality traits. We examine this possibility with analyses of ness, low openness, and high authoritarianism—in the
panel datasets from three different countries (with Netherlands (LISS panel), Germany (GESIS panel),
design and analysis plan preregistered in two of these) and the United States (GSS panel). These panels con-
as well as two survey experiments from the United tain measures of personality and political preferences
States (with design, analysis plan, and predictions pre- at three occasions over long periods (Netherlands =
registered in both). The Online Appendix on the APSR 11 years; Germany = 5 years; US = 4 years). We
website provides item wording and results belonging to preregistered hypotheses, methods, and analysis strat-
the main tests of the hypotheses. The Supplementary egy before gaining access to the data (Van den Akker
Information contains additional information and et al. 2019) for the German GESIS panel (here: https://
robustness checks and is placed in the American Polit- osf.io/2bx8c/) and the American GSS panel (here:
ical Science Review Dataverse (Bakker, Lelkes, and https://osf.io/h67p5/) but not for the Dutch LISS panel.
Malka 2021). Table 1 provides an overview of the three panel studies.
First, we used cross-lagged panel models (CLPMs) to The panel studies adhere to APSA’s Principles and
examine the causal direction in population-based lon- Guidance for Human Subject Research (see Online
gitudinal panel studies from the Netherlands, Ger- Appendix [OA] 7.1).
many, and the United States. Each panel spans a long Academic norms for analyzing the reciprocal rela-
time interval and includes validated measures of per- tionship between two variables using longitudinal data
sonality traits from the open versus closed family and vary considerably between disciplines. Political scien-
measures of political preferences. tists have typically relied on the traditional CLPM
CLPMs, at best, offer Granger causal evidence (Finkel 1995); see for instance Goren (2005), Lelkes
(Rogosa 1980; Vaisey and Miles 2017). To overcome (2018), Luttig (2021), or Margolis (2018). In this
this issue, we conducted two well-powered two-wave approach, current values of x and y are simultaneously
between-subjects survey experiments, with preregis- regressed on lagged values of x and y. The lagged
tered hypotheses and analysis plans (Big Five: https:// dependent variable is included in each of these models
osf.io/kqexp/; Authoritarianism: https://osf.io/7bgrm/). to guard against spurious correlations, which can arise
Though experimental manipulation of political prefer- due to differing levels of stability in the outcome and
ences is not feasible, the potential causal influence of predictor variable (Rogosa 1980).
political preferences can be indirectly addressed In Figure 1 we plot the cross-lagged panel model that
through an experimental procedure that makes polit- we used. Positive and statistically significant effects of
ical preferences salient for some but not other respond- personality on political preferences from waves 1–2 and
ents. This corresponds with the approach taken by waves 2–3 (path T [traditional] in Figure 1) would
political scientists and psychologists of priming religi- support the conventional view of personality influen-
osity to gauge the causal influence of religious senti- cing political preferences. We hypothesized, however,
ment, a personal attribute that is not directly that there would also be significant positive effects of
manipulable (Ben-Nun Bloom and Arikan 2013; Mar- political preference on personality from waves 1–2 and
golis 2018). If exogenously manipulated political pref- waves 2–3 (path H [hypothesized] in Figure 1).
erence salience causes people to report personality The Dutch and German samples included measures
traits that are more consistent with previously assessed of conscientiousness and openness to experience,
political preferences, this would suggest that having whereas the American sample included measures of
political preferences in mind causes one to represent authoritarianism. In the Dutch and German samples,
oneself as having a more politically congruent person- we (a) treat each personality measure (openness and
ality. We, therefore, tested the preregistered prediction conscientiousness) as an indicator of a closed person-
that those primed with politics, compared with those in ality, (b) concatenate the measures, (c) include a
1484
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
TABLE 1. Overview of the Design Characteristics of the Panel Studies in the Netherlands, Germany
and the United States
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
H
B H
T T
Right-Wing Right-Wing Right-Wing
Policy Policy Policy
Preference Preference Preference
(Wave 1) (Wave 2) (Wave 3)
Note: T is the path of the traditional personality-politics literature where personality is causing ideology. H is the hypothesized relationship
where politics is causing personality.
dummy variable to indicate whether a particular set of Given these limitations and the fact that we preregis-
observations comes from openness or conscientiousness, tered use of the CLPM analyses, we presently report
and (d) cluster on respondent. This approach, which was results using CLPM in the main text and results using
preregistered for the German data, maximizes power, RI-CLPM analyses in the Online Appendix (the Neth-
and simplifies the presentation of results. Note that erlands, see OA 1.4; Germany, see OA 2.3; the US, see
throughout the panel studies we used the one-sided p- OA 3.4). Most importantly, however, we supplement
value of 0.05 as the value for statistical significance, the panel data analyses with analyses of two preregis-
which was preregistered for the German and US panels. tered survey experiments that attempt to diagnose
Though the use of CLPMs is quite common and we causal influence by exogenously manipulating political
preregistered the plan to use them, it is important to preference salience.
note that this procedure has limitations. In particular,
the traditional CLPM does not distinguish within-per-
son and between-person variance and is ultimately Nonpreregistered Test in the Netherlands of
susceptible to omitted variable bias. However, alterna- the Big 5 and Political Preferences
tives to the CLPM, most notably the random intercept We used data from the Dutch LISS (Longitudinal
CLPM (RI-CLPM; Hamaker, Kuiper, and Grasman Internet Studies for the Social Sciences) panel in the
2015), also come with biases (Allison, Williams, and Netherlands (Scherpenzeel 2018). The LISS panel is a
Moral-Benito 2017; Leszczensky and Wolbring 2019; representative sample of Dutch individuals who par-
Nickell 1981). In OA 4, we describe these biases and ticipate in monthly Internet surveys. We used measures
illustrate with our own simulations and analyses how of the Big Five personality traits administered in
they would be expected to seriously distort conclusions May 2008, May 2013, and May 2019 and measures of
if applied to the present panel data. political preferences administered during December
1485
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
0.10
Standardized Coefficient
●
●
0.05
●
● ●
● ● ●
0.00
●
−0.05
s
n
n
ia
gy
ia
gy
EU
EU
ce
ce
tio
tio
as
as
lo
lo
en
en
ra
ra
an
eo
an
eo
ig
ig
er
er
th
Id
th
Id
m
m
iff
iff
Eu
Eu
Im
Im
D
D
e
e
m
m
co
co
In
In
Policy Variable
Note: Dots and triangles are point estimates, error bars are 90% confidence intervals. The left panel presents the path from lagged
personality on political preference in a subsequent wave—see path T in Figure 1. The right panel presents the path from lagged political
preference on personality in a subsequent wave, path H in Figure 1. The complete output of the cross-lagged models, including model fit,
can be found in the Online Appendix 1.4.
2007–January 2008, December 2012, and December generally considered a good model fit (Byrne 1994;
2018–March 2019. Sample sizes for each wave-measure Hu and Bentler 1999; MacCallum, Browne, and Suga-
combination appear in Supplementary Information wara 1996; see SI 1.4). We plot the standardized coef-
(SI) 1.3. ficients for personality on political preferences in the
Closed personality traits were measured with 10-item left panel of Figure 2 and those for political preferences
conscientiousness and openness scales drawn from the on personality in the right panel of Figure 2.
International Personality Item Pool (Goldberg 1999). Consistent with the key assumption of personality-
The item wording for the trait measures is provided in politics research, we found lagged effects of closed
Online Appendix 1.1, and the psychometric properties, personality on a number of right-wing political prefer-
Cronbach’s α, and average interitem correlation are ences (left panel, Figure 2). For instance, lagged closed
provided in Supplementary Information 1.3. personality scores were positively associated with right-
As for political preferences, we used measures of wing immigration attitudes from waves 1–2 (β = 0.06,
left-right ideological self-placement and attitudes SE = 0.01, p < 0.001) and waves 2–3 (β = 0.07, SE = 0.01,
toward euthanasia, reducing income gaps, European p < 0.001). Similar patterns were found for personality
integration, and immigration. See OA 1.1 for question effects on left-right ideological self-placement, EU atti-
wording. The correlation coefficients between the per- tude, and income differences attitude (waves 2–3) but
sonality traits and policy preferences are provided in not for euthanasia. The one-tailed p-values from these
SI 1.3. models were smaller than 0.05 for 5 of 10 coefficients.
In line with our key hypothesis, however, lagged
levels of political preferences predicted subsequent
Results levels of closed personality in half the tests (right panel,
Figure 2). Lagged immigration attitude was signifi-
We present the unconstrained cross-lagged regression cantly positively associated with later personality
coefficients.2 The RMSEA for all models was 0.07, the scores from waves 1–2 (β = 0.03, SE = 0.01, p < 0.001)
CFI was 0.98, and the SRMR was 0.03, which is and waves 2–3 (β = 0.01, SE = 0.01, one-tailed p = 0.04).
Lagged EU attitudes predicted increase in closed per-
2
Goodness-of-fit-statistics showed that the unconstrained models sonality from waves 1–2 (β = 0.02, se = 0.01, one-tailed
had a better fit compared with the constrained model (OA 1.3). p = 0.01) but not from waves 2–3 (β = 0.01, se = 0.01,
1486
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
one-tailed p = 0.09). Lagged euthanasia attitude had a it is necessary to cluster data at the individual level
positive effect on more closed personality, but the when running multilevel models with multiple obser-
effects were not statistically significant from waves vations per individual, we did not apply weights in our
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
1487
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
0.06
Standardized Coefficient
0.04
0.02
0.00
EU Ideology EU Ideology
Policy Variable
Note: Dots are point estimates, error bars are preregistered 90% confidence intervals. The left-hand panel presents the path from lagged
personality on ideology in a subsequent wave—see path T in Figure 1. The right-hand panel presents the path from lagged ideology on
personality in a subsequent wave, path H in Figure 1. The complete output of the cross-lagged models can be found in the Online Appendix
2.2.
between the assessments (β = 0.02, SE = 0.01, one-sided each year. Data come from mixed-mode surveys in
p < 0.001). which respondents were either interviewed face-to-face
The results reported here do not change when we or by phone.
analyze conscientiousness and openness (reverse Following Stenner (2005), we used a two-item meas-
scored) separately (SI 2.8). As in the Netherlands, we ure of authoritarianism in which respondents ranked
find no evidence for political preferences causally influ- values in terms of importance for child rearing. The
encing neuroticism and extraversion but suggestive measure was computed in each GSS wave by averaging
evidence that becoming more right-wing decreases the ranking of “obedience” and the reverse-scored
agreeableness (SI 2.9). The inclusion of control vari- ranking of “thinking for oneself.”
ables (gender, age, education, and income) does not For political preferences, we used measures of ideo-
change the results (SI 2.10). logical self-placement; party identification; and atti-
In sum, the preregistered tests in Germany align with tudes toward abortion, LGBT rights, and social
the Dutch LISS panel findings, suggesting that political welfare. All political preference measures were coded
preference exerts some causal influence on personality. so that a high score indicates a more right-wing (con-
Next, we turn to a preregistered test of our hypothesis servative) position. The Online Appendix provides the
with another trait that falls within the open versus item wording for the authoritarianism and political
closed domain: authoritarianism (Johnston, Lavine, preference measures (OA 3.1) and the Supplementary
and Federico 2017). Information on Dataverse the descriptive statistics
(SI 3.2), and psychometric properties (SI 3.3) of the
measures. SI 3.4 provides the correlations between the
Preregistered Test Using the GSS Panels in
personality and political preference variables.
the US
We ran CLPMs with authoritarianism as the indica-
We used GSS panels from the United States to test the tor of a closed personality. We also added a categorical
hypothesis that political preferences exert causal influ- variable representing which of the three GSS panels the
ence on authoritarianism. We combined data from data came from. While the RMSEA for these models
three of these panels—2006–2008–2010, 2008–2010– was slightly above the cutoff criteria for acceptable fit
2012 and 2010–2012–2014—into one dataset. In each (RMSEA were roughly 0.15), CFI (>0.90) and SRMR
panel, data were collected in the spring and summer of (<0.05) indicated an acceptable fit (Byrne 1994; Hu and
1488
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
0.2
0.1
0.0
re
re
gy
BT
gy
BT
D
D
n
n
tio
tio
PI
PI
fa
fa
lo
lo
LG
LG
or
or
el
el
eo
eo
W
W
Ab
Ab
Id
Id
al
al
ci
ci
So
So
Policy Variable
Note: Dots are point estimates, error bars are preregistered 90% confidence intervals. The left panel presents the path from lagged
personality on political preference in a subsequent wave—see path T in Figure 1. The right panel presents the path from lagged political
preference on personality in a subsequent wave, path H in Figure 1. The complete output of the cross-lagged models can be found in Online
Appendix 3.2.
1489
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
Conscientiousness (3 items)
from waves 1–2 (β = 0.20; SE = 0.02; one-sided p < 0.001)
Authoritarianism
In contrast, both lagged party identification and left-
wing social welfare attitudes did not predict a more
Openness (3 items)
authoritarian personality in later waves. Analyzing each
(4 items)
of the three panels separately does not change the
substantive conclusions we draw based upon the pre-
registered pooled analyses (see SI 3.8). The inclusion of
control variables (gender, age, education, and income)
also does not change the results substantively (SI 3.9).
Thus, as in the German and Dutch panels, evidence
TABLE 2. Overview of the Design Characteristics of the Big Five Experiment and the Authoritarianism Experiment
was consistent with some causal influence of political
Browsing preferences
Browsing preferences
Online video games
Online shopping
EXPERIMENTAL EVIDENCE
Internet use
Internet use
The results from the three cross-lagged panel data sets
were consistent with political preferences exerting
some causal influence on self-reported personality
traits. However, analyses of this sort are limited in
their capacity to ascertain causality (Rogosa 1980;
Economic conservatism
Economic conservatism
Conservatism (1 item)
Conservatism (1 item)
Wave 2: Political prime
(Big Five: https://osf.io/kqexp/; Authoritarianism:
(1 item)
(1 item)
control condition) before completing measures of
personality—the Big Five personality traits in the first
experiment (Soto and John 2017) and authoritarianism
in the second (Feldman and Stenner 1997). We
Liberal-conservative self-placement
Data
(1 item)
Wave 1
2,020 MTurk
1490
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
their responses. We fielded wave 2 of the survey self-placement, cultural conservatism, economic conser-
roughly one week later, between March 29 and April vatism, presidential approval, and, in the authoritarian-
1, with 1,756 (80%) of the original respondents. This ism experiment, an open-ended question about what
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
sample size was in line with our preregistered power they like about their own party and dislike about the
analysis. other party (Klar 2014). In the placebo control condi-
For the first wave of the Authoritarianism experi- tion, respondents were told that the survey was about
ment, eligible participants either participated in the internet browsing preferences and were then adminis-
first wave of the Big Five experiment (N = 2,055) or a tered questions about their internet browsing prefer-
different study conducted by one of the present authors ences: preference for browsing the internet on
(N = 3,078) on March 9, 2020. We relied on the same different kinds of devices and the strength of this pref-
power analysis as in the Big Five experiment and erence, hours per day spent on the internet, hours per
attempted to collect 2,000 responses from May 14 to day spent on social media, frequency of online shopping
May 20, 2020. We invited all wave 1 respondents and and online gaming, and, in the authoritarianism experi-
closed recruitment once we crossed the threshold. ment, an open-ended question about what they like
Since multiple respondents completed the survey sim- about their preferred internet browsing device and what
ultaneously, our final N was 2,020.4 they dislike about other ones. In each experiment, the
number and format of manipulation items were equiva-
Measures and Procedure lent across both conditions (See the Online Appendix
for exact item wording in Big Five experiment (OA 5.1)
In wave 1 for the Big Five Experiment, respondents and Authoritarianism experiment (OA 6.1). We provide
completed political preference measures: party identi- randomization checks for the Big Five and Authoritar-
fication, liberal-conservative self-placement, cultural ianism experiments in the Supplementary Information
conservatism, economic conservatism, and presidential (SI 5.5, SI 6.6) and outcome neutral quality checks for
approval (see OA 5.1 for item wording and OA 5.2 for the Big Five Experiment in the Supplementary Infor-
coding). We created a general right versus left ideology mation (SI 5.6).
composite to test our preregistered hypotheses, con- Immediately following the manipulation in the Big
sisting of the measures of partisanship, presidential Five experiment, respondents completed the 15-item
approval, liberal-conservative self-placement, and BFI-2-XS, a valid and reliable short Big Five inventory
social and economic policy preferences. We scaled this with three items per trait (Soto and John 2017). Item
variable to range from 0 to 1, with higher scores mean- wording can be found on the Online Appendix
ing a more conservative position. The cultural conser- (OA 5.1), while descriptive statistics (SI 5.3), and psy-
vatism scale was created by averaging the four cultural chometric properties (SI 5.4) are provided in the Sup-
conservatism items from wave 1 and recoding to range plementary Information at the Dataverse. Immediately
from 0 to 1 with higher scores meaning more conserva- following the manipulation in the authoritarianism
tive. In the same way, we computed an economic experiment, respondents completed a four-item authori-
conservatism variable using the two economic attitude tarianism measure with each item presenting a pair of
items and a symbolic political preference variable using traits and asking respondents to consider which of these
party identification, presidential approval, and liberal- they believed was more important to instill in children
conservative self-placement. (Feldman and Stenner 1997). Based on recent evidence
In wave 1 of the Authoritarianism experiment, (Bakker et al. 2020), we instructed respondents to rate
respondents completed measures of party identifica- preference for one or the other trait on a five-point
tion and ideological self-placement, which were also bipolar scale instead of having them make dichotomous
combined into a symbolic political preference measure choices. Items were scaled so that a high score meant the
that ranged from 0 to 1 and with higher scores meaning more authoritarian option and averaged. See OA 6.2 for
more conservative (see OA 6.1 for item wording and the item wording.
coding). In the Supplementary Information file on the
APSR Dataverse, we present descriptive statistics and Analytical Strategy
psychometric properties of the ideology dimensions in
the Big Five experiment (SI 5.3 and 5.4) and Authori- In the Big Five experiment, we treated openness
tarianism experiment (SI 6.3). (reverse-scored) and conscientiousness as two meas-
In wave 2 of each experiment, respondents were ures of a “closed-personality” in a multilevel model
randomly assigned to the political prime or placebo with a random intercept for each person to account for
control prime condition. In the political prime the nested structure of the data. This approach, which
condition, respondents were told that the survey was was preregistered, maximizes power and simplifies the
about politics and were then administered political presentation of results. In essence, it treats openness
preference questions: partisanship, ideological and conscientiousness as a repeated measure of a
“closed-personality.” In both experiments, our primary
analysis regressed closed-personality traits (measured
4
Omitting respondents in the Authoritarianism experiment who had
in wave 2) on wave 1 political preferences (high =
also completed the Big Five experiment yields almost identical point conservative); a dummy variable capturing whether
estimates (SI 6.5), but, given that the sample size is halved, larger participants were in the politics prime (1) or placebo
confidence intervals. control (0) condition; the interaction between political
1491
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
1492
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
2 Authoritarianism in the Politics and Internet the prime did not affect conservatives/Republicans or,
Conditions
except for symbolic political preference, moderates.
Ideology Party Identity
0.4 Individual Data Meta-Analysis of the
0.02 0.21
0.3 Experiments
Average Marginal Effect
1493
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
Ideology
0.04
0.00
−0.04
Party Identity
0.04
0.00
−0.04
Symbolic
0.04
0.00
−0.04
Note: Dots are point estimates, error bars are 90% confidence intervals. Full regression output is provided in the Online Appendix 6.3.
and act in ways that are characteristic of their political political preferences, the results from the RI-CLPM
outlook, or at least perceive themselves to be doing so. models in the Netherlands (see OA 1.4), Germany (see
We examined this possibility using three large and OA 2.3), and the US (see OA 3.4) suggest no causal
long-spanning panel studies from three different coun- influence in either direction. Again, we are skeptical of
tries (two of which were preregistered) and two survey the latter results because of the high likelihood of a
experiments employing a novel two-wave design (both contemporaneous relationship between politics and
preregistered). In each study, we found some evidence personality (see Online Appendix 4 for a discussion)
consistent with political preferences exerting causal influ- and the estimates’ resulting downward bias. However,
ence on self-reported personality traits. Lagged effects of if the results from the RI-CLPM models are correct,
political preference on self-reported personality traits this would be consistent with claims that a latent genetic
were observed in all three-panel studies, and making factor that is itself distinct from both personality traits
politics salient through the survey context resulted in and political preferences drives variation on both
self-reports of personality traits that were in some cases (Hatemi and Verhulst 2015; Verhulst, Eaves, and
more aligned with preexisting political preferences. Hatemi 2012).
We must be clear that any causal claims derived from If, on the other hand, our conclusion about the causal
longitudinal survey data are on shaky ground. The influence of political preferences on self-reported per-
traditional CLPM is more susceptible to omitted vari- sonality traits is correct, it is essential to note that our
able bias than RI-CLPM and other dynamic fixed-effects evidence suggests that this effect is relatively small. This
models, which control for time-invariant confounders. is consistent with the generally small effects observed in
However, RI-CLPM and analogs are only appropriate if political science (Claassen 2020; Kalla and Broockman
the lag structure is correctly specified (Vaisey and Miles 2020; Shepherd and You 2020) and social science
2017). Most social science surveys, which include only a research more generally (Camerer et al. 2018).
few waves and are generally spaced years apart, are Overall, the small effect sizes reported in this paper
likely inappropriate for RI-CLPM. should be evaluated in the context of two consider-
Whereas the CLPM results suggest small mutual ations. First, even a small amount of endogeneity could
causal influences between personality traits and severely bias the estimates of the effects of personality
1494
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
on political preference in the types of models routinely experiences, and perhaps select themself into contexts
tested in this area. Consider a standard model regress- that actually promote this trait. A significant threat
ing EU attitude on a closed personality trait. Using associated with (American) polarization is that it leads
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
wave-3 EU attitudes and wave-2 personality from the people to construe various political and nonpolitical
Dutch LISS data would give a standardized regression differences in terms of an overarching dimension of
coefficient of 0.05 (SE = 0.01, p < 0.001). This relation- societal conflict (McCoy, Rahman, and Somer 2018). If
ship’s estimates from the cross-lagged model were half personality trait perceptions, like perceptions of religi-
the size (β = 0.02, SE = 0.12, p = 0.09). Second, this osity (Margolis 2018) and even demographic attributes
study involved large sample sizes sufficiently powered (Egan 2020), are influenced by political leaning, this
to detect the effect sizes of interest and, in all but one would likely aggravate the tendency of partisans to
case, preregistered analysis plans. It is well known that view the opposition as threatening to one’s way of life.
these attributes of studies are associated with finding One might wonder whether our conclusions are
smaller effect sizes (Camerer et al. 2018; Schäfer and limited to the countries we studied or the specific sam-
Schwarz 2019) because, for instance, selective report- ples we use. However, the personality-politics link is
ing of statistically significant findings from small-N relatively consistent across Western countries and sam-
studies leads to an overestimation of effect sizes ples (Clifford, Jewell, and Waggoner 2015; Malka et al.
(Simmons, Nelson, and Simonsohn 2011). 2014; Sibley, Osborne, and Duckitt 2012), and the pat-
To be sure, several of the present experimental terns we report here are similar to those identified in the
findings were not statistically significant at the preregis- literature. Nevertheless, we will only know if the present
tered threshold for statistical significance. The experi- results generalize beyond these samples and contexts if
ments were sufficiently powered, and the treatments others attempt replication, as we hope they will.
were based upon work by others (Klar 2014; Lavine, It is also important to acknowledge that we used
Johnston, and Steenbergen 2012). That being said, the relatively brief personality scales involving two
primes were quite subtle. Indeed, making politics sali- (GESIS panel and GSS panel) or three (Big Five
ent simply involved stating that the experiment was experiment) items per trait in some of our studies. This
about politics and administering political preference is typical of personality assessment in survey research,
questions—what amounts to “business as usual” in this which often employs short personality measures for
line of work. While the results indicate that adminis- cost reasons. However, Bakker and Lelkes (2018)
tering personality measures in the context of a political showed that highly abbreviated personality measures
survey might overestimate influences of personality on often lead to underestimating the association between
political preference, the subtlety of the prime might personality and political measures. Therefore, our esti-
understate the extent to which political salience can mates could be considered conservative estimates of
lead political opponents to diverge in terms of person- the effects of political preferences on personality and
ality or self-perceptions thereof. In addition to this, it is vice versa. That said, longer personality trait measures
important to keep in mind that the null findings for would be desirable in future work. Future work could
partisanship in the authoritarianism experiment align also disentangle whether political preferences more
with the finding that authoritarianism is not causing strongly influence some of the lower subdomains of
partisanship in the GSS study and with recent work that personality (such as facets and aspects) compared with
questions the direct link between authoritarianism and others (Xu, Soto, and Plaks 2020).
partisanship (Wronski et al. 2018). In addition, we did not preregister expectations
One potential explanation of the present findings is about the extent to which some policy preferences
that the context of a political survey can bias self- would have stronger effects on personality compared
reports of personality traits away from people’s actual with others. There is considerable heterogeneity in this
levels of the traits (Ludeke, Tagar, and DeYoung association across different political domains in the
2016). This would have considerable methodological personality and policy preferences literature. In par-
implications for survey research on personality and ticular, the association between personality and right
political attitudes. However, as important as this meth- versus left ideological self-placement (Sibley, Osborne,
odological issue is, the implications of such a conclusion and Duckitt 2012) and the association between person-
would extend beyond survey measurement. Specific- ality and stances on cultural issues are better estab-
ally, self-perceptions are psychologically important: lished than those involving economic issues (Bakker
Being motivated to view oneself in a particular way as 2017; Johnston, Lavine, and Federico 2017; Malka et al.
a result of one’s context and surroundings can influence 2014). Across our studies, we find suggestive evidence
one’s behavior and judgments in a way that has real that economic issues such as welfare spending (GSS
social consequences. Imagine a person who identifies as panel in the US) and reducing income differences
politically conservative. Spurred by the political con- (LISS panel in NL) have a weaker—and often not
text, they might view themself as more conventional statistically significant—effect on personality com-
and averse to novel experiences than they actually are. pared with right versus left ideological self-placement
Suppose this motivated self-perception is tied to their and cultural issues. However, these results were not
sense of self as a political conservative. In that case, predicted in advance. Independent preregistered rep-
they might see the divide against liberals as reflecting a lications will have to confirm whether it is indeed the
deep-seated personality attribute, surround themself case that some political preferences have a stronger
with others who see themselves as closed to new effect on personality compared with others.
1495
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
1496
Reconsidering the Link Between Self-Reported Personality Traits and Political Preferences
the human subjects research in the Big Five experiment Coppock, Alexander, Thomas J. Leeper, and Kevin J. Mullinix. 2018.
and Authoritarianism experiment was deemed exempt “Generalizability of Heterogeneous Treatment Effect Estimates
across Samples.” Proceedings of the National Academy of Sciences
from review by the University of Pennsylvania (see
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
1497
Bert N. Bakker, Yphtach Lelkes, and Ariel Malka
Lavine, Howard G., Christopher D. Johnston, and Marco R. Party Supporters and Partisan Polarization.” Political Behavior
Steenbergen. 2012. The Ambivalent Partisan: How Critical Loyalty 41 (2): 423–43.
Promotes Democracy. Oxford: Oxford University Press. Schäfer, Thomas, and Marcus A. Schwarz. 2019. “The
Lelkes, Yphtach. 2018. “Affective Polarization and Ideological
Downloaded from https://www.cambridge.org/core. Yeshiva University Libraries, on 08 Dec 2021 at 14:01:15, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/S0003055421000605
1498