Professional Documents
Culture Documents
Transparency Is Necessary But Not Sufficient To Reduce Skepticism About A COVID-19 Vaccine
Transparency Is Necessary But Not Sufficient To Reduce Skepticism About A COVID-19 Vaccine
Michael Bang Petersen*, Alexander Bor, Frederik Jørgensen & Marie Fly Lindholt
Abstract:
Acknowledgements:
The analyses presented in this paper are preliminary and have not yet been peer reviewed. The study
has been conducted as part of the "HOPE - How Democracies Cope with COVID-19"-project, funded
by The Carlsberg Foundation with grant CF20-0044 to Michael Bang Petersen. The funders had no
role in the conduct of this research.
1
The World Health Organization (WHO) has emphasized that a vaccine against COVID-19 is a “vital
tool” to counter the current pandemic (WHO, 2020a) and, accordingly, unprecedented amounts of
resources are invested in the race towards the development of a vaccine. Yet, the challenges of a
vaccine-based solution to the COVID-19 pandemic does not end with the development of an approved
vaccine. Put bluntly, a rapidly developed vaccine will have no effect if citizens across the world are
not willing to get vaccinated. Given that the SARS-COV-2 virus is highly contagious, researchers
currently estimate that to reach herd immunity up to 82 percent of a population may need to get
The key challenge is that most countries, as of late 2020, are very far from reaching this
threshold, even if all people who wanted would have access to a vaccine. International studies
document that, depending on the specific samples, question-wording and response options, in some
Western democracies as little as 40 percent of the population is willing to get vaccinated (Callaghan
et al., 2020; Lazarus et al., 2020; Lindholt et al., 2020). The COVID-19 pandemic may not be
contained until health authorities (and other actors) find a way to counter this widespread vaccine
skepticism.
trivial task even in normal circumstances. While vaccines may be among humanity’s greatest
technological achievements, the idea to voluntarily expose ourselves to a virus (even if in a weakened
form) goes against deep-seated intuitions of pathogen avoidance (Mercier, 2020). Moreover,
vaccination constitutes a classical social dilemma: herd immunity is a common good enjoyed even
At the same time, there is growing evidence that skepticism towards COVID-19 vaccines is
also fuelled by distrust in the authorities and beliefs in conspiracies (Browne, 2018; Freeman et al.,
2020; Palamenghi et al., 2020). While the authorities struggle under the burden of pandemic
2
management, some citizens question the intentions and competences of authorities (Bartusevicius et
al., 2020). This may be particularly poignant in countries where the pandemic was politicized, leading
to large partisan divides on proper form of action (Freeman et al., 2020). Furthermore, distrust in the
authorities may be exacerbated by feelings of uncertainty and concern, which are widespread during
the pandemic (Bartusevicius et al., 2020). Thus, the COVID-19 pandemic poses both “realistic”
threats (leading to concerns about health and the economy) and more “symbolic” threats (leading to
concerns about democratic freedoms) (Kachanoff et al., 2020) and people who are concerned whether
the government has their best interest in mind (e.g., having failed to protect their health, financial
well-being or freedom) may also doubt whether the government is competent in authorizing novel
Distrust and uncertainty, however, may not just have direct effects on vaccine skepticism. A
key concern is whether these factors creates further ripple effects by providing a fertile ground for
conspiracies (Douglas et al., 2017; Marchlewska et al., 2018; Van Prooijen & Jostmann, 2013). A
Nature editorial has warned against “a pandemic of vaccine misinformation” (Nature, 2020) and the
WHO similarly warns against the “infodemic” of conspiracy theories and misinformation circulating
The most prominent proposed solution to this perfect storm of vaccine skepticism is “radical
transparency”. Health authorities, academics and the biomedical industry advocate for completely
transparent health communication about COVID-19 vaccines’ approval procedures, efficiency and
side-effects (Nature, 2020; Mahase, E., 2020; see also Bélisle-Pipon et al., 2017; Dayrit et al., 2020).
While transparency is normatively important in itself (Bélisle-Pipon et al., 2017), it is also hoped to
may increase the perceived legitimacy of government decisions (Tyler 2006), could alleviate
heightened needs for cognitive closure (i.e., low abilities to cope with uncerainty; Marchlewska et al.
3
2018), and buffer against conspiracy theories claiming that official authorities are hiding important
information. In short, citizens may need an information “vaccine” that inoculates against skepticism
before they are ready to get inoculated against the virus itself (Van der Linden et al., 2017; Cook et
al., 2017). Indeed, a study of a vaccine controversy in the Philippines argued that increased
transparency in the early phases of the campaign might have hindered the spread of misinformation
The core purpose of the present study is, first, to examine how transparent communication
relative to vague communication about a vaccine influences public vaccine support and, second,
communication. The above arguments notwithstanding, it is also important to note that some studies
have raised concerns that transparent provision of safety information can increase public vaccination
concerns (Byington, 2014), especially if negative information about the efficiency, side effects and
other features of a COVID-19 vaccine become transparently disclosed (Motta, 2020). While initial
announcements for some vaccines against COVID-19 are highly promising (Cohen, 2020), this
question is of particular relevance during the COVID-19 where there are many unknowns about the
duration of protection and the risk of long-term side effects. Accordingly, negative information may
On this basis, a final purpose of the present study is to assess whether additional official
communication can buffer the potential adverse effects of transparently revealing information about
a COVID-19 vaccine. In this regard, prior studies in public legitimacy find that policies with negative
repercussions are viewed as more legitimate to the extent that people feel that their uncertainties are
explicitly acknowledged (Tyler, 2006). In the context of a vaccine against COVID-19, the
management of concern and uncertainty involves both acknowledgement and action: Acknowledging
the uncertainties that citizens may legitimately feel (Blastland et al., 2020) and stating what specific
4
actions have been taken to address these concerns. Regarding the latter, vaccine developers have
taken care to test vaccines in large trials (Doshi, 2020) and, hence, provide certainty about the
Overall, the present study was thus designed to test four predictions:
a COVID-19 vaccine will increase support for the vaccine (support of its approval and
use etc.).
about a COVID-19 vaccine will increase support for the vaccine (support of its
vaccine will inoculate against the negative effects of conspiratorial information about
uncertainty and describes concrete steps taken to decrease this uncertainty (i.e., a
Certainty Induction).
In addition, in a series of post-hoc analyses we explore the role of associations between vaccine
support and a range of individual difference variables highlighted in the above: Individual differences
in abilities to manage uncertainty, political mistrust and perceived threats associated with the COVID-
5
Methods
The study was pre-registered at Open Science Framework (OSF) and the study received ethical
approval from the ethics review board at Aarhus University. The pre-registration, materials, data and
Data collection
Between October 14 and October 21 2020, prior to the release of any information about the features
of vaccines against COVID-19, a sample of 3,436 Americans and 3,427 Danes were invited by the
survey agency YouGov to participate in a survey on attitudes towards a fictitious vaccine against
COVID-19. The sample size was determined on the basis of a power analyses that showed that a
combined sample of 6800 would provide us with 90% power to detect a true effect size of Cohen's d
>= 0.1 for Prediction 1 and 90% power to detect a true effect size of Cohen's d>= .12 for Predictions
2 and 3. The samples were quota-sampled on gender, age, geographical location, education and, in
the US, race to match the respective populations on these sociodemographic variables. These two
countries reflect countries where the pandemic has been less and more politized, respectively
Experimental design
Using a factorial experiment, participants were randomly assigned to receive different information
about a new fictional vaccine against COVID-19, referred to as COVACID. To create a judgmental
anchor for both the features of COVACID and the transparency of the provided information,
COVACID was compared to transparent and factual information about the seasonal vaccine against
the common flu. The experiment had a 3 (Information: Transparent positive / Transparent negative /
6
Vague) × 3 (Induction: Control / Conspiratorial / Certainty) full factorial design. The first
experimental factor described the effectiveness, the side effects and the duration of tests of
COVACID. The Transparent positive condition described the COVACID to equal in all aspects to
one of the world's most used vaccines, the vaccine against the common flu. Negative information
implied that COVACID was less effective, had more side effects and a shorter test period than the
vaccine against the common flu. The Vague information condition suggested publicly available
information that does not allow for precise comparisons with common flu shots, but the authorities
stated that COVACID is “sufficiently effective”, has “acceptable” side effects, and that test period
was “adequate”.
The second experimental factor manipulated whether participants see any additional
information about the context of COVACID. Participants in the Certainty Induction condition read
that the authorities explicitly acknowledge concerns about a novel, hastily developed and approved
vaccine, which therefore was tested on a much larger sample than seasonal flu vaccines. Participants
in the Conspiracy Induction condition learned that conspiratorial views about the vaccine’s approval
circulate on social media. Participants in the control group received no additional information.
No deception was involved in the study and participants were debriefed subsequently and
provided links to the most recent official information about vaccines against both the flu and COVID-
19. Table 1 provides an overview of the experimental conditions and full wordings are available in
Appendix A1.
Upon completion of the dependent measures (see below), participants completed two
manipulation checks that allow us to assess the success of the first experimental factor, i.e., the
manipulation of the descriptions of the COVID-19 vaccine. Specifically, respondents were asked
about their degree of agreement with two statements: (1) "The description of the COVACID vaccine
was more negative than the description of a regular flu vaccine." and (2) "The description of the
7
COVACID vaccine was more vague than the description of the regular flu vaccine." Consistent with
the pre-registered expectations, the Transparent Negative Condition was assessed as significantly
more negative than the two other conditions combined (r=.29, p<.001) and the Vague Condition was
assessed as significantly more vague than the two other conditions combined (r=.22, p<.001).
Following the pre-registration these manipulation checks were conducted for respondents in the
8
Table 1. Overview Over Experimental Conditions.
Imagine that the US health authorities approve a new vaccine against COVID-19 next year. We will call the
vaccine COVACID. To help you assess the new COVACID vaccine it will be compared to one of the most
Intro
commonly used vaccines: the vaccine against the common flu. Every year, almost 50 % of all Americans
receives a flu vaccine.
1. Protection: A flu vaccine 1. Protection: A flu vaccine protects 1. Protection: A flu vaccine
protects about 70 out of 100 who about 70 out of 100 who receive the protects about 70 out of 100 who
receive the vaccine. [...] vaccine. [...] COVACID offers the receive the vaccine. [...] The health
COVACID offers less protection same level of protection against authorities have not disclosed exact
against COVID-19. This means COVID-19. This means that 70 out information about how effective
that 50 out of 100 obtain effective of 100 obtain effective protection. the COVACID vaccine is, but they
protection. state that it is sufficiently effective.
2. Side effects: The side effects of 2. Side effects: The side effects of a 2. Side effects: The side effects of a
Experimental Factor 1
a flu vaccine are mainly mild or flu vaccine are mainly mild or flu vaccine are mainly mild or
moderate. [...] Serious side moderate. [...] Serious side effects moderate. [...] Serious side effects
effects like respiratory problems like respiratory problems are rare like respiratory problems are rare
are rare and may happen to 1 out and may happen to 1 out of 10,000. and may happen to 1 out of 10,000.
of 10,000. COVACID implies a COVACID implies the same risk of The health authorities have not
greater risk of side effects. This side effects. This means that, for issued information on the exact
means that 1 out of 1,000 may example, 1 out of 10,000 may side effects of COVACID but note
experience serious side effects experience serious side effects such that the side effects are considered
such as respiratory problems. as respiratory problems. acceptable.
3. Test period: [...] New vaccines 3. Test period: [...] New vaccines 3. Test period: [...] New vaccines
are normally tested for one year are normally tested for one year or are normally tested for one year or
or more before being approved. more before being approved. more before being approved. The
COVACID has been tested for a COVACID has undergone a normal health authorities have not
shorter period. Therefore, only test period. Therefore, side effects disclosed the exact degree to which
side effects up to six months are up to one year are known. long-term side-effects are known
known. but note that the temporal
perspective is adequate.
[Control Condition] [Certainty Induction] [Conspiracy Induction]
9
Dependent measure
After exposure to the information about the vaccine, participants were asked their agreement with 12
statements about the COVACID vaccine (e.g., "I support the health authorities’ approval of
COVACID", "I would get vaccinated with COVACID if my GP recommended it", "I would not feel
safe getting a COVACID vaccine" and "I feel that the authorities are withholding important
information about COVACID"). Full wordings are available in Appendix A2. The pre-registration
divided these statements into multiple different scales (see Appendix A2) but an exploratory factor
analysis shows that a single latent variable explains 87 % of the total variance in all of the items and,
for the sake of simplicity, a summary scale of all 12 indicators is created with a high level of reliability
(US: a=.90; DK: a=.92). The measure, Vaccine Support, is recoded to vary between 0 and 1 with
higher values indicating greater support and positivity for the COVACID vaccine. Appendix Figure
A2 and Table A2 provides separate analyses for each of the separate scales. The results from those
analyses do not differ substantively from the results presented in the main text.
Finally, the study obtained five psychological individual difference measure and four
Support and four individual difference measures. As to the psychological measures, we collected,
first, Webster & Kruglanski's (1994) scale of the Need for Cognitive Closure, which taps an
individuals' ability to cope with uncertainty and is a major psychological predictor of conspiracy
beliefs. The scale is reliably measured in both the United States (a=.72) and in Denmark (a=.73).
Second, Dekker & Meijerink's (2012) scale of political cynicism, which is a major political predictor
of conspiracy beliefs (Swami et al., 2010). This scale is also reliably measured in both the United
10
States (a=.70) and Denmark (a=.86). Third, Kachanoff et al.'s (2020) scale of threats from the
COVID-19 pandemic. Consistent with the Kachanoff et al. (2020), we created two separate scales, a
scale of perceived symbolic threats (e.g., agreement with the statement that the coronavirus outbreak
is a threat to "the rights and freedoms of the U.S. population as a whole ") (aUS=.85; aDK=.81) and a
scale of realistic threats (e.g., agreement with the statement that the coronavirus outbreak is a threat
to " "your personal health") associated with COVID-19 pandemic (aUS=.75; aDK=.66). Finally, we
obtained a 10-point measure of ideological self-placement on a scale from left to right. In terms of
sociodemographics, we collected gender, age and education as well as vote choice in the last election
for president in the United States and parliament in Denmark, which was recoded into a dichotomous
variable reflecting a left-wing or right-wing vote choice. All individual difference measures are
standardized as z-scores and higher values reflect higher need for cognitive closure, higher cynicism,
higher perceived threat, a more right-wing orientation, being female, being older, being more
Statistical analyses
Consistent with the pre-registration, all predictions are tested using ordinary least squares regression
on the pooled sample of Danes and Americans with two-sided p-values and post-stratification on the
variables used for quota-sampling. We also explore the predicted effects in each sample separately.
As specified in the pre-registration, participants also completed three attention checks that asked them
to recall the specific features of COVACID. The planned inclusion criterion was to only include
participants who provided correct answers to two of the three measures. However, by mistake the
attention checks did not include the correct options for the "Vague Condition" and, accordingly, we
test the predictions on the full sample. It is possible to assess how many failed the planned inclusion
criteria in the other conditions. This amounts to 13 and 12 percent of the participants in those
11
conditions for the United States and Denmark, respectively. While analyses of the effects of those
conditions suggest that exclusion leads to evidence of stronger communication effects (see Table A1
and Figure A1), the effects do not change in terms of substance or statistical significance depending
on whether these participants are included or not. Nonetheless, compared to the planned analyses,
this change implies that the conducted analyses reflect a more ecologically valid test where
12
Figure 1. Predicted Vaccine Support Across All Experimental Conditions and Samples.
Notes. Ns = 3,436 (United States) and 3,427 (Denmark). Predicted values are calculated using OLS
regression to regress Vaccine Support on the two-way interaction between the two experimental
factors. Vaccine Support is coded between 0 and 1. Whiskers represent 95 % confidence intervals.
13
Results
Does transparent positive information about a COVID-19 vaccine increase vaccine support? Yes.
significantly increases vaccine support overall (b=.07, p<.001) and in both the United States (b=.09,
p<.001) and Denmark (b=.06, p<.001). Figure 1 provides predicted values from regression analyses
on the basis of the entire 3×3 factorial experimental design and as is evident support for the
transparently described COVID-19 vaccine is higher across all samples and other conditions.
Does transparent negative information about a COVID-19 vaccine increase vaccine support?
No. Against Prediction 2, Transparent Negative Information relative to Vague Information decreases
vaccine support overall (b=-.02, p=.001). When the samples are assessed separately, this slight
decrease is significant in Denmark (b=-.03, p=.001) but not in the United States (b=-.01, p=.14).
conspiratorial information? No. As a first step, we observe that the Conspiracy Induction decreases
Vaccine Support significantly (b=-.02, p=.002), compared to the average of the other conditions in
the second experimental factor. Subsequently, we regress Vaccine Support on the two-way interaction
between the Transparent Positive Information condition and the Conspiracy Induction, excluding
participants who were exposed to the Transparent Negative Information condition or the Certainty
Induction. Against Prediction 3, there is no evidence that transparent information relative to vague
information significantly diminishes the effect of the Conspiracy Induction overall (b=-.01, p=0.61)
conspiratorial information? No. Specifically, we regress Vaccine Support on the two-way interaction
between the Transparent Negative Information condition and the Conspiracy Induction, excluding
participants who were exposed to the Transparent Positive Information condition or the Certainty
14
Induction. Against Prediction 3, there is no evidence that transparent negative information relative to
vague information significantly diminish the effect of the conspiracy induction overall (b=.02, p=.18)
Does health communication that acknowledges uncertainty buffer against the negative effects
of negative transparent communication? No. As a first step, we observe that the Certainty Induction
significantly increases Vaccine Support (b=.02, p<.001) compared to the average of the other
conditions in the second experimental factor. Subsequently, we regress Vaccine Support on the two-
way interaction between the Transparent Negative Information condition and the Certainty Induction,
excluding participants who were exposed to the Transparent Positive Information condition or the
Conspiracy Induction. Against Prediction 4, there is no evidence that the Certainty Induction
significantly diminishes the negative effect of Transparent Negative Information relative to Vague
Information overall (b=.001, p=.94) nor in United States (b=.02, p=0.26) or Denmark (b=-.02,
p=0.30). Similar results are obtained when the Transparent Information condition is examined rather
than the Transparent Negative Information condition (bOverall=-.02, p=0.20; bUS=-.01, p=.79; bDK=-
.04, p=0.08).
analyze the bivariate associations between our individual difference measures and Vaccine Support.
Specifically, we regress Vaccine Support on each of the individual difference measures in separate
bivariate regression models for each sample and measure. We pool the results across all experimental
conditions. The results are shown in Figure 2. The results show that vaccine skepticism is not driven
by a Need for Cognitive Closure (bUS=-.001, p=.63; bDK=-.001, p=.65) nor by concerns related to the
realist threats from COVID-19 (bUS=-.004, p=.30; bDK=-.003, p=.46). There is only little evidence
that people on the ideological (bUS=-.009, p=.02; bDK=-.009, p=.02) or electoral (bUS=-.01, p=.63;
bDK=-.02, p=.002) right-wing respondents are less supportive of the COVID-19 vaccine. Nor
15
demographics are consistently important: Being female is inconsistently related to vaccine support
across the countries (bUS=-.05, p<.001; bDK=.03, p<.001). In United States, there is some evidence
that education is important (bUS=.02, p<.001; bDK=.01, p=.04) and, in Denmark, age is a relatively
strong predictor (bUS=.01, p<.05; bDK=.04, p<.001). Overall, however, the key drivers of vaccine
skepticism are concerns about the symbolic threats from COVID-19 (e.g., its potential impact on
democratic freedoms; (bUS=-.04, p<.001; bDK=-.06, p<.001) and, in particular, a general distrust of
the political system reflected in the variable of political cynicism (bUS=-.04, p<.001; bDK=-.07,
p<.001). Overall, political cynicism is the strongest predictor of vaccine skepticism across the United
States and Denmark. In Appendix Figure A3, we replicate these finding when we assess the bivariate
16
Figure 2. Associations Between A Range of Individual Differences and Vaccine Support.
Notes. N= 3,427 for all US analyses, except Vote where N = 2,079. N = 3,436 for all Danish analyses,
except Vote where N = 3,004. Associations reflect unstandardized OLS regression coefficients
calculated from bivariate regressions. All correlates, except for the female and vote dummies, are
centered on their mean with standard deviation 1. Higher values on Ideology and Vote Choice equals
more right-wing ideology and vote choice, respestively. Whiskers represent 95 % confidence
intervals.
17
Does the transparency and negativity of vaccine information moderate the association between
political cynicism and vaccine support? On the basis of the analyses of individual difference, we
examine whether the strength of the association between the most predictive individual difference
i.e., political cynicism and vaccine support is influenced by vaccine communication. Specifically, we
regress Vaccine Support on the two-way interaction between political cynicism and the conditions of
the first experimental factor separately for each country. To zoom in on the effects of the descriptions
provided in the first set of experimental conditions, we only include respondents in the Control
condition of the second experimental factor. The results are shown in Figure 3. The analyses show
that the association between political cynicism and vaccine support does not differ significantly
across conditions in Denmark. In the United States, however, political cynicism is significantly less
associated with vaccine support when Americans are exposed to transparent positive information
relative to both transparent negative information (b=.04, p=0.04) and vague positive information
(b=.05, p=0.006).
Does vaccine support differ across countries? Yes. As a final exploratory analysis, we
examine whether vaccine support is significantly higher in one of the countries. Specifically, we
regress Vaccine Support on the dichotomous country variable, pooling across all experimental
conditions. This analysis reveals that there is a sizeable and significant difference in vaccine support
corresponding to an effect size r=.27 (p<.001) with Danes being more supportive of the potential
COVID-19 vaccine. Consistently with the identified role of political cynicism, Danes are also, on
average, significantly less cynical than Americans, corresponding to an effect size of r=-.37 (p<.001).
18
Figure 3. Associations Between Political Cynicism and Vaccine Support Across
Notes. Ns = 3,436 (United States) and 3,427 (Denmark). Entries are unstandardized OLS regression
coefficients calculated from models where Vaccine Support is regressed on the two-way interaction
between experimental condition and Political Cynicism. All variables range between 0 and 1.
19
Discussion
Against widespread hopes among health authorities, researchers and vaccine developers, the present
results demonstrate that transparency is not sufficient to reduce skepticism about a COVID-19
vaccine. First, transparency does not in itself decrease skepticism about a COVID-19 vaccine. This
is only the case when the transparent communication discloses that the features of the COVID-19
vaccine in terms of effectiveness and safety is on par with one of the most widely used vaccines, the
flu vaccine. Second, the negative effects of transparently describing a less effective and less safe
vaccine cannot be buffered by additional health communication that acknowledges public uncertainty
and describes the steps taken to increase certainty. Third, we found no empirical evidence for the
central hope among those stressing the importance of transparency: That transparency in itself
At the same time, the present results clearly buttress the concern among health authorities,
challenge towards reaching herd immunity against COVID-19 via vaccinations. Thus, the largest
predictor of vaccine skepticism in both the United States and Denmark was individual differences in
political cynicism, i.e., beliefs that political elites are corrupt and incompetent. Individual differences
in the ability to manage uncertainty, in contrast, did not significantly relate to vaccine skepticism
despite the fact that much of the theoretical argument for the importance of transparency revolves
These findings on individual differences may also explain another observation: The small
causal effects of health communication observed in the present findings. Even a considerable change
increased vaccine support with, on average, 7 percentage points. This small effect could reflect, first,
that skepticism is not, in fact, driven by feelings of uncertainty and, second, that it is difficult to reach
20
politically cynical citizens via communication. If these segments do not trust the authorities, they will
also not trust the content of their communication and, hence, assess the vaccine more on the basis of
their cynical predispositions than on the basis of the features of the vaccine. A potential silver lining,
however, is the observation that in the United States, where both cynicism and vaccine skepticism is
higher, transparent and positive information about a potential vaccine did, in fact, turn the association
These findings notwithstanding, the present findings also clearly speak against
communicating about future COVID-19 vaccines in positive but vague terms. Participants in the
present study thus reacted just as negatively towards vague, positive communication as they did
towards clear communication that revealed the negative attributes of a vaccine. Furthermore, support
for vaccines described in positive but vague terms was highly associated with beliefs related to
political cynicism. In a nutshell, people seem to assume that vague language, even if positive, serves
as an attempt to hide away a negative set of vaccine attributes. Finally, it is relevant to note that when
the two transparently-described vaccines are directly compared (see Appendix Table A1), the
respondents that failed the attention check has been excluded, but only 9 percentage points when all
respondents are included. If communication about the characteristics of a vaccine does in fact reach
citizens, this suggests that these characteristics can have a substantial impact on vaccine uptake.
Overall, these results underscore that transparency is necessary but not sufficient to reduce
vaccine skepticism. The results highlight that both transparent communication and the exact features
of future COVID-19 vaccines are crucial from the perspective of securing public support for potential
COVID-19. While health communicators and authorities have little influence over the attributes of
the vaccines on offer, the findings, first, highlight the importance of vaccines with significantly
positive attributes in terms of effectiveness and safety and, second, the importance of communicating
21
clearly and transparently about these attributes. Yet, even as very positive news about the vaccines is
currently being announced (Cohen, 2020), the present findings will be a cause of concern for health
authorities and health communicators across the world. The pandemic has been a catalyst of political
polarization and protest across a large number of countries (Bartusevičius et al., 2020). If the
management of the pandemic has eroded political trust in specific countries, the present findings such
that the arrival of the vaccine will not bring an automatic end to their troubles. Instead, these countries
will now face an uphill battle to beat distrust-based skepticism of the vaccines and, according to the
present results, the main available tool of health communication has little power of the truly skeptical.
References
Bartusevičius, H., Bor, A., Jørgensen, F. J., & Petersen, M. B. (2020). The psychological burden of
Bélisle-Pipon, J. C., Ringuette, L., Doudenkova, V., & Williams-Jones, B. (2017). Protecting public
Blastland, M., Freeman, A. L., van der Linden, S., Marteau, T. M., & Spiegelhalter, D. (2020). Five
Britton, T., Ball, F., & Trapman, P. (2020). A mathematical model reveals the influence of population
Böhm, R., Betsch, C., & Korn, L. (2016). Selfish-rational non-vaccination: Experimental evidence
from an interactive vaccination game. Journal of Economic Behavior & Organization, 131,
183-195.
Browne, M. (2018). Epistemic divides and ontological confusions: The psychology of vaccine
22
Byington, C. L. (2014). Vaccines: can transparency increase confidence and reduce hesitancy?.
Callaghan, Timothy and Moghtaderi, Ali and Lueck, Jennifer A. and Hotez, Peter J. and Strych,
Ulrich and Dor, Avi and Franklin Fowler, Erika and Motta, Matt. 2020. Correlates and
http://dx.doi.org/10.2139/ssrn.3667971
Cohen, J. (2020). ‘Incredible milestone for science.’ Pfizer and BioNTech update their promising
Cook, J., Lewandowsky, S., & Ecker, U. K. (2017). Neutralizing misinformation through
inoculation: Exposing misleading argumentation techniques reduces their influence. PloS one,
12(5), e0175799.
Dayrit, M. M., Mendoza, R. U., & Valenzuela, S. A. (2020). The importance of effective risk
communication and transparency: lessons from the dengue vaccine controversy in the
Dekker, H., & Meijerink, F. (2012). Political cynicism: Conceptualization, operationalization, and
Douglas, K. M., Sutton, R. M., & Cichocka, A. (2017). The psychology of conspiracy theories.
Doshi, P. (2020). Will covid-19 vaccines save lives? Current trials aren’t designed to tell us. bmj,
371.
Freeman, D., Waite, F., Rosebrock, L., Petit, A., Causier, C., East, A., ... & Bold, E. (2020).
23
Kachanoff, F. J., Bigman, Y. E., Kapsaskis, K., & Gray, K. (2020). Measuring realistic and
symbolic threats of COVID-19 and their unique impacts on well-being and adherence to
https://doi.org/10.1177%2F1948550620931634 .
Lazarus, J. V., Ratzan, S. C., Palayew, A., Gostin, L. O., Larson, H. J., Rabin, K., ... & El-
Lindholt, M. F., Jørgensen, F., Bor, A., & Petersen, M. B. (2020). Willingness to Use an Approved
Mahase, E. (2020). Covid-19: Vaccine trials need more transparency to enable scrutiny and earn
Marchlewska, M., Cichocka, A., & Kossowska, M. (2018). Addicted to answers: Need for cognitive
closure and the endorsement of conspiracy beliefs. European Journal of Social Psychology,
48(2), 109-117.
Marchlewska, M., Cichocka, A., & Kossowska, M. (2018). Addicted to answers: Need for cognitive
closure and the endorsement of conspiracy beliefs. European Journal of Social Psychology,
48(2), 109-117.
Mercier, H. (2020). Not born yesterday: The science of who we trust and what we believe. Princeton
University Press.
Nature (2020). COVID vaccine confidence requires radical transparency. Nature 586, 8 (2020).
24
Palamenghi, L., Barello, S., Boccia, S., & Graffigna, G. (2020). Mistrust in biomedical research and
vaccine hesitancy: the forefront challenge in the battle against COVID-19 in Italy. European
Sanche, S., Lin, Y. T., Xu, C., Romero-Severson, E., Hengartner, N., & Ke, R. (2020). High
Tyler, T. R. (2006). Why people obey the law. Princeton University Press.
Van der Linden, S., Leiserowitz, A., Rosenthal, S., & Maibach, E. (2017). Inoculating the public
Van Prooijen, J. W., & Jostmann, N. B. (2013). Belief in conspiracy theories: The influence of
uncertainty and perceived morality. European Journal of Social Psychology, 43(1), 109-115.
Webster, D. M., & Kruglanski, A. W. (1994). Individual differences in need for cognitive closure.
WHO. 2020a. WHO Director-General's opening remarks at the media briefing on COVID-19 - 21
remarks-at-the-media-briefing-on-covid-19---21-august-2020
WHO. 2020b. Managing the COVID-19 infodemic: Promoting healthy behaviours and mitigating
09-2020-managing-the-covid-19-infodemic-promoting-healthy-behaviours-and-mitigating-
the-harm-from-misinformation-and-disinformation
25
APPENDIX
for
Contents
A1. Wording of Experimental Conditions ........................................................................................... 2
A2. Measures ....................................................................................................................................... 4
Table A1. Predicted Vaccine Support. Comparing Transparent Negative and Transparent Positive
Information and Inclusion and Exclusion of Respondents with Failed Attention Checks. ................. 6
Figure A1. Predicted Vaccine Support Across Experimental Conditions. Pooled Samples and
Exclusion of Respondents with Failed Attention Checks. ................................................................... 7
Figure A2. Predicted Vaccine Support Across Experimental Conditions with Pooled Samples. ....... 8
Table A2. Overview of Regression Analyses Underlying Figure 1 and Figure A2 .......................... 10
Figure A3. Bivariate Correlations in Pooled Samples Between Various Codings of Vaccine Support
(Pre-Registered and Not) and Individual Differences........................................................................ 11
1
A1. Wording of Experimental Conditions
Intro Text
Imagine that the US health authorities approve a new vaccine against COVID-19 next year. We
will call the vaccine COVACID.
To help you assess the new COVACID vaccine it will be compared to one of the most commonly
used vaccines: the vaccine against the common flu. Every year, almost 50 % of all Americans
receives a flu vaccine.
2
3. Test period: Vaccines are 3. Test period: Vaccines are for one year or more before being
normally tested over an normally tested over an approved.
extended period in order to extended period in order to
reveal both short- and long- reveal both short- and long- The health authorities have not
term side effects. New term side effects. New disclosed the exact degree to
vaccines are normally tested vaccines are normally tested which long-term side-effects are
for one year or more before for one year or more before known but note that the temporal
being approved. being approved. perspective is adequate.
3
A2. Measures
Vaccine Support
Based on the description of COVACID on the previous screen, to what extent do you agree with the
following statements? We know that it may be difficult to answer the questions based on the
description and we therefore ask you to simply answer the first answer that comes to mind.
1. I support the health authorities’ approval of COVACID.
2. I do not think COVACID should have been approved.
3. I would encourage health staff to get vaccinated against COVID-19.
4. I would encourage people who are particularly vulnerable to COVID-19 to get vaccinated with
COVACID.
5. I would encourage close relatives to get vaccinated.
6. I would get vaccinated with COVACID if my GP recommended it.
7. I think most people would feel safe getting a COVACID vaccine.
8. I would not feel safe getting a COVACID vaccine.
9. I would need to get more information on COVACID before deciding whether to get vaccinated.
10. I feel well informed about COVACID.
11. I feel that the authorities are withholding important information about COVACID.
12. I think the authorities are lying about COVACID.
Response scales are seven-point scales with the following anchors: "Strongly disagree" (1),
"Neither disagree nor agree" (4), "Strongly agree" (7).
For the preregistered variables, items 1+2 underlie Approval, items 3-6 underlie Use, items 7+8
underlie Safety, items 9+10 underlie Information and items 11+12 underlie Conspiracies. Items are
reversed as appropriate.
Manipulation checks
1. The description of the COVACID vaccine was more negative than the description of a
regular flu vaccine.
2. The description of the COVACID vaccine was more vague than the description of the
regular flu vaccine.
Response scales are seven-point scales with the following anchors: "Strongly disagree" (1),
"Neither disagree nor agree" (4), "Strongly agree" (7).
Attention checks
How many achieved effective protection against COVID-19 with the COVACID vaccine?
1. 50 out of 100
2. 70 out of 100
3. 90 out of 100
4
4. Don’t know / don’t remember
1. 1 out of 1000
2. 1 out of 10,000
3. 1 out of 100,000
4. Don’t know / don’t remember
How long was the test period for the COVACID vaccine?
1. Six months
2. One year
3. Eighteen months
4. Don’t know / don’t remember
5
Table A1. Predicted Vaccine Support. Comparing Transparent Negative and Transparent
Positive Information and Inclusion and Exclusion of Respondents with Failed Attention
Checks.
(1) (2)
Respondents Excluded All Included
***
Transparent Positive 0.139 (0.008) 0.094*** (0.006)
***
Constant 0.501 (0.006) 0.512*** (0.004)
Observations 2920 4583
2
R 0.090 0.047
Notes. Entries are unstandardized regression coefficients from OLS regression analysis with
standard errors in parentheses. Baseline condition is "Transparent Negative Information". All
variables are scored between 0 and 1. * p < 0.05, ** p < 0.01, *** p < 0.001
6
Figure A1. Predicted Vaccine Support Across Experimental Conditions. Pooled Samples and
US + DK US + DK US + DK
Transparent
Positive
Vague
Transparent
Negative
0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1
Notes. N = 5,200. Respondents who failed the attention check in the Transparent Positive and
Transparent Negative Conditions have been removed. No respondents have been removed from the
Vague Condition. Predicted values are calculated using OLS regression to regress Vaccine Support
on the two-way interaction between the two experimental factors. Vaccine Support is coded between
0 and 1. Whiskers represent 95 % confidence intervals.
7
Figure A2. Predicted Vaccine Support Across Experimental Conditions with Pooled Samples.
US + DK US + DK US + DK
Transparent
Positive
Vague
Transparent
Negative
0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1
Support of Vaccine Approval
US + DK US + DK US + DK
Transparent
Positive
Vague
Transparent
Negative
0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1
Support of Vaccine Use
US + DK US + DK US + DK
Transparent
Positive
Vague
Transparent
Negative
0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1
Feelings of Safety About Vaccine
8
E. Dependent variable: Feeling of Having Sufficient Vaccine Information
Control Conspiracy Induction Certainty Induction
US + DK US + DK US + DK
Transparent
Positive
Vague
Transparent
Negative
0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1
Feeling of Sufficient Vaccine Info
US + DK US + DK US + DK
Transparent
Positive
Vague
Transparent
Negative
0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1 0 .2 .4 .6 .8 1
Endorsement of Conspiracies About Vaccine
Notes. Ns = 3,436 (United States) and 3,427 (Denmark). Predicted values are calculated using OLS
regression to regress each of the five pre-registered dependent variables on the two-way interaction
between the two experimental factors. Dependent variables are coded between 0 and 1. Whiskers
9
Table A2. Overview of Regression Analyses Underlying Figure 1 and Figure A2
10
Figure A3. Bivariate Correlations in Pooled Samples Between Various Codings of Vaccine
1.00
Vacine Info 0.72 0.51 0.50 0.58
-0.60
Age 0.12 0.11 0.12 0.10 0.07 -0.07 -0.09 0.03 0.05 -0.04 0.12 0.08 0.07
-0.80
Education -0.01 -0.01 0.01 -0.03 -0.05 0.01 -0.07 0.14 -0.00 0.11 -0.11 -0.12 0.02 -0.08
-1.00
Vaccine Support
Vaccine Approval
Vaccine Use
Vaccine Safety
Vacine Info
Vaccine Conspiracy
Cognitive Closure
Political Cynicism
Symbolic Threat
Real Threat
Vote Choice
Ideology
Female
Age
11