Professional Documents
Culture Documents
SSRN Id4173643
SSRN Id4173643
SSRN Id4173643
Tom Zur1
September 15th
Abstract
The law and economics literature has long theorized that one of the goals of law enforcement is
specific deterrence, which relies on the conjecture that imperfectly informed offenders learn
about the probability of apprehension from their prior interactions with law enforcement
agencies. Surprisingly, however, no empirical study has rigorously tried to identify the learning
process that underlies the theory of specific deterrence and, more specifically, whether potential
repeat offenders learn from getting caught in the same way as they learn from not getting caught.
This paper presents novel evidence from a pre-registered randomized controlled trial that sheds
new light on these questions. In each of the two stages of the experiment, participants could
cheat for an increased monetary payoff at the risk of paying a fine, in the face of an uncertain
chance of being audited. Using an incentive-compatible procedure, participants’ beliefs
regarding the probability of being audited were rigorously elicited both before and after they
were either audited or not audited, allowing us to establish the unique rational-Bayesian
benchmark and any deviation thereof for each participant. We find that being audited induces a
stronger adjustment in one’s estimate compared to the adjustment induced by not being audited,
providing novel evidence for what we call a “non-occurrence bias.” We show that this bias
reduces the specific deterrence effect. It also reduces the marginal benefit from investing in
enforcement and thus lowers the optimal investment level.
JEL CODES: K42, K14, D83, D91
1
John Olin Fellow and SJD Candidate, Harvard Law School. For helpful comments and suggestions, I thank Oren
Bar-Gill, Alma Cohen, Tamar Kricheli-Katz, Haggai Porat, Omri Porat, Holger Spamann, Kathryn Spier, Crystal
Yang, and participants of the 39th annual conference of the European Association of Law & Economics (awarded
the Göran Skogh Award for the best paper presented by a young scholar). The hypotheses of this study were pre-
registered in the American Economic Association's registry for randomized controlled trials on February 24, 2022,
and can be found at https://www.socialscienceregistry.org/trials/8992. The experimental design was reviewed and
determined to be exempt from Institutional Review Board (IRB) by Harvard University Area IRB on January 25,
2022.
Beginning with Becker (1968), economic theory of law enforcement teaches us that, when
contemplating whether to commit an offense, a potential offender considers his benefit from
committing the offense against the expected costs, which are a function of the sanction and the
probability of being apprehended and sanctioned. Early models of deterrence relied on the
assumption that individuals’ beliefs regarding the probability of apprehension are accurate and
steady over time. This assumption, however, has long been empirically disproved: beliefs are
likely to be inaccurate and change through the offender’s experience with criminal activity.
Deterrence created through this learning process, which is the focus of this study, is often
referred to as specific deterrence, which is most relevant to offenses that are likely to be
repeated. Sah (1991) presented the first theoretical model to explicitly account for learning in a
law enforcement setting, replacing the static approach of a single-known objective probability
model with a dynamic mechanism where individuals’ perceptions regarding the probability of
apprehension evolve through their experience with illegal activity and their interaction (or lack
thereof) with law enforcement agencies. While a static model predicts that individuals who
commit an offense once will always find it optimal to commit it again in the future, the dynamic
model suggests that the offender’s perceived probability of apprehension may change in response
to his experience with crime, and thus might deter him from offending again in the future.
Despite its theoretical importance, the empirical literature that studied how repeat
offenders successfully learn about the probability of apprehension exclusively relies on surveys
and self-reported estimations, which are limited in their power to rigorously identify the
underlying learning process. More importantly, the empirical literature has only shown that
offenders adjust their beliefs in the right direction, concluding that this indicates rational
learning. This is especially surprising given the vast experimental psychological literature that
shows that individuals often fail to adjust their beliefs rationally when presented with new
information, albeit in the correct direction. Such a simplistic approach overlooks two crucial
questions for law enforcement that our study answers: whether individuals adjust their beliefs to
a magnitude that is consistent with rational-choice theory, and whether they similarly learn from
being caught and from not being caught, as expected in a perfectly rational, Bayesian world. An
This study starts filling these gaps by conducting a pre-registered randomized controlled
trial in a laboratory setting through Amazon Mechanical Turk (Mturk). In the experiment,
participants were faced with two sequential opportunities to cheat in two identical rounds, each
cheating decision potentially resulting in a higher payoff if it was not chosen for inspection and a
sanction and a lower payoff if chosen for inspection. Participants were initially given noisy
information about the probability of being inspected, and their beliefs regarding this probability
were rigorously elicited (using additional monetary incentives) both before and after they were
notified whether their first decision had been chosen for inspection. This design allows us to
rigorously identify the learning process in a specific deterrence setting. In particular, we elicit
participants’ prior beliefs and use them to construct the rational, Bayesian benchmark. We can
thus test whether individuals adjust their beliefs in a way that is consistent with Bayesian
learning. In addition, the sequential cheating opportunities, before and after being notified
whether they were chosen for inspection, allows us to test the effect of specific deterrence on
actual, cheating behavior. Most importantly, by comparing participants who were and were not
selected for inspection, we can identify the hypothesized non-occurrence bias.
The results confirm the existence of a non-occurrence bias: the learning effect is stronger
when caught, as compared to when not caught. Specifically, we find that, on average, individuals
who were inspected adjust their beliefs regarding the probability of apprehension in the future
upwards, at a level that is statistically indistinguishable from the Bayesian benchmark. In
contrast, individuals who were not inspected adjust their beliefs downwards, but not enough, i.e.,
to a lesser extent than the Bayesian benchmark, with a statistically significant difference. This
result becomes more significant when focusing on the subset of individuals who exhibited a
higher level of comprehension of the mechanism of the experiment, captured by the accuracy of
their initial estimate regarding the probability of inspection.
These results have important policy implications. Most notably, the non-occurrence bias
reduces the marginal benefit from investing in enforcement and thus lowers the optimal
investment level. To see this, assume that some agency, e.g., the IRS, audits taxpayers with a
probability that taxpayers initially view as 𝑝. The IRS can invest additional resources to increase
its auditing capacity by a single additional taxpayer. In addition to any general deterrence effect,
there is also a specific deterrence gain to be made from the additional taxpayer that will be
audited and adjust her belief upwards to 𝑝 + 𝑑1 . In a rational-choice model, there is another
effect: if the taxpayer is not audited, they will adjust their belief downwards to 𝑝 − 𝑑2 ,
decreasing deterrence. For this reason, in a rational-choice model, the overall gain from auditing
an additional taxpayer is not solely a function of 𝑑1 , but a function of 𝐷 = 𝑑1 + 𝑑2 , the wedge
between her posterior belief when being audited to her posterior belief when not being audited.
With a non-occurrence bias, 𝑑2 , the downward adjustment in one’s belief when not being
audited, is smaller than expected by the rational-choice model, implying that 𝐷 is smaller as
well. Thus, in the presence of a non-occurrence bias the marginal benefit from additional
investment in enforcement is smaller than predicted by rational choice theory, implying a smaller
optimal investment in enforcement.
The remainder of the paper proceeds as follows. Section 2 reviews the related literature,
section 3 presents a simple model to guide the experimental design and flush out its potential
policy implications, section 4 presents the experimental design, section 5 describes the data,
2. Related Literature
Following the influential work by Sah (1991), an avalanche of empirical scholarship has been
dedicated to studying specific deterrence, namely – how offenders’ interactions with the criminal
justice system and law enforcement agencies affect their perceptions and future criminal
behavior through learning. One strand of this literature has focused on offenders’ learning about
uncertain criminal sanctions, either through the severity of the sanction (e.g., Hjalmarsson, 2009;
Di Tella and Schargrodsky, 2013) or the length and conditions of imprisonment (e.g., Chen and
Shapiro, 2007; Drago et al., 2011). A second strand of this literature has focused on offenders’
learning about the probability of apprehension, albeit indirectly – using future behavior as a
proxy for a change in beliefs. For example, Dušek & Traxler (2020) show, using administrative
data from speed cameras, that drivers who receive speeding tickets tend to drive slower.2
A third line of empirical scholarship, most closely related to our study, are observational
survey studies that focus on the effect of the offender’s prior interactions with law enforcement
agencies (or lack thereof) on their beliefs regarding the probability of future apprehension. The
majority of this literature finds that offenders who were arrested more frequently report a higher
probability of apprehension than offenders who were arrested less often, providing suggestive
evidence that offenders adjust their beliefs in the Bayesian-rational direction. For example,
Lochner (2007) shows that respondents who engaged in crime while avoiding arrest revised their
perceived probability of future arrest downwards, while those who were arrested adjusted their
perceived probability of rearrest upwards. In a similar vein, Huizinga et al. (2006) find that as the
number of offenses gone unpunished increases, the perceived probability of arrest decreases
monotonically; and Anwar & Loughran (2011) show that the experience of being arrested
induces a significant increase in offenders’ perceived probability of future arrest, especially for
individuals whose prior beliefs were relatively low.
2
For empirical literature that support the reverse effect, namely – that the experience of punishment might increase
recidivism, see, for example Cullen et al., 2011; Nagin et al., 2009; Nagin 2013.
Finally, this paper is also related to the growing psychological literature studying
information processing under uncertainty, showing that people systematically deviate from
Bayesian predictions (Tversky and Kahneman, 1974; Grether, 1980). Most closely related to the
hypothesized non-occurrence bias is the literature on asymmetric learning, and specifically, the
so-called “good-news-bad-news” bias, where subjects tend to over-weight events framed as
“good news” compared to events framed as “bad news” when adjusting their beliefs. This
phenomenon has been shown in various contexts, such as beliefs about financial prospects,
intellectual abilities, temperature forecasts, and more (Eil and Rao, 2011; Sunstein et al., 2016).
In the context of law enforcement, the non-occurrence bias works in the opposite direction of the
good-news-bad-news bias, since we hypothesized that the good news (not being caught) induces
a weaker response compared to the bad news (being caught), due to the latter being framed as a
“non-occurrence”, and not the other way around. Identifying the non-occurrence bias was,
therefore, an uphill battle, further emphasizing the conclusion that it is a distinct form of
cognitive bias that has yet to be identified in the literature.
Assume that 𝑁 individuals consider whether to commit an offense that causes a harm of ℎ >
0 in each of two sequential periods, 𝑡 = 1,2.3 Without loss of generality, we will normalize the
number of individuals to one. Let e denote the government’s expenditures in enforcement
(which, for simplicity, is assumed to be the same in both periods), and 𝑝(𝑒) denote the actual
probability of apprehension in each period, as a function of 𝑒. It is also assumed that there is a
decreasing marginal return to investment in enforcement as captured by 𝑝(𝑒)′ > 0 and
𝑝(𝑒)′′ < 0. Let 𝑝𝑡 (𝑒) denote the belief of the individual, at the beginning of period 𝑡, regarding
the probability of apprehension if they decide to commit an offense in that period. Furthermore,
let 𝑔 denote the gain that the individual derives from committing the offense in each period,
which is distributed among individuals by the density function 𝑓(𝑔) > 0. Without loss of
generality, we assume that 𝑓(𝑔) is a single peak distribution, where the gain of individuals who
commit the offense in each period exceeds the peak of 𝑓(𝑔). let 𝑠 > 0 denote the private
disutility from the sanction imposed on the individual, which is known to her (for simplicity, we
assume that imposing the sanction is socially costless, e.g., a monetary fine).4 An individual will
commit the offense in period 𝑡 if and only if their gain exceeds the expected sanction, given by:
3
The assumption that the horizon is limited to two periods only was made solely for simplification, and our results
hold in any finite horizon with 𝑡 > 2 periods.
4
We assumed that the sanction, in terms of both type and magnitude, is objectively known. However, it is plausible
that individuals often do not know either the magnitude or the type of the sanction, such that learning effects are
expected not only with respect to the probability of apprehension, but also with respect to the sanction itself. See, for
example, Ben-Shahar (1997).
the adjustments in one’s estimate that are induced by observing the signal of either being audited
or not being audited, respectively. Given the behavior of the individual in equation (1), the
government chooses 𝑒 so as to minimize:
∞ ∞
(2) 𝑆𝐶 = ∫𝑝 𝑓(𝑔)𝑑𝑔 ∙ ℎ + 𝑝(𝑒) ∙ ∫(𝑝 𝐴 𝑓(𝑔)𝑑𝑔 ∙ ℎ +
1 (𝑒)𝑠 1 (𝑒)+∆2 (𝑒))𝑠
∞
(1 − 𝑝(𝑒)) ∙ ∫ 𝑓(𝑔)𝑑𝑔 ∙ ℎ + 2𝑒
(𝑝1 (𝑒)−∆𝑁𝐴
2 (𝑒))𝑠
The first term in equation (2) is the aggregate harm from crimes committed at 𝑡 = 1; the
second term represents the aggregate harm from crimes committed at 𝑡 = 2 by individuals who
were audited at 𝑡 = 1, adjusted their belief upwards and, nonetheless, decided to commit the
crime at 𝑡 = 2; the third term is the aggregate harm from crimes committed at 𝑡 = 2 by
individuals who were not audited at 𝑡 = 1 and decided to commit the offense at 𝑡 = 2, and the
last term is the government’s expenditures in enforcement in the two periods.6
The benchmark for the analysis is that individuals are rational-Bayesian decision-makers,
i.e., that ∆2𝐴 (𝑒) and ∆𝑁𝐴
2 (𝑒) are consistent with Bayesian learning. By taking the partial
derivative of the social costs function with respect to enforcement expenditures e, we can
5
There are two significant situations where the assumption that individuals learn about the probability of
apprehension even when not committing the offense is realistic. First, when apprehension is based on auditing, for
example, auditing for tax evasion, safety, or other types of regulatory inspection, stop and frisk, sobriety checkpoints
for DUI, and so on. Second, when individuals receive information from the experience of other individuals (as
opposed to themselves) with criminal activity. On this type of learning, see, e.g., Parker and Grasmick (1979), and
Sah (1991).
6
Note that the number of individuals who commit the offense at 𝑡 = 2 is also a function of the actual probability of
being audited, 𝑝(𝑒), not just their prior belief 𝑝1 (𝑒) and the signal they got at 𝑡 = 1, audited or not audited (which in
turn determines whether they adjust their belief upwards by ∆2𝐴 (𝑒) or downwards by ∆𝑁𝐴 2 (𝑒), respectively), because
the actual probability is what determines the number of individuals who get each of these signals at 𝑡 = 1.
𝜕𝑆𝐶
(3) (𝑒 ∗ ) = 0 ⇒
𝜕𝑒
∞
𝑑𝑝(𝑒 ∗ )
− ∙∫ 𝑓(𝑔)𝑑𝑔 + (1 − 𝑝(𝑒 ∗ ))
𝑑𝑒 (𝑝1 (𝑒 ∗ )+∆𝐴 ∗
2 (𝑒 ))𝑠
𝑑(𝑝1 (𝑒 ∗ ) − ∆𝑁𝐴 ∗
2 (𝑒 )) 𝑑𝑝(𝑒 ∗ )
∙ ∙ 𝑠 ∙ 𝑓 ((𝑝1 (𝑒 ∗ ) − ∆𝑁𝐴
2 (𝑒 ∗ ))𝑠)
+
𝑑𝑒 𝑑𝑒
∞
∙∫ 𝑓(𝑔)𝑑𝑔] = 2
(𝑝1 (𝑒 ∗ )−∆𝑁𝐴 ∗
2 (𝑒 ))𝑠
Next, consider the effect of an occurrence bias on the optimal e. We empirically find, as will
be further elaborated in the following sections, that the actual upwards adjustment induced by
being audited ∆2𝐴 (𝑒) is consistent with rational-Bayesian learning; but that the downward
adjustment induced by not being audited ∆𝑁𝐴
2 (𝑒) is smaller than the adjustment predicted by
rational learning.
our experimental design, assume that individuals’ prior beliefs regarding the probability of
apprehension 𝑝1 (𝑒 ∗ ) have the following structure: at 𝑡 = 0, all individuals believe that there is a
50% chance that the probability of apprehension is 𝑝𝐻 = 𝑝(𝑒) + ∆1 and 50% chance that the
probability of apprehension is 𝑝𝐿 = 𝑝(𝑒) − ∆𝟏 (where 𝑝𝐻 < 1, 𝑝𝐿 > 0, ∆𝟏 > 0).8
7
Note that 𝛽 < 0 means that when not being audited, the individual adjusts his belief upwards (rather than
downwards). As elaborated in the previous section, the assumption that offenders adjust their beliefs in the rational-
Bayesian direction had long been empirically established.
8
Note that the assumptions that 𝑝𝐻 < 1 and 𝑝𝐿 > 0 derive from our prior assumption that the informational benefit
of one’s experience with criminal activity takes the form of a partially informative binary signal. Where one (or
𝛽∆𝟏 𝟐 ∆𝟏 𝟐 𝛽∆𝟏 𝟐
𝑝2𝑁𝐴 (𝑒) = 𝑝1 (𝑒) − . 9
Substituting 𝑝1 (𝑒) + for 𝑝2𝐴 (𝑒) and 𝑝1 (𝑒) − for
1−𝑝1(𝑒) 𝑝1 (𝑒) 1−𝑝1(𝑒)
Proposition: The optimal investment in law enforcement is decreasing in the magnitude of the
𝜕𝑒 ∗
occurrence bias, i.e., > 0.
𝜕β
Remark: The intuition for this result, whose formal proof can be viewed in the appendix, is as
follows. Since individuals who are not audited at 𝑡 = 1 adjust their beliefs downwards to
𝑝2𝑁𝐴 (𝑒) = 𝑝1 (𝑒) − 𝛽∆𝑁𝐴
2 and thus are less deterred at 𝑡 = 2, in the presence of an occurance
bias, i.e., whereby 𝛽 < 1, the downward adjustment is smaller, hence the loss of deterrence is
smaller as well. In essence, this group of individuals discount the signal of not being audited,
which in turn leads to a higher expected sanction and consequently a lower willingness to
commit the offense at 𝑡 = 2 at any given level of investment in enforcement. The mirror image
of this observation is that whenever a non-occurrence bias exists, the benefit from investing in
enforcement, which operates to increase deterrence among (also) this group, is lower than
predicted by the rational-choice model, implying that enforcement is socially excessive. It
follows that at the optimal level of enforcement that is guided by rational theory, 𝑒 ∗ , the marginal
benefit from investment in enforcement is lower than the marginal cost in the presence of a non-
𝜕𝑒 ∗
occurrence bias, and hence, the optimal level of investment is lower when β is lower, > 0.
𝜕β
This preliminary analysis elaborates the intuition provided in the introduction that the
implication of the non-occurrence bias for policymaking is that the socially optimal investment
both) of these conditions is violated, one learns the enforcement parameters perfectly (i.e., whether 𝑝(𝑒) is
𝑝𝐻 or 𝑝L ) at the end of 𝑡 = 1.
9
For individuals who are audited at 𝑡 = 1, 𝑝2𝐴 (𝑒) = Pr(𝑝𝐻 |A) × 𝑝𝐻 + Pr(𝑝𝐿 |A) × 𝑝𝐿 , where:
Pr(A|𝑝𝐻 )×Pr(𝑝𝐻 ) 0.5𝑝1 (𝑒)+0.5∆𝟏 0.5𝑝1 (𝑒)− 0.5∆1
Pr(𝑝𝐻 |A) = = and Pr(𝑝𝐿 |A) = 1 − Pr(𝑝𝐻 |A) = .
Pr(A|𝑝𝐻 )×Pr(𝑝𝐻 )+(A|𝑝𝐿)×Pr(𝑝𝐿) 𝑝1 (𝑒) 𝑝1 (𝑒)
𝑝 (𝑒)𝟐 + ∆ 𝟐 𝟐
Therefore, 𝑒
𝑝2𝐴 ( ) = 1 ( ) 𝟏 = 𝑝1 ( )
𝑝 𝑒
𝑒 + 𝑝∆𝟏(𝑒). By the same token, for individuals who are not audited at 𝑡 = 1,
1 1
Pr(NA|𝑝𝐻 )×Pr(𝑝𝐻 )
𝑝2𝑁𝐴 (𝑒) = Pr(𝑝𝐻 |NA) × 𝑝𝐻 + Pr(𝑝𝐿 |NA) × 𝑝𝐿 , where: Pr(𝑝𝐻 |NA) = =
Pr(NA|𝑝𝐻 )×Pr(𝑝𝐻 )+(𝑁A|𝑝𝐿)×Pr(𝑝𝐿)
0.5 − 0.5𝑝1 (𝑒)−0.5∆𝟏 0.5 − 0.5𝑝1 (𝑒)+ 0.5∆1 𝑝1 (𝑒) − 𝑝1 (𝑒)𝟐 − ∆𝟏 𝟐
1 − 𝑝1 (𝑒)
; and Pr(𝑝𝐿 |NA) = 1 − Pr(𝑝𝐻 |NA) =
1 − 𝑝 (𝑒)
. Therefore, 𝑝2 𝑒
𝑁𝐴 ( )
=
1 − 𝑝 (𝑒)
=
1 1
∆𝟏 𝟐
𝑝1 (𝑒) − .
1−𝑝1 (𝑒)
10
4. Experimental Design
Participants were recruited through Mturk for a $1 participation fee and an additional bonus
payment based on performance. The average payment was $6 for approximately 10 minutes.10
10
Nonetheless, participants’ understanding of the various components of the experiment was critical to its credibility
and could be achieved only by a careful reading of the instructions. To achieve this, we took two complementary
steps: first, we recruited only Mturk workers with a “master” qualification for an additional payment. This
designation is awarded to individuals that have “demonstrated a high degree of success in performing a wide range
of HITs across a large number of Requesters”, as determined by Amazon’s algorithm. Second, after reading the
instructions and before starting the trial, we asked participants to complete a short simple three-questions
comprehension test, of which answering correctly was required to be eligible for the bonus payment. Participants
were able to return and read the instructions with no time limit and leave the experiment without penalty. Indeed,
our records show that participants allotted two minutes on average for reading the instructions and that about 1/3 of
the participants used the “back” button option (with astonishing average number of “clicks” of 2.5), indicating the
effectiveness of this comprehension test altogether.
11
To give participants more room for cheating, the following statement appeared below the “Roll!” button: "Before
moving to the next screen, please press the 'Roll!' button a few more times just to make sure the dice is legitimate"
(procedure adapted from Shalvi et al., 2012). This procedure builds on the well-established behavioral phenomenon
according to which observing desired counterfactual information (in our design, observing the number guessed
albeit not in the first roll), individuals often feel that shaffling the facts in a self-serving way (in our context,
reporting subsequent, irrelevant-for-pay rolls) is more legitimate than a pure lie. Indeed, our data reveals that 50% of
the respondents rolled the dice several times, 43% out of which were cheaters, which is significantly higher from the
overall cheating rate of 30%. Additional support of this procedure power to facilitate cheating is the observed rolling
pattern, where 30% of the cheaters who rolled the dice more than once did so until observing the number they
guessed.
11
After completing the die-rolling task, participants’ beliefs regarding the probability of
inspection were elicited through the lottery version of the compatible-incentive quadratic loss
rule (McKelvey and Page, 1990), which determine an expected payoff function that is
maximized by a reported probability that equals the person's subjective probability.12 Participants
were asked to provide their “best estimate” regarding the probability of being audited, for the
opportunity to win an additional $1. Following Eil and Rao (2011), participants were told that
“the probability of winning the bonus is higher the closer you are to the correct estimate,” with
an optional link that refers them to a more thorough explanation and a table of possible payoffs
that demonstrate why that is the case.13 To further facilitate participants’ understanding of the
elicitation procedure, we added the following intuitive explanation: “Since your gumball
machine contains either 7 red audit balls or 3 red audit balls (out of 10), your estimate is limited
to a range between 70% (if you are certain that your assigned machine is the one with 7 audit
balls) and 30% (if you are certain that your assigned machine is the one with 3 audit balls). If
you are uncertain, the correct estimate lies somewhere in between”. Participants were asked to
enter their estimate on a virtual slider, with the lower-end labeled as “I am certain there are 3
12
Specifically, each participant’s payoff was determined according to the following scheme: a reported estimate
regarding the probability of being audited of 𝑝 is translated to a possibility of winning a lottery that pays $1 with a
probability of 2𝑝– 𝑝2 if the participant was audited and 1– 𝑝2 if he was not audited. After the completion of the trial,
we matched each participant with her appropriate probability of winning the $1 prize in each of the two rounds,
2𝑝 – 𝑝2 if she was audited in that round and 1– 𝑝2 if she was not audited. Then, the computer drew a random
number 𝑟 distributed uniformly from 0 to 100: if 𝑟 is smaller or equal to the matched probability, the subject wins
the $1 prize in that round. Participants could access a detailed explanation of how this mechanism works, and the
pair probabilities of winning for any given p, by clicking on a link in the survey.
13
Our records indicates that about 7% of the participants clicked on the link at least once.
12
After completion of the elicitation part, participants were notified whether their report
was chosen for inspection (i.e., a ball labeled “audit” was randomly drawn by the computer) or
not (i.e., a ball labeled “no audit” was randomly drawn by the computer), accompanied by an
animation of the corresponding ball jumping up and down on the screen. Participants’ elicited
beliefs before and after learning whether they were audited or not were analyzed to identify
whether they exhibited a non-occurrence bias. Finally, participants were asked to provide a short
explanation of what drove them to adjust their estimation in the second round, followed by a
short demographic questionnaire. Participants’ written feedback in our post-treatment survey and
a short-comprehension test administered after reading the instructions suggested that participants
had a good understanding of the various components of the experiment.
Building on prior literature that demonstrated that many individuals suffer from a distaste
for cheating (Gneezy, 2005), we calibrated the payoffs and the fine to be such that for a rational
Bayesian risk-neutral individual, cheating will consistently yield a higher expected payoff than
not cheating in both rounds, regardless of whether they were audited, to ensure that cheating
does not become ill-advised solely on the basis of rational learning. Altogether, the experiment
consists of two stages (first and second rounds) × two experimental conditions (being audited
and not being audited),14 allowing us to causally identify dynamic within-subject effects of
learning.
5. Data
Three hundred and ten individuals with a “master” qualification and above the age of 18 were
recruited online via Mturk. The sample consists of 47.5% female and 83.6% white participants.
The average age is 44.3, 51.8% have at least a college degree, and 38.6% report earning more
than $50,000 a year. As to participants’ first-round decisions (before administering the
treatment), they reported an average prior belief of being audited of 49.6% (which is not
14
Note that there are two dimensions to the randomization in our experiment: being assigned to the 30% condition
or the 70% condition (each with a probability of 50%), and then being audited or not being audited (30% and 70%,
depending on the first condition). However, all audited participants experience an identical experimental procedure
(and so do all non-audited participants). For this reason, it is more analytically accurate to say that the experiment
includes two treatment conditions, and not four.
13
Only five out of the three hundred and ten participants were eliminated from all analyses
based on either their complete failure in the comprehension test or completion of the experiment
in less than three minutes, either of which exhibited an extreme lack of attention to the
experimental protocol.15
Table 1 provides summary statistics for these variables separately for those who were
audited in the first round and those who were not, as well as their adjusted posterior beliefs and
the decision to cheat in the second round. A balance test reported in the last column revealed no
significant differences across all pre-treatment variables by experimental condition, suggesting
that randomization was effective. Furthermore, since participants were technically assigned to
different gumball machines, which subsequently determined whether or not they were audited,
table 2 provides information on the allocation of participants into these two groups and the
auditing rate within each group, consistent with the 30% and 70% probabilities.
15
Fifteen individuals accessed but did not finish the experiment, and are thus not considered part of the total pool of
310 participants.
14
Prior 0.50 0.10 0.30 0.70 0.49 0.10 0.30 0.70 0.005
Posterior 0.44 0.12 0.30 0.70 0.57 0.11 0.30 0.70 −0.122***
Math literacy 0.30 0.46 0.00 1.00 0.30 0.46 0.00 1.00 −0.002
Cheated in 1st round 0.32 0.47 0.00 1.00 0.30 0.46 0.00 1.00 0.018
Cheated in 2nd round 0.40 0.49 0.00 1.00 0.26 0.44 0.00 1.00 0.142***
Female 0.45 0.50 0.00 1.00 0.50 0.50 0.00 1.00 −0.049
White 0.85 0.36 0.00 1.00 0.82 0.38 0.00 1.00 0.027
Age 43.75 10.65 24.00 75.00 44.80 10.79 24.00 78.00 −1.051
College (Bachelor's) 0.50 0.50 0.00 1.00 0.53 0.50 0.00 1.00 −0.030
Annual income>$50k 0.36 0.48 0.00 1.00 0.41 0.49 0.00 1.00 −0.055
time (minutes) 8.41 4.04 1.55 25.32 8.19 3.61 3.25 22.03 0.216
15
Not audited 69% (107/155) 71% (109/155) 30.5% (46/151) 29% (44/151)
6. Results
6.1 Beliefs: The effect of learning on the perceived probability of being audited
This section explores how participants incorporated the signals of “being audited” and “not being
audited” into their posterior beliefs regarding the probability of being inspected in the second
round. We hypothesized that offenders learn about the probability of apprehension from being
caught at a different level of accuracy compared to learning from not being caught, challenging
the implicit assumption of existing models of specific deterrence that offenders’ learning
conforms with the rational-choice theory.
In our setting, there are two equally likely states of the world, i.e., two gumball machines
from which the computer draws a ball: the “bad” machine (with seven audit balls) and the
“good” machine (with three audit balls). This allowed us to construct the accurate prior belief of
50% (which is indeed the average prior belief reported by participants), such that both signals
should rationally induce the same absolute change in one’s estimate, albeit in a different
direction. In other words, a rational-Bayesian decision-maker will adjust their belief upwards
(when being audited) or downwards (when not being audited) by the same magnitude.
Concretely, after completing the first round, a rational-Bayesian decision-maker should adjust
her belief eight percentage points upwards or downwards, i.e., a posterior of 58% or 42% (50%
± 8%), depending on whether they were audited or not, respectively.16 While symmetric learning
16
To see this, denote the event of being assigned to the 30% condition by A30% (with Pr(A30% ) = 0.5); The event
of being assigned to the 70% condition by A70% (with Pr(A70% ) = 0.5); The event of being audited in the first
round by 𝐶; The event of not being audited in the first round by C ̅ , and the event of being audited in the second
Pr(𝐶|𝐴70% )× Pr(𝐴70% )
round by 𝐵. For participants who were audited in the first round, Pr(𝐴70% |𝐶) =
Pr(𝐶|𝐴70% )×Pr(𝐴70% ) + (𝐶|𝐴30% )×Pr(𝐴30% )
0.7 × 0.5
= = 0.7 . Therefore, Pr(𝐵|𝐶) = Pr(𝐴70% |𝐶) × 0.7 + Pr(𝐴30% |𝐶) × 0.3 = 0.7 × 0.7 + 0.3 × 0.3 =
0.7×0.5 + 0.3 × 0.5
0.58. Conversely, for participants who were not audited in the first round (𝐶̅ ), we have Pr(𝐴30% |𝐶̅ ) =
16
As expected, respondents adjusted their beliefs in the right direction, i.e., upwards in the
audit condition (𝑝 < 0.001),17 and downwards in the no audit condition (𝑝 < 0.001).18 The
average posterior belief is 44.5% for those who were not audited, which is significantly higher
than the average Bayesian benchmark of 42% (𝑝 < 0.01) and 56.7% for those who were audited,
which is not statistically different from the Bayesian benchmark of 58%. However, these
constructed benchmarks assume a prior of 50%, while we observed that respondents’ priors often
deviated from 50%. Specifically, 35% of our sample reported a prior of exactly 50%; 69%
reported relatively accurate priors between 40% and 60%; and the remaining 31% reported priors
that are either smaller than 40% or larger than 60%, half of which reported the extreme priors of
either 30% or 70%, which presumably reflect a somewhat strange complete certainty regarding
the assigned machine, even before learning anything about it. Such deviation might be a result of
the respondent’s mathematical illiteracy (namely, failure to understand that 50% of 70% and
50% of 30% equals 50%); an absolute belief in luck (or lack thereof) that makes one of the
machines more plausible than the other; or misunderstanding of the instructions, which seems the
more plausible explanation for the 31% exhibiting extreme prior beliefs.19
The reported prior allowed us to derive the subjective Bayesian benchmarks – i.e., the
rational posterior belief, conditional on whether one was audited or not, when the reported prior
17
Due to the possible difficulties faced by some participants when presented with nuanced
instructions regarding probabilities and the noise that it created in participants’ reports of their
initial estimation, we then focused on the 199 out of 305 individuals whose prior beliefs lie
between 40% and 60%, as a proxy for a relatively better understanding of the experiment’s
instructions. Recall that reporting a prior belief of either 30% or 70%, which 14% of participants
did, means that the participant is 100% certain which of the gumball machines they were
assigned, at a point in time when the only information they have is that there is an equally likely
chance to be assigned to either of the machines (to be decided by a flip of a coin). Moreover, due
to anticipating this possible misunderstanding, participants were explicitly told that they should
choose either 30% or 70% only if they were absolutely certain that their assigned gumball
machine was the one with three audit balls or seven audit balls, respectively (and that otherwise,
they should set the slider to “somewhere in between”). Seeing as the reported prior is mostly an
indication of one’s understanding of the experimental design, as opposed to their cognitive
process of adjusting their beliefs and forming their posterior estimation, the following analysis
20
To calculate the “rational” posterior for participants with a prior that is different than 50%, let’s denote the
0.7 − m 𝑚 − 0.3
reported prior as m ∈ [0.3, 0.7]. We know that 𝑝 × 0.3 + (1 − 𝑝) × 0.7 → 𝑝 = , and that 1− 𝑝 = .
0.4 0.4
Pr(C|𝐴70% )× Pr(𝐴70% )
For participants who were audited in the first round, Pr(𝐴70% |C) = =
Pr(C|𝐴70% )×Pr(𝐴70% ) + (C|𝐴30% )×Pr(𝐴30% )
m − 0.3
0.7 × 1
0.4
m − 0.3 0.7 − m = 1.75 − 0.525 × . Therefore, Pr(𝐵|C) = Pr(𝐴70% |C) × 0.7 + Pr(𝐴30% |C) × 0.3 = (1.75 −
0.7× + 0.3 × 𝑚
0.4 0.4
1 1 0.21
0.525 × ) × 0.7 + (0.525 × − 0.75) × 0.3 = 1 − . Conversely, for participants who were not audited
𝑚 𝑚 𝑚
0.7 − m
Pr(𝐶̅ |𝐴30% )× Pr(𝐴30% ) 0.7 ×
in the first round (𝐶̅ ), we have Pr(𝐴30% |𝐶̅ ) = = m − 0.3
0.4
0.7 − m =
Pr(𝐶̅ |𝐴70% )×Pr(𝐴70% ) + (𝐶̅ |𝐴30% )×Pr(𝐴30% ) 0.3× + 0.7 ×
0.4 0.4
0.49 − 0.7𝑚 0.49 − 0.7𝑚 0.3𝑚 − 0.09
. Therefore, Pr(𝐵|𝐶̅ ) = Pr(𝐴30% |𝐶̅ ) × 0.3 + Pr(𝐴70% |𝐶̅ ) × 0.7 = ( ) × 0.3 + ( ) × 0.7 =
0.4 − 0.4𝑚 0.4 − 0.4𝑚 0.4 − 0.4𝑚
0.084
0.4 − 0.4𝑚
18
21
Focusing on participants who reported the accurate prior estimation of 50%, while appealing, is impossible due to
lack of statistical power within this group. The choice of the symmetric interval of 20 percentage points around 50%
was guided by identifying the group with the most accurate estimations that is just large enough to yield statistical
power.
19
This striking effect justifies further exploration of whether the hypothesized “non-
occurrence bias” is driven by some sub-group of participants. In our post-treatment survey, we
(33 − 2)
asked respondents to solve an arithmetic problem at a middle-school level ( ) as a proxy
4
for math literacy. Interestingly, we find that when not being audited, both groups – those who
answered the math question correctly and those who failed to do so – adjusted their estimate
downwards by a magnitude that is statistically smaller than warranted by the Bayesian
benchmark (𝑝 < 0.05 and 𝑝 < 0.01, respectively). Conversely, when being audited,
participants who answered the math question correctly adjusted their beliefs upwards to the
extent that is statistically indistinguishable from their Bayesian benchmark (𝑝 > 0.1), as we
found before, while those who answered it incorrectly adjusted their estimate upwards to a
statistically larger extent than dictated by their Bayesian benchmark (𝑝 < 0.05). This means
20
This section explores the relationship between the perceived probability of inspection and the
subsequent decision to cheat. An initial plausible conjecture would be that being audited results
in a decrease in the cheating rate, while not being audited would increase the cheating rate.
Indeed, we observe this general deterrent effect, as evident from the finding that the cheating rate
in the first round is not statistically different across treatments (as one would expect for any pre-
treatment measure), while the cheating rate in the second round is 14.2 percentage points higher
among those who were not audited compared to those who were audited (𝑝 < 0.01).22 However,
when examining the magnitude of the change in behavior, we find that individuals who were not
audited exhibit an increase in the cheating rate from 32% to 39.9% (𝑝 < 0.05), while the
decrease in the cheating rate among those who were audited (from 30.3% to 25.7%) is not
statistically different from zero. Figure 3 compares average cheating rates in the first and second
rounds across experimental conditions.
22
Somewhat trivially (and consistently with this finding), using logit regression, we find a positive and statistically
significant relationship between elicited beliefs regarding the probability of inspection – priors (𝑝 < 0.05) and
posteriors (𝑝 < 0.001) – and the decision to cheat in the first round, and in the second round, respectively.
21
First, differences in behavior across individuals are not only due to differences in
perceptions regarding the probability of apprehension, but also differences in risk preferences
and varying degrees of distaste for cheating,23 both of which we do not observe. While
variability in risk preferences is less of a problem in our design, as the stakes involved are
relatively small and lie in a range in which people are considered to be approximately risk-
neutral (Rabin, 2000), the distaste for cheating makes it hard to isolate the effect of the observed
non-occurrence bias on behavior. Namely, given the distaste for cheating, we cannot expect that
a given change in one’s estimate will necessarily lead to a symmetric change in behavior. More
crucially, if respondents' distaste for cheating is not normally distributed, one cannot rule out the
possibility that any observed divergence is driven by respondents’ varying degrees of distaste for
cheating.
Second, since the first-stage cheating rate was only ~30%, the number of participants
who may potentially be incentivized to change their behavior and cheat after not being audited is
substantially larger than the number of participants who may potentially change their behavior
23
Indeed, some responses to our post-treatment survey open-ended question suggests that their choice to report
honestly was driven from distaste for cheating (for example: “I wanted to be fair”; “I didn't want to have the bonus
based on lying about it").
22
Figure 4 focuses on respondents for whom being notified of whether they were audited or
not should, potentially, induce a change in behavior, namely – those who cheated in the first
round and were audited (𝑛 = 46); and those who did not cheat in the first round and were not
audited (𝑛 = 106). By dropping from the analysis participants for whom the new information
only reinforces their previous decision, we find that among those who did not cheat and were not
audited, 21% changed their behavior and cheated in the second round (𝑝 < 0.001); while of
those who cheated and were audited, 43.5% changed their behavior and did not cheat in the
second round (𝑝 < 0.001). Comparing the absolute change in behavior reveals a statistically
significant difference across treatments: the shift downwards in the audit condition is
dramatically larger than the shift upwards in the no audit condition (𝑝 < 0.01).24 While possibly
suggestive of the “non-occurrence bias,” these results may also be driven by people’s distaste for
cheating, which is likely stronger among those who did not cheat in the first round, making them
less responsive to the economic incentives.
FIGURE 4: DIFFERENCES IN CHEATING RATES FOR THOSE PRONE TO CHANGING THEIR BEHAVIOR
ACROSS TREATMENTS
24
This result holds when dropping participants who guessed correctly at least in one of the two rounds, and thus
were not tempted to cheat due to this reason.
23
24
This paper is the first to explore whether potential repeat offenders learn about the probability of
apprehension from being caught at a different level of accuracy compared to learning from not
being caught. We find that being caught induces a stronger response in one’s belief than the one
induced by not being caught, which we call a non-occurrence bias. This is because in our design,
both events – being audited and not being audited – carry the same informational power, but the
former is framed as something that has occurred, despite both being presented with identical
saliency.
As illustrated in the model, these results imply that enforcement policy grounded in the
rational-choice theory of specific deterrence may result in excessive investment in enforcement.
The reason is that the marginal gain from specific deterrence, embodied in the apprehension of
one additional offender, is a function of the wedge between that offender’s higher posterior
belief regarding the likelihood of being apprehended in the future if he gets caught, and the lower
posterior belief if he does not get caught. A non-occurrence bias means that this wedge is smaller
than predicted by a rational-choice model, and thus that the equilibrium level of investment in
enforcement that is the product of a rational-choice theory is higher than the optimal level given
the non-occurrence bias.
There are two reasons to suspect that the measured non-occurrence bias reflects an under-
estimation of the magnitude of the phenomenon. First, in our setting, the signals of being audited
and not being audited are equally salient. In both cases, the participant is actively notified of the
drawn ball, accompanied by an animation of a jumping ball with the matching label and color. In
reality, however, not being caught (i.e., committing an offense without being arrested) is
typically not salient at all, which is likely to further weaken its informational effect. Second, the
non-occurrence bias in the context of law enforcement operates in the opposite direction of the
established “good-news-bad-news” bias, whereby people tend to over-weight good news and
discount bad news. In the context of specific deterrence, not being caught reflects the “good
news,” and nonetheless, the signal is discounted. Therefore, one may suspect that the actual
magnitude of the “non-occurrence bias” would likely be larger if it was decoupled from the
offsetting “good news” effect.
25
Finally, as we addressed earlier, our design does not allow us to rigorously isolate the
effect of the observed non-occurrence bias on behavior, as unobserved differences in
participants’ risk preferences and distaste for cheating make it impossible to construct a rational
benchmark for behavior, which we hope to explore in future research that will incorporate
mechanisms for eliciting tastes and risk preferences.
26
Let 𝑅 denote the partial derivative of the social costs function with respect to enforcement
expenditures e, as given by expression (3). Using the general formula for the derivative of
implicit function, we can now demonstrate that the optimal investment in law enforcement is
𝜕𝑒 ∗ 𝑅
decreasing in the magnitude of the non-occurrence bias, i.e., = − 𝑅 𝛽 > 0.
𝜕β 𝑒∗
First, taking the derivative of 𝑅 with respect to 𝛽 (omitting 𝑒 ∗ for expositional purposes):
β∆𝟏 𝟐 ∆2
(4) 𝑅𝛽 = [𝑓′ ((𝑝1 − ) 𝑠) ∙ (𝛽 (1−𝑝1 2 − 1) 𝑝1 ′∆12 𝑠 2 𝛽]
1−𝑝1 1)
β∆𝟏 𝟐
Observe that the first term in expression (4), 𝑓 ′ ((𝑝1 −
1−𝑝1
) 𝑠), is negative by virtue of the
assumption that the gain of individuals who choose to commit the offense is larger than the peak
∆2
of 𝑓(𝑔); and that the second term in brackets, (𝛽 (1−𝑝1 )2 − 1), is also negative given that 𝑝𝐻 =
1
𝟐
∆ ∆ 𝟐 ∆ 𝟐
𝑝 + ∆1 < 1 by design (hence 1 − 𝑝 > ∆1 ↔ (1− 𝟏𝑝 2 <1 ↔ β (1− 𝟏𝑝 2 <1 ↔ β (1− 𝟏𝑝 2 − 1 < 0).
1) 1) 1)
Further notice that 𝑝′1 is positive by virtue of the assumption that 𝑝(𝑒)′ > 0 (as 𝑝1 = 𝑝 by
design). The rest of the elements in (4) − ∆1 , 𝑠, 𝛽 − are positive by design, hence 𝑅𝛽 is positive.
27
[
2
⏞
∆𝟏 𝟐 ∆𝟏 𝟐
𝑆 [(2𝑝1 ′𝟐 + 𝑝𝑝′′1 (1 − 𝑝1 2
)) ∙ 𝑓 ((𝑝1 + 𝑝1
) 𝑠)] +
2 +
𝑝1 ′∆𝟏 𝟐 ′ ∆𝟏 𝟐 ∞
𝑆2 [𝑝 ∙ (𝑝1 ′ − ) ∙ 𝑓 ((𝑝1 + ) 𝑠)] + [− 𝑝′′ ∙∫ ∆𝟏 𝟐 𝑓(𝑔)𝑑𝑔]
𝑝1 2 𝑝1 (𝑝1 + )𝑠
{ 𝑝1 }
3
⏞
∆𝟏 𝟐 ∆𝟏 𝟐
𝑆 [(−2𝑝1 ′𝟐 + (1 − 𝑝)𝑝′′1 (1 − β 2 )) ∙ 𝑓 ((𝑝1 − β ) 𝑠)]
(1− 𝑝1 ) (1− 𝑝1 )2
𝑆 2
β𝑝1 ′∆𝟏 𝟐 β∆𝟏 𝟐 ∞
+ 𝑆 2 [(1 − 𝑝) ∙ (𝑝1 ′ − 2 ) ∙ 𝑓′ ((𝑝1 − ) 𝑠)] + [𝑝′′ ∙ ∫ β∆ 𝟐
𝑓(𝑔)𝑑𝑔]
(1−𝑝1 ) 1−𝑝1 (𝑝1 − 1−𝑝𝟏 )𝑠
{ 1 }
]
2
Starting with the first term in brackets in (5), 𝑝1′′ ∙ 𝑓(𝑝1 𝑠) + (𝑝1 ′ ) ∙ 𝑓′ (𝑝1 𝑠) ∙ 𝑠, notice that 𝑝1′′
is negative under the assumption that there is a decreasing marginal return to investment in
enforcement, hence 𝑝′′ < 0, and that 𝑓 ′ (𝑝1 𝑠) is negative by virtue of the assumption that the
gain of individuals who choose to commit the offense is larger than the peak of 𝑓(𝑔). The rest of
the elements in the first term are positive, given the aforementioned assumptions. Hence the first
term is negative.
Moving next to the second and third terms in (5), observe that each of these terms is the
summation of three parallel components in brackets. Starting with the first component of the
𝟐
∆𝟏 𝟐
second term, [(2𝑝1 ′𝟐 + 𝑝𝑝1′′ (1 − 𝑝∆𝟏2 )) ∙ 𝑓 ((𝑝1 + 𝑝1
) 𝑠)], while this component can be either
1
positive or negative, its summation with its parallel in the third term, [(−2𝑝1 ′𝟐 + (1 − 𝑝)𝑝1′′ (1 −
∆𝟏 𝟐 ∆𝟏 𝟐
β )) ∙ 𝑓 ((𝑝1 − β ) 𝑠)], is clearly negative. To see this, note that the summation of
(1− 𝑝1 )2 (1− 𝑝1 )2
∆𝟏 𝟐 ∆𝟏 𝟐 ∆𝟏 𝟐
2𝑝1 ′𝟐 𝑓 ((𝑝1 +
𝑝1
) 𝑠) and −2𝑝1 ′𝟐 𝑓 ((𝑝1 − β
(1− 𝑝1 )2
) 𝑠) is negative, as 𝑓 ((𝑝1 + ) 𝑠) <
𝑝1
28
𝟐
∆𝟏 𝟐 𝟐
by design. Also notice that 𝑝𝑝1′′ (1 − 𝑝∆𝟏2 ) 𝑓 ((𝑝1 + 𝑝1
) 𝑠) and 𝑝1′′ (1 − 𝑝) (1 − β (1−∆𝟏𝑝 )2) 𝑓 ((𝑝1 −
1 1
∆𝟏 𝟐
β
(1− 𝑝1 )2
) 𝑠) are both negative under the assumptions above (i.e. 𝑝1′′ < 0 and 𝑝, 𝑓(𝑔) > 0); the
∆𝟏 𝟐 ∆𝟏 𝟐
fact that 𝑝𝐿 = 𝑝 − ∆1 > 0 by design (hence 𝑝 > ∆1 ↔ <1 ↔ 1− > 1); and the fact that
𝑝1 2 𝑝1 2
∆ 𝟐 ∆ 𝟐 ∆ 𝟐
𝑝𝐻 = 𝑝 + ∆1 < 1 by design (hence 1 − 𝑝 > ∆1 ↔ (1− 𝟏𝑝 <1 ↔ β (1− 𝟏𝑝 <1 ↔ 1 − β (1− 𝟏𝑝 >
1 )2 1 )2 1)
2
0).
2
𝑝1 ′∆𝟏 𝟐 ′
The second component of both the second and third terms, [𝑝 ∙ (𝑝1 ′ − 𝑝1 2
) ∙ 𝑓 ((𝑝1 +
2
∆𝟏 𝟐 𝟐
β∆𝟏 𝟐
𝑝1
) 𝑠)] and [(1 − 𝑝) ∙ (𝑝1 ′ − β𝑝1 ′∆𝟏
(1−𝑝 )2
) ∙ 𝑓′ ((𝑝1 –
1−𝑝1
) 𝑠)] respectively, is also negative given the
1
aforementioned assumptions.
Finally, the summation of the last components of the second and third terms, [−𝑝′′ ∙
∞
∫ ∆𝟏 𝟐 𝑓(𝑔)𝑑𝑔] and [𝑝′′ ∙ ∫∞ β∆𝟏 𝟐
𝑓(𝑔)𝑑𝑔] is also negative, as the perceived probability of
(𝑝1 + )𝑠 (𝑝1 – )𝑠
𝑝1 1−𝑝1
∆𝟏 𝟐
individuals who were audited (𝑝1 + 𝑝1
), is higher than that of individuals who were not audited
β∆𝟏 𝟐 ∞ ∞
(𝑝1 –
1−𝑝1
) by design, hence ∫ ∆𝟏 𝟐 𝑓(𝑔)𝑑𝑔 < ∫ β∆𝟏 𝟐 𝑓(𝑔)𝑑𝑔.
(𝑝1 + )𝑠 (𝑝1 − )𝑠
𝑝1 1−𝑝1
Since we demonstrated that the first term in (5) is negative, and that the summation of the second
and third terms is negative, we demonstrated that 𝑅𝑒 ∗ is negative as well. Therefore, as 𝑅𝛽 > 0
𝜕𝑒 ∗ 𝑅
and 𝑅𝑒∗ < 0 it follows that ∀𝑒 ∗ , 𝛽: = − 𝑅 𝛽 > 0 . Q.E.D.
𝜕β 𝑒∗
29
Description: You are invited to participate in a research study on decision-making and economic
behavior. You will be asked to play a game and to fill out a demographic survey. You must be at
least 18 years of age to participate. Your participation will take about 10 minutes. There are no
risks associated with this study, and your identity will be kept confidential.
Payment: In addition to the $1 payment for taking this HIT, you will receive a bonus payment of
up to $5, based partially on your performance, partially on your decisions, and partially on
chance.
Participant’s rights: If you decide to participate in this experiment, please note that your
participation is voluntary and that you may withdraw your consent or discontinue participation at
any time without penalty. Your privacy will be maintained in all published and written data
resulting from the study. Your name will never be connected to any decision you make. For
scientific reasons, you may be unaware of the study hypotheses and the research questions being
tested.
Contact Information: If you have any questions, concerns, or complaints about this research, its
procedures, risks or benefits, contact the Protocol Director, Tom Zur at zurlab975@gmail.com.
By clicking on the link below, you confirm that you have read the consent form, are at least 18
years old, and agree to participate in the research.
INSTRUCTIONS
This experiment includes two identical rounds. In each round, we will ask you to perform a
simple task of guessing the outcome of a dice roll. You will be asked to report whether your
guess was correct, and the payment will be based on your report: $1.50 for a correct guess and
$0.50 otherwise. However, after each round, some participants, randomly chosen, will be
30
The decision whether to inspect your report in each round will be determined by the computer
randomly drawing a ball from a gumball machine that was loaded with 10 balls labeled either
“Audit” or “No Audit.” The computer has randomly assigned you, by a flip of a coin, either to a
gumball machine with 7 red balls labeled “Audit” and 3 green balls labeled “No Audit”; or to a
gumball machine with 3 red balls labeled “Audit” and 7 green balls labeled “No Audit”. Once
the computer has assigned you to one of the gumball machines, that machine will be used in
both rounds, but you will not know for certain which one it is.
You will also have a chance to receive an additional bonus of $1.00 in each round by estimating
the probability of being audited. In the first round, you will not have any concrete information
about which gumball machine was assigned to you. In the second round, however, you will know
whether or not you were audited in the first round, which will allow you to improve your
estimate.
Final notes: the outlined procedure is completely true and will be strictly followed by the
experimenter. Remember: your identity will never be connected to any decision you make and
will not affect you negatively in any manner or shared with Amazon Mechanical Turk or anyone
else.
31
Comprehension test
To ensure that you understand the instructions, please answer the following questions. You must
answer these questions correctly to be eligible to receive the bonuses in the following sections.
________________________________________________________________
What are the odds that you will be assigned to a gumball machine with 3 green balls?
________________________________________________________________
How many times you will be asked to guess the outcome of a dice roll?
________________________________________________________________
One of the gumball machines has more green balls than the other. How many green balls does it
have?
________________________________________________________________
32
o1
o2
o3
o4
o5
o6
To roll the dice, please click on the “Roll!” button below, and make a mental note of whether
you guessed correctly
o Yes
o No
Remember: your bonus payment will be either $0.50 or $1.50, based on this report only, unless
you will be chosen to be audited based on the ball drawn from your gumball machine, in which
case falsely reporting a correct guess will reduce your payment to $0.25.
33
You will enter your estimate by adjusting the slider at the bottom of the screen to the number that
best reflects your belief regarding the chance you will be audited. Since your gumball machine
contains either 7 red audit balls or 3 red audit balls (out of 10), your estimate is limited to a range
between 70% (if you are certain that your assigned machine is the one with 7 audit balls) and
30% (if you are certain that your assigned machine is the one with 3 audit balls). If you are
uncertain, the correct estimate lies somewhere in between.
Your estimate will be used to determine whether you win the additional $1.00, by means of a
lottery conducted by the computer at the end of the experiment. The probability of winning the
bonus is higher the closer you are to the correct estimate. If you want, you can click here to
see how the accuracy of your estimation increases the chance of earning the $1.00 bonus.
34
Please click on the "Next" button below to start the second round.
o1
o2
o3
o4
o5
o6
35
o Yes
o No
Remember: your bonus payment will be either $0.50 or $1.50, based on this report only, unless
you will be chosen to be audited based on the ball drawn from your gumball machine, in which
case falsely reporting a correct guess will reduce your payment to $0.25.
36
Note: since a red "audit" ball was drawn in the first round, you can use this information to
improve your estimation regarding which gumball machine was assigned to you and,
consequently, what are your chances of being audited.
As before, your chance of winning the additional $1.00 is higher the closer you are to the
correct estimate. If you want, you can click here to see how the accuracy of your estimation
increases the chance of earning the bonus.
37
To what extent, if at all, was being notified that you were audited after the first round affected
your belief regarding the likelihood of being audited in the second round? Please answer on a
scale of 1 to 10 [1=not at all; 10=extremely affected]
o1
o2
o3
o4
o5
o6
o7
o8
o9
o 10
Please provide a short explanation of what drove you to update your estimation the way you did,
or not to update it, if you did not change it. Feel free to provide any other feedback on the
instructions, user interface, etc.
________________________________________________________________
________________________________________________________________
38
________________________________________________________________
What is the highest level of school you have completed or the highest degree you have received?
▢ White/Caucasian
▢ African American
▢ Native American
▢ Asian
▢ Other
39
o Male
o Female
o Transgender Male
o Transgender Female
o Non-binary
o Other
Which of these describes your annual income last year?
o $0
o $1 to 9,999$
o $10,000 to 24,999$
o $25,000 to 49,999$
o $50,000 to 74,999$
o $75,000 or more
o prefer not to say
(33 − 2)
=?
4
Please do not use a calculator. It does not matter whether you answer correctly.
________________________________________________________________
40
− Lucian Bebchuk & Louis Kaplow, Optimal Sanctions When Individuals Are imperfectly
169 (1968)
learn the penalty only by committing the crime, 17 INT'L REV. L. & ECON. 409 (1997)
− M. Keith Chen & Jesse M. Shapiro, Do Harsher Prison Conditions Reduce Recidivism –
− Alexander Coutts, Good news and bad news are still news: experimental evidence on
− Francis T. Cullen , Cheryl Lero Jonson & Daniel S. Nagin, Prisons Do Not Reduce
− Francesco Drago, Roberto Galbiati & Pietro Vertova, Prison Conditions and Recidivism,
− David Eil & Justin M. Rao, The Good News-Bad News Effect: Asymmetric Processing of
− Uri Gneezy, Deception: The Role of Consequences, 95 AM. ECON. REV. 384 (2005)
41
− Charles A.Holt & Angela M.Smith, An update on Bayesian updating, 69 J. ECON. BEHAV.
− Daniel Kahneman & Amos Tversky, Judgment under Uncertainty: Heuristics and Biases,
about Whether Acts Are Subject to Sanctions, J. L. ECON. & ORG. 93-128 (l990)
− Lance Lochner, Individual Perceptions of the Criminal Justice System, 97 AM. ECON.
REV. (2007)
Rational Choice Model of Theft and Violence, 71 AM. SOCIOL. REV. 95 (2006)
− Richard McKelvey & Talbot Page, Public and Private Information: An Experimental
− Daniel S. Nagin, Francis T. Cullen & Cheryl Lero Jonson, Imprisonment and
− Mitchell Polinsky & Steven Shavell, On the Disutility and Discounting of Imprisonment
− Raaj K. Sah, Social Osmosis and Patterns of Crime, 99 J. POLITICAL. ECON. 1272 (1991)
42
− Shaul Shalvi, Ori Eldar &Yoella Bereby-Meyer, Honesty Requires Time (and Lack of
− Steven Shavell, The Optimal Structure of Law Enforcement, 36 J.L. & ECON. 255 (1993).
− Cass Sunstein, Sebastian Bobadilla-Suarez, Stephanie Lazzaro & Tali Sharot, How
People Update Beliefs about Climate Change: Good News and Bad News,
43