Green 2013

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2013, 99, 3–13 NUMBER 1 (JANUARY)

HOW MANY IMPULSIVITIES? A DISCOUNTING PERSPECTIVE


LEONARD GREEN AND JOEL MYERSON
WASHINGTON UNIVERSITY

People discount the value of delayed and uncertain outcomes, and how steeply individuals discount is
thought to reflect how impulsive they are. From this perspective, steep discounting of delayed outcomes
(which fails to maximize long-term welfare) and shallow discounting of probabilistic outcomes (which fails
to adequately take risk into account) reflect the same trait of impulsivity. Despite the fact that a hyperboloid
function describes the discounting of both delayed and probabilistic outcomes, there is considerable
evidence that the two kinds of discounting involve different processes as well as separate impulsivity traits.
Several manipulations differentially affect delay and probability discounting, and correlational studies show
that how steeply one discounts delayed rewards is relatively independent of how steeply one discounts
probabilistic rewards. Moreover, people’s discounting of delayed money and health outcomes are
uncorrelated as are discounting of real, consumable rewards and hypothetical money. These results suggest
that even within delay discounting, there may be multiple ‘impulsivities,’ each of which may be important
for understanding a different aspect of decision making. Taken together, the pattern of findings reviewed
here argues for a more nuanced view of impulsivity than that which is usually assumed in discounting
research.
Key words: discounting, impulsivity, traits, delay, probability

When offered the choice, people usually about it, has become an important focus of much
would prefer to have more (rather than less) recent behavioral research. Researchers in a
of what they like, they would rather have it number of fields (including economics, genet-
sooner (rather than later), they would like to pay ics, neuroscience, pharmacology, and psycholo-
less (rather than more), and they would prefer to gy) increasingly view people’s choices between
expend less effort getting it. However, the multidimensional alternatives from a discount-
choices we face daily are not usually one- ing perspective (e.g., Anokhin, Golosheykin,
dimensional. We do not choose just between Grant, & Heath, 2011; Frederick, Loewenstein, &
more and less, or sooner versus later. Rather, O’Donoghue, 2002; Kable & Glimcher, 2007;
outcomes are typically multidimensional, and MacKillop, Amlung, Few, Ray, Sweet, & Munafò,
tradeoffs are necessary. For example, one can 2011; Madden & Bickel, 2010), in which variation
work harder to get more, or choose to exert less along one dimension (e.g., delay) is associated
effort but get less. There are not necessarily with the discounting of another dimension (e.g.,
correct choices in such situations, but there are amount).
consequences, and these consequences can be We begin with the hyperboloid function that
personal, interpersonal, or even societal in describes the discounting of delayed and
nature. In large part because of these conse- probabilistic outcomes and present a mathe-
quences, research on how people make such matical derivation of that function as it applies
tradeoffs, what it says about them as individuals, to delay discounting. Next, we discuss the
and in some cases at least, what can be done similarities and differences between delay
and probability discounting and argue that
Support was provided by NIH Grant RO1 MH055308. The there is converging evidence that these two
article is based on a talk given at the Association for Behavior kinds of discounting involve different processes
Analysis International’s Behavioral Economics Conference: as well as separate ‘impulsivities’. We argue
From Demand Curves to Public Policy, Chicago, IL, March further that although there may be groups of
2011. We thank members of the Psychonomy Cabal for their
assistance. We would like to express our gratitude to Maria individuals who are both impatient and risk-
Malott and her staff for their efforts in coordinating the taking, there also are groups who are impatient
conference and our appreciation to the ABAI Science Board and risk-averse, and that in any case, the
for sponsoring it. existence of such groups, although important
Address correspondence to Leonard Green, Washington
University, Department of Psychology, Campus Box 1125,
from a number of perspectives, is not necessar-
St. Louis, MO 63130 (e-mail: LGreen@wustl.edu). ily relevant to understanding the nature of
doi: 10.1002/jeab.1 impulsivity in the general population.

3
4 LEONARD GREEN and JOEL MYERSON

We present evidence that even within delay tively. In order to show discounting of different
discounting, and perhaps within probability reward amounts on the same scale, the subjec-
discounting as well, there are important dis- tive value of each delayed or probabilistic reward
tinctions to be drawn between the way different is plotted as a proportion of its nominal amount.
types of rewards are discounted, suggesting Note that amount has opposite effects on how
the existence of even more ‘impulsivities’. steeply delayed and probabilistic rewards are
For example, different types of rewards (e.g., discounted: Larger delayed amounts are dis-
money, food) may be discounted at different counted less steeply than smaller delayed
rates, even if the rewards are matched on utility. amounts (e.g., $40,000 vs. $200 in Fig. 1),
In addition, the degree to which an individual whereas smaller probabilistic amounts are dis-
discounts a particular type of reward, relative to counted less steeply than larger probabilistic
how steeply others discount that type of reward, amounts.
sometimes predicts how steeply that individual The typical procedure in studies of delay
will discount another type of reward; in other discounting where the choice is between an
cases, however, there is little or no correlation immediate reward and a larger, later reward, is
between how steeply individuals discount re- to adjust the amount of the immediate reward
wards of different types. Taken together, such until it and the delayed reward are equally likely
findings argue for a more nuanced view of to be chosen. The amount of immediate reward
impulsivity than one that views impulsivity at this indifference point is taken as the
simply in terms of how steeply an individual subjective value of the delayed reward. So, too,
discounts. Finally, we consider the implications when the choice is between a certain reward and
of this view for future research. a larger, probabilistic reward, the amount of the
certain reward is adjusted until both alternatives
are equally likely to be chosen, and the amount
Derivation and Interpretation of Hyperboloid of certain reward at indifference is taken as the
Discounting Functions subjective value of the probabilistic reward.
This hyperboloid discounting function was
To date, discounting research has focused first used to describe the discounting of delayed
primarily on the tradeoff between delay and rewards, and its derivation by Myerson and
amount of reward and the tradeoff between Green (1995) was based on the assumption that
probability and amount. In such tradeoffs, people (and other animals) choose between
discounting refers to the tendency for a delayed rates of reward and that no reward, even an
or a probabilistic reward to be valued less than a ‘immediate’ one, is instantaneous. That is, if one
comparable amount of reward that could be alternative provides a smaller amount of reward,
received sooner or with greater certainty. The AS, sooner (i.e., after some minimal delay of
value of a delayed or uncertain reward is m time units) and the other alternative provides
described as being discounted relative to its a larger amount of reward, AL, later (i.e., after a
nominal amount, and the extent to which such delay of m þ D time units), then at indifference,
rewards are discounted increases systematically AS/m ¼ AL/(m þ D). Rearranging reveals that
as a function of how delayed or how unlikely they the value of the delayed reward relative to its
are. This systematic decrease in subjective value nominal amount, AS/AL, is equal to m/(m þ D),
is well described by the hyperboloid function, and dividing both the numerator and the
denominator of the right side of the equation
V ¼ A=ð1 þ bX Þs ; ð1Þ by m, one obtains the familiar hyperbolic
discounting function: AS/AL ¼ 1/(1 þ D/m),
where 1/m corresponds to the parameter b in
where V represents the subjective value of a Equation 1. Note that as m increases, the rate of
delayed or probabilistic reward of amount A, X is discounting (as indexed by the b parameter)
the delay until or odds against its receipt, and b decreases.
and s are free parameters (Green & Myerson, It is generally assumed that quantities like
2004). Fits of Equation 1 to delay and probability amount and delay are nonlinearly scaled and
discounting data (taken from a study by Estle, that such scaling is described by a power
Green, Myerson, & Holt, 2006) are presented in function (Stevens, 1957). It follows from this
the top and bottom panels of Figure 1, respec- assumption that ASa/ALa ¼ md/(m þ D)d ¼
HOW MANY IMPULSIVITIES? A DISCOUNTING PERSPECTIVE 5

1.0 by adding a common delay before receipt of


both the smaller or larger reward, the rate
0.8 of discounting decreases (Calvert, Green, &
Subjective Value

Myerson, 2011; Green, Myerson, & Macaux,


0.6 2005). Second, the s parameter remains con-
stant when the amount of the delayed reward is
0.4 varied across a wide range (Estle et al.,
2006; McKerchar, Green, & Myerson, 2010),
0.2 consistent with the psychophysical scaling
interpretation.
0.0 Although an analogous interpretation of the
0 50 100 150 200 250 probability discounting function is possible,
consideration of the effect of reward amount
Delay (months)
on the s parameter of the function argues
1.0 against such an interpretation. That is, as the
amount of the probabilistic reward is increased,
0.8 the s parameter increases systematically, rather
Subjective Value

$40K than remaining constant as in the case of delay


0.6 $200 discounting (Estle et al., 2006; Myerson, Green,
& Morris, 2011) and as the psychophysical
0.4 scaling interpretation would predict. This find-
ing may be interpreted in terms of probability
0.2
weighting, a concept introduced by Kahneman
and Tversky (1979) in their prospect theory
0.0
account of decision making under risk, al-
0 5 10 15 20 though they did not view such decision making
as being amount-sensitive in this way.
Odds Against Notably, increasing the amount of probabilis-
tic reward appears to increase the degree of
Fig. 1. Relative subjective value as a function of the delay
until (upper panel) and the odds against (lower panel)
discounting by increasing the s parameter, while
receiving a smaller ($200) and a larger ($40,000) reward. the b parameter remains constant, whereas
Curves represent the best-fitting hyperboloid discounting increasing the amount of delayed reward
functions (Eq. 1). Data are from Experiments 1 and 2 of appears to decrease the degree of discounting
“Differential Effects of Amount on Temporal and Probability by decreasing the b parameter, while the s
Discounting of Gains and Losses,” by S. J. Estle, L. Green, J.
Myerson, and D. D. Holt, Memory & Cognition, 34, p. 926. parameter remains constant. These differential
Copyright 2006 by the Psychonomic Society, Inc. Reprinted effects of reward amount on delay and proba-
with permission. bility discounting functions, along with other
evidence to be described below, demonstrate
that different processes must be involved in
1/(1 þ D/m)d/a, which may be rewritten as delay and probability discounting (Green &
AS =AL ¼ 1=ð1 þ D=mÞs , where s is the ratio of Myerson, 2010).
the exponents of the power functions describing
the scaling of delay and amount. Note that the Delay and Probability Discounting
preceding equation is equivalent to Equation 1, as Separate Impulsivities
the hyperboloid discounting function, rewritten
in terms of relative subjective value (i.e., the The fact that delay and probability discount-
subjective value of a delayed reward expressed ing involve different processes has important
as a proportion of its nominal amount). When implications for our understanding of the
s ¼ 1.0, the equation reduces to a simple relation between discounting and impulsivity.
hyperbola (Mazur, 1987). Steep delay discounting, in particular, has often
Support for the interpretation of the delay been associated with impulsive decision making,
discounting function implicit in the preceding as reflected in an inability to delay gratification.
derivation comes from two findings. First, when Consistent with this view, abusers of a wide
the duration of m is experimentally manipulated variety of psychoactive substances, ranging from
6 LEONARD GREEN and JOEL MYERSON

cigarette smokers to heroin addicts, have been impulsive individuals are greater risk takers, they
shown repeatedly to discount delayed rewards should be less sensitive to the odds against
more steeply than controls (Yi, Mitchell, & winning and discount probabilistic rewards less
Bickel, 2010). In addition to showing steep delay steeply. Although other studies have found no
discounting, one might expect individuals who difference between smokers and controls
engage in impulsive decision making to show (Mitchell, 1999; Ohmura & Takahashi, 2005),
greater than average risk taking, which would be this result, too, is inconsistent with the predic-
reflected as insensitivity to the odds against tion of a unitary impulsivity trait involving
winning a gamble. This insensitivity, in turn, impatience and risk taking.
would be manifested as shallow probability The failure to find shallower probability
discounting. discounting in presumably impulsive cigarette
The idea that impulsive individuals are both smokers would appear to pose a serious problem
risk takers and unable to delay gratification for a definition of impulsivity that incorporates
would predict a negative correlation between both an inability to delay gratification and a
probability and delay discounting. That is, tendency toward risk taking. If probability
shallow discounting of probabilistic rewards is discounting were not a valid measure of risk
a form of risk taking, whereas steep delay taking, of course, then this failure would not be a
discounting may reflect an inability or unwilling- problem. However, probability discounting
ness to wait for gratification. Nevertheless, the appears to be a valid measure, as evidenced by
evidence is inconsistent with the idea of a single the finding that gamblers do show shallower
trait of impulsivity, one that involves both risk probability discounting than controls (Holt,
taking and impatience, where a trait is defined as Green, & Myerson, 2003; Madden, Petry, &
an enduring behavioral tendency that manifests Johnson, 2009). Moreover, some studies have
itself in multiple, diverse situations. In the reported that gamblers discount delayed re-
present case, such situations would include those wards more steeply than controls (Dixon,
in which one has to choose between smaller Marley, & Jacobs, 2003; Petry, 2001; but see
rewards available sooner and larger rewards Holt et al., 2003), and this result is somewhat
available later, as well as those in which one has more supportive of the idea that an inability to
to choose between smaller rewards available delay gratification goes with greater risk taking.
with a higher likelihood and larger rewards In contrast, data from obese women with binge-
available with a lower likelihood. In contrast to eating disorder (BED), who steeply discount
the negative correlation predicted by a unitary both delayed and probabilistic rewards
trait of impulsivity, numerous studies have (Manwaring, Green, Myerson, Strube, & Wilfley,
reported that the actual correlation is either 2011), are inconsistent with this idea.
not significant or even weakly positive (e.g., Thus, no simple pattern emerges from the
Myerson, Green, Hanson, Holt, & Estle, 2003; data from special groups with respect to the
Ohmura, Takahashi, Kitamura, & Wehr, 2006; relation between delay and probability discount-
Olson, Hooper, Collins, & Luciana, 2007; ing. We would argue, however, that studies
Richards, Zhang, Mitchell, & de Wit, 1999; Shead involving special groups (e.g., women with BED,
& Hodgins, 2009). smokers, gamblers) actually address a different
Another way to examine the relation between question than that addressed by correlational
impulsivity and probability discounting would analyses of data from the general population.
be to take individuals who are known to be This may be seen in the scatterplot shown in
impulsive on other grounds and see if their Figure 2, which depicts hypothetical data from
probability discounting differs from controls. the general population showing a weak positive
For example, studies that examine probability correlation between delay and probability dis-
discounting in cigarette smokers, a particular counting like that which has been reported
group of substance abusers known to show (e.g., Myerson et al., 2003). As is apparent from
steeper than normal delay discounting, fall into the scatterplot, despite the weak correlation
this category. Some studies have found steeper there would still be individuals who showed
probability discounting by smokers (Reynolds, extreme tendencies, and those individuals who
Richards, Horn, & Karraker, 2004; Yi, Chase, & showed similar extreme tendencies with respect
Bickel, 2007), the exact opposite of what one to discounting might well show similar behav-
would predict based on the view that because ioral problems.
HOW MANY IMPULSIVITIES? A DISCOUNTING PERSPECTIVE 7

does not inform us about the nature of the


relation in the general population, the relation
Risk Aversion

between delay and probability discounting in


the overall distribution does not preclude the
Probability Discounting

existence of such extreme groups, nor does it


prevent those with extreme tendencies from
experiencing the consequences of those ten-
dencies. In the present case, the fact that there is
no unitary trait of impulsivity (as evidenced by
the fact that delay and probability discounting
are not negatively correlated and the fact that
Risk Taking

there exist groups, such as obese women with


BED, who exhibit impatience while being very
risk averse) does not mean that there are not
groups whose members exhibit multiple “im-
pulsivities,” nor does it mean that the members
Patience Impatience of such groups may not have special problems as
Delay Discounting a result of their multiple impulsivities.

Fig. 2. Probability discounting as a function of delay Discounting of Different Types of


discounting. Each data point represents how steeply a
particular individual drawn from a hypothetical population Outcomes as Separate Impulsivities
distribution discounts delayed and probabilistic rewards.
The solid squares represent a group of individuals who Further evidence for the existence of multiple
steeply discount both delayed and probabilistic rewards, impulsivities comes from studies that have
reflecting both impatience and risk aversion, respectively; focused only on delay discounting but have
the solid circles represent a group of individuals who steeply examined the discounting of different types of
discount delayed rewards but shallowly discount probabilis-
tic rewards, reflecting impatience and risk taking,
delayed rewards. For example, a number of
respectively. studies have shown that although individuals
discount both delayed health benefits and
financial gains, individuals’ discount rates for
For example, the solid circles in the lower health gains are largely independent of their
right quadrant of Figure 2 represent hypotheti- discount rates for financial gains (e.g.,
cal individuals who, like the pathological Cairns, 1992). This finding was replicated by
gamblers with substance abuse problems stud- Chapman and Elstein (1995) who also showed
ied by Petry (2001), show steep discounting of that three independent factors described the
delayed rewards but shallow discounting of delay discounting of health, monetary, and
probabilistic rewards. In contrast, the solid vacation rewards (see also Foxall, Doyle, Yani-
squares in the upper right quadrant represent de-Soriano, & Wells, 2011). Moreover, in a series
hypothetical individuals who, like the obese of experiments, Chapman (1996) found that
women with BED studied by Manwaring et al. even within a type of outcome (i.e., money,
(2011), show steep discounting of both proba- health), the correlations between gains and
bilistic and delayed rewards. Data from these two losses were relatively weak. For example, writing
groups speak not to the relation between delay in regard to the final experiment in the series,
and probability discounting but rather to their Chapman noted that the correlations between
consequences. Those who discount both de- outcomes of the same type and the same sign
layed and probabilistic rewards steeply are likely (i.e., gains, losses) averaged .71, whereas corre-
to have one set of problems, whereas those who lations within a type of outcome but between
discount one steeply but the other very shallowly signs averaged only .28.
may have different problems, yet all may come This is not to say that the rates at which
from the same overall distribution. individuals discount different types of rewards
Importantly, the same conclusions would always are uncorrelated or only weakly correlat-
follow if the distribution depicted in Figure 2 ed. For example, Table 1 presents the results of a
showed a negative correlation or no correlation factor analysis as well as the correlation matrix
at all. Although the existence of extreme groups based on data from a study by Estle, Green,
8 LEONARD GREEN and JOEL MYERSON

Table 1
Factor analysis (Varimax rotation) results and intercorrelations among different types of delayed and
probabilistic rewards (based on data from Estle et al., 2007; n ¼ 47).

Reward Prob. Delay Prob. Prob. Prob. Prob. Delayed Delayed Delayed
Type Factor Factor Money Candy Soda Beer Money Candy Soda

Probabilistic
Money .817 .024
Candy .819 .286 .482
Soda .818 .168 .530 .463
Beer .765 .064 .650 .459 .411
Delayed
Money .056 .770 .055 .110 .173 .031
Candy .335 .766 .272 .510 .294 .307 .456
Soda .231 .868 .166 .463 .319 .214 .507 .718
Beer .098 .831 .170 .249 .175 .200 .521 .539 .698
Note: r  .29, p < .05; r  .38, p < .01; r  .47, p < .001.

Myerson, and Holt (2007) of the delay and the differential effects of reward amount on
probability discounting of money and three delay and probability discounting already dis-
directly consumable rewards (candy, soda, cussed. Yet another approach to this issue is to
beer). As may be seen, our reanalysis of Area- examine whether different types of outcomes
under-the-Curve discounting measures from are discounted at different rates. For example,
the Estle et al. (2007) study provides further consider the shallower discounting of delayed
evidence that the rates at which individuals money, relative to delayed consumable rewards
discount delayed rewards and the rates at which (Odum & Rainaud, 2003). This finding was
they discount probabilistic rewards are relatively replicated in the study by Estle et al. (2007), who
independent. All four delayed rewards loaded also found that while delayed money and
strongly (all >.76) on one factor, whereas all consumable rewards were discounted at differ-
four probabilistic rewards loaded strongly (all ent rates, no such differences between types of
>.76) on a separate factor. These two separate rewards were observed when money and
factors reflect the fact that the correlations consumable rewards were probabilistic. This
among the different types of delayed rewards may be seen in Figure 3. The left panel shows
(median r ¼ .530) and among the different that delayed money was discounted much more
types of probabilistic rewards (median r ¼ .473) shallowly than delayed consumable rewards of
both tended to be stronger than the correlations similar monetary value; in contrast, the right
between delayed and probabilistic rewards panel shows that probabilistic money and
(median r ¼ .207). Although there was a probabilistic consumable rewards were dis-
tendency for those who steeply discount delayed counted at equivalent rates.
candy and soda to also steeply discount proba- An exceptionally clear case of the need to
bilistic candy and soda (contrary to what would distinguish between the discounting of different
be expected from the perspective of a unitary types of rewards was recently reported by Jimura,
impulsivity trait), the degree to which partic- Myerson, Hilgard, Keighley, Braver, and Green
ipants discounted delayed money or beer did (2011). Jimura et al. found that delayed real
not predict the degree to which they discounted liquid rewards were discounted at an extremely
probabilistic money or beer. steep rate, losing half their value when delayed by
The question of whether individuals who less than a minute, whereas the rates of discount-
steeply discount one type of reward or outcome ing delayed monetary rewards were orders of
steeply discount other types of rewards or magnitude lower than those for liquid rewards.
outcomes is one way of approaching the issue When young and older adult participants were
of how many impulsivities there are. Another assessed again several weeks later, the steep
approach is to look at whether experimental discounting rates for liquid rewards showed
manipulations or environmental changes have high test–retest reliability, as did the rates at
similar effects on discounting, as in the case of which they discounted the hypothetical monetary
HOW MANY IMPULSIVITIES? A DISCOUNTING PERSPECTIVE 9

1.0 1.0

0.8 0.8 Money


Subjective Value

Soda
Beer
0.6 0.6 Candy

0.4 0.4

0.2 0.2

0.0 0.0
0 6 12 18 24 30 36 0 2 4 6 8

Delay (months) Odds Against


Fig. 3. Relative subjective value as a function of the delay until (left panel) and the odds against (right panel) receiving
different types of rewards. Curves represent the best-fitting hyperboloid discounting functions (Eq. 1). Data are from the
large amount condition of “Discounting of Monetary and Directly Consumable Rewards,” by S. J. Estle, L. Green, J. Myerson,
and D. D. Holt, Psychological Science, 18, p. 60. Copyright 2007 by Blackwell Publishers, Ltd. Reprinted with permission.

rewards. Despite the high reliability of both liquid rewards (like money) that serve an exchange
and monetary discount rates, the two were function from those that serve a direct metabol-
uncorrelated: Those who steeply discounted ic function (Charlton & Fantino, 2008). Others
monetary rewards did not necessarily discount have suggested that with some types of rewards,
liquid rewards steeply—they might or might not, visceral factors are more likely to affect inter-
but individuals’ discounting of one type of reward temporal choice as well as other aspects of
was not at all predictable from their discounting decision making, whereas other types of rewards
of the other type. We believe that these kinds of are usually associated with more deliberative or
distinctions may have much to tell us about the “cool” decision making (Loewenstein, 1996;
nature of discounting, in part because they Metcalfe & Mischel, 1999).
suggest that even within delay discounting, there It may be noted, however, that even if these
may be multiple impulsivities, each of which is distinctions prove useful, it is not clear how they
important for understanding a different aspect of apply to delayed rewards as diverse as health,
decision making. vacations, and money, all of which, at the group
level, are discounted at different rates, and for
Future Directions which, at the individual level, the rate at which
one discounts a particular reward type is a poor
Further research will be needed to determine predictor of the rate at which one will discount
not just which types of reward are discounted at another type (Chapman, 1996; Foxall et al.,
similar rates at the group level, but also what 2011). To complicate matters even more, the
determines when the discounting of one type of categories that are useful for distinguishing
outcome will predict the discounting of another different types of delayed reward may not always
type at the individual level. Several suggestions apply to probabilistic rewards, as evidenced by
as to how rewards might be categorized have the findings of Estle et al. (2007; see Table 1 and
been offered, such as distinguishing monetary Figure 3). The fact that different categories may
and other fungible rewards from directly be needed for delayed and probabilistic rewards
consumable rewards (Estle et al., 2007; Odum argues that the real basis for distinguishing
& Rainaud, 2003) or distinguishing between rewards may reside not in the commodity alone,
10 LEONARD GREEN and JOEL MYERSON

but rather in the interaction between the either regard can cause people real problems,
commodity and the type of decision. and thus it would not be surprising if people who
To date, basic research on discounting has are extreme in both regards were also likely to
focused largely on determining basic laws: the have problems. Nevertheless, that does not make
forms of the delay and probability discounting impatient risk-takers a natural kind—a personal-
functions, and the ways in which experimental ity type consisting of “impulsive” people. Rather,
manipulations (and differences between choice we would argue, such people are characterized
situations outside the laboratory) affect the rates by at least two “impulsivities.” An important
at which delayed and probabilistic rewards are implication of the “multiple impulsivities” view is
discounted (for reviews, see Frederick et al., that there may not be a magic bullet for treating
2002; Green & Myerson, 2004). Discounting impulse-control disorders involving both impa-
research has been quite successful with this tience and risk taking, if only because this view
“natural laws” strategy, but at least two separate suggests there may be at least two targets to be
sets of laws appear to be emerging (Myerson hit. Indeed, the existence of multiple impulsiv-
et al., 2011): one law for delay discounting (Eq. 1 ities may mean that there are multiple ways for
with b as a function of amount of delayed people to get into multiple kinds of trouble.
reward), and another for probability discount- Of particular importance from this multiple-
ing (Eq. 1 with s as a function of amount of impulsivities perspective is the discounting of
probabilistic reward). losses. This topic, which has received relatively
As we have noted already, however, the little attention to date, is especially important for
differences between delay and probability dis- two reasons. First, basic research indicates
counting appear to be one instance (albeit an important similarities between the discounting
important one) of a more general situation, and of gains and losses (e.g., delay and probability
we are coming to the point at which the focus discounting of losses are both well described by
needs to be expanded so as to include not only the hyperboloid discounting function, Eq. 1),
discovering “natural laws” but also determining but there are important differences, as well.
what are the “natural kinds.” The need to Second, delayed and probabilistic losses appear
discern “the natural lines of fracture along to play a major role in many of the behavior
which behavior and environment actually problems attributed to impulsivity.
break,” as Skinner (1938, p. 33) put it when With regard to the differences between the
discussing the generic nature of the concepts of discounting of gains and losses, delayed losses
stimulus and response, is a recurrent one in are discounted less steeply than delayed gains,
science. Natural laws describe the relations and similarly, probabilistic losses are discounted
between natural kinds (e.g., different physical less steeply than probabilistic gains (Estle et al.,
dimensions and different types of outcomes), 2006; Mitchell & Wilson, 2010). Moreover, while
and thus discovering the boundary conditions delayed and probabilistic gains both show
that define a natural kind is a necessary part of magnitude effects (albeit in opposite direc-
discovering laws. Indeed, the present discussion tions), the amount of loss has relatively little
could be considered a review of the boundary effect on the rate of either delay or probability
conditions that are apparent so far. discounting (Estle et al., 2006; Mitchell &
As noted above, the clearest case of natural Wilson). Further, although with gains, delay
kinds requiring different laws is that involving and probability discounting tend, at best, to be
delay and probability discounting. It has become weakly positively correlated, with losses, delay
increasingly apparent that choosing between an and probability discounting have been reported
immediate and a delayed reward (or smaller, to be negatively correlated (Shead, Callan, &
sooner and larger, later rewards) and choosing Hodgins, 2008; Shead & Hodgins, 2009), but not
between a certain and a probabilistic reward (or always significantly so (Mitchell & Wilson).
between smaller, more likely and larger, less Although more research, including studies
likely rewards) represent choices involving that compare discounting of different kinds of
different natural kinds. This is apparent both losses, obviously is needed, what is known
with respect to the laws that describe them and strongly suggests that with respect to both traits
the “traits” they represent. Referring to both and processes, there are fundamental differ-
impatience and risk taking as ‘impulsivity’ may ences in the discounting of gains and the
serve only to indicate that being extreme in discounting of losses.
HOW MANY IMPULSIVITIES? A DISCOUNTING PERSPECTIVE 11

Moreover, the discounting of delayed and Conclusions


probabilistic losses would appear to be at least as
relevant to behavioral problems that have been Despite the fact that a hyperboloid function
attributed to impulsivity as is the discounting of (Eq. 1) describes the discounting of delayed and
gains. Consider the problem of substance abuse. probabilistic outcomes (both gains and losses),
One could argue that the reason it is a problem there is considerable evidence that the two kinds
is not because substance abusers, by choosing of discounting involve different processes as well
immediate rewards, are failing to maximize as separate impulsivities. Although there may be
their long-term gains. Rather, the real reason groups of individuals who are both impatient
why substance abuse is a problem, for the and risk taking, there also are groups who are
individual and for society, is because substance impatient and risk averse, and in any case, the
abusers discount both the possibility of relatively existence of such groups is not necessarily
immediate, but highly negative probabilistic relevant to the question of whether impulsivity
outcomes (e.g., arrest, overdose) as well as the is a unitary trait.
delayed negative consequences of their behav- Personality researchers have long argued that
ior (e.g., problems with family relationships, loss what they often term impulsiveness (rather than
of employment). impulsivity) is multifactorial in nature (e.g.,
Consider the problem of getting clean and Patton, Stanford, & Barratt, 1995; for a review,
sober from the perspective of delay discount- see Evenden, 1999). Indeed, when Kirby and
ing. A substance abuser might decide that he Finch (2010) recently factor-analyzed self-report
would quit the following week, at which point responses to questions from different personality
he would experience the aversive (but time- tests representing all previously proposed dimen-
limited) consequences of abstinence, rather sions of impulsiveness, they obtained at least seven
than continue to use drugs and experience the interpretable factors. Discounting of delayed
larger, but later (and perhaps longer lasting) monetary rewards loaded on only one of these
negative consequences of drug use for his social factors (which they termed Impatiently Pleasure
and family relationships. Despite having made Seeking). Which factor the discounting of proba-
this decision, come the next week he might bilistic monetary rewards would load on, if it did at
choose to continue to use drugs. This choice all, is not known. Nor is it known how discounting
represents a preference reversal of the kind of negative outcomes (e.g., losses) or discounting
typically discussed with respect to choices of different kinds of positive and negative out-
between smaller, sooner and larger, later comes relate to the multiple factors that make up
rewards, but such preference reversals also impulsiveness as assessed by self-report.
have been observed with smaller, sooner and What we do know is that delay and probability
larger, later losses (Holt, Green, Myerson, & discounting represent separate factors, and that
Estle, 2008). within each, there are important distinctions to
We are not arguing that delayed rewards do be drawn at both the individual and group levels
not play a role in the present example. Rather, between the discounting of different types of
what we are suggesting is that delayed losses also outcomes. At the individual level, in some cases
could explain this behavior (Woolverton, Free- the degree to which one discounts a particular
man, Myerson, & Green, 2012), and regardless type of reward predicts how steeply one will
of whether one focuses on the delayed gains or discount another type of reward. In other cases,
the delayed losses, in both cases the preference however, there is little or no correlation between
reversal may be explained in terms of the the discounting of different types of rewards,
hyperboloid model. Although gains and losses indicating that these reward types are associated
both could be important in such a reversal, with separate impulsivities. At the group level,
which way the problem is viewed (whether in there are differences with regard to the rate at
terms of gains, or losses, or both) may affect which different rewards are discounted. Taken
success in solving it. Moreover, just as there are together, these differences at both the individu-
differences in the discounting of different types al and group levels argue that thinking about
of gains, there may well be differences in the impulsivity as if it were a unitary trait represents
discounting of different types of losses, differ- a vast over-simplification—instead, what is
ences that could prove to be important from needed is a much more nuanced view, even
both theoretical and applied perspectives. when the focus is just on discounting.
12 LEONARD GREEN and JOEL MYERSON

We believe that this situation should be Green, L., & Myerson, J. (2004). A discounting framework
viewed as an important scientific opportunity for choice with delayed and probabilistic rewards.
rather than as a limitation of the discounting Psychological Bulletin, 130, 769–792.
Green, L., & Myerson, J. (2010). Experimental and correla-
framework. Indeed, it is by working within the tional analyses of delay and probability discounting. In:
discounting framework that researchers have G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The be-
been able to examine the discounting of havioral and neurological science of discounting (pp. 67–92).
different outcomes in different choice situations Washington, DC: American Psychological Association.
Green, L., Myerson, J., & Macaux, E. W. (2005). Temporal
and identify differences that reflect fundamen- discounting when the choice is between two delayed
tal characteristics. Were it not for this common rewards. Journal of Experimental Psychology: Learning,
framework, the important distinctions revealed Memory, and Cognition, 31, 1121–1133.
so far might well have been obscured by Holt, D. D., Green, L., & Myerson, J. (2003). Is discounting
impulsive? Evidence from temporal and probability
differences in procedure and measurement.
discounting in gambling and non-gambling college
Finally, we would argue that a precise mapping students. Behavioural Processes, 64, 355–367.
of these fundamental behavioral distinctions is a Holt, D. D., Green, L., Myerson, J., & Estle, S. J. (2008).
prerequisite to discovering the multiple brain Preference reversals with losses. Psychonomic Bulletin &
mechanisms and the genetic bases for individual Review, 15, 89–95.
Jimura, K., Myerson, J., Hilgard, J., Keighley, J., Braver, T. S.,
differences in these mechanisms that presum- & Green, L. (2011). Domain independence and stability
ably underlie what appear to be multiple in young and older adults’ discounting of delayed
impulsivities. rewards. Behavioural Processes, 87, 253–259.
Kable, J. W., & Glimcher, P. W. (2007). The neural correlates
of subjective value during intertemporal choice. Nature
References Neuroscience, 10, 1625–1633.
Kahneman, D., & Tversky, A. (1979). Prospect theory: An
Anokhin, A. P., Golosheykin, S., Grant, J. D., & Heath, A. C. analysis of decision under risk. Econometrica, 47, 263–291.
(2011). Heritability of delay discounting in adolescence: Kirby, K. N., & Finch, J. C. (2010). The hierarchical structure
a longitudinal twin study. Behavior Genetics, 41, 175–183. of self-reported impulsivity. Personality and Individual
Cairns, J. A. (1992). Health, wealth and time preference. Differences, 48, 704–713.
Project Appraisal, 7, 31–40. Loewenstein, G. (1996). Out of control: Visceral influences
Calvert, A. L., Green, L., & Myerson, J. (2011). Discounting on behavior. Organizational Behavior and Human Decision
in pigeons when the choice is between two delayed Processes, 65, 272–292.
rewards: implications for species comparisons. Frontiers MacKillop, J., Amlung, M. T., Few, L. R., Ray, L. A., Sweet, L.
in Neuroscience, 5, 96. H., & Munafò, M. R. (2011). Delayed reward discount-
Chapman, G. B. (1996). Temporal discounting and utility ing and addictive behavior: A meta-analysis. Psychophar-
for health and money. Journal of Experimental Psychology: macology (Berl.), 216, 305–321.
Learning, Memory, and Cognition, 22, 771–791. Madden, G. J., & Bickel, W. K. (Eds.) (2010). Impulsivity:
Chapman, G. B., & Elstein, A. S. (1995). Valuing the future: The behavioral and neurological science of discounting.
Temporal discounting of health and money. Medical Washington, DC: American Psychological Association.
Decision Making, 15, 373–386. Madden, G. J., Petry, N. M., & Johnson, P. S. (2009).
Charlton, S. R., & Fantino, E. (2008). Commodity specific Pathological gamblers discount probabilistic rewards
rates of temporal discounting: Does metabolic function less steeply than matched controls. Experimental and
underlie differences in rates of discounting? Behavioural Clinical Psychopharmacology, 17, 283–290.
Processes, 77, 334–342. Manwaring, J. L., Green, L., Myerson, J., Strube, M. J., &
Dixon, M. R., Marley, J., & Jacobs, E. A. (2003). Delay Wilfley, D. E. (2011). Discounting of various types of
discounting by pathological gamblers. Journal of Applied rewards by women with and without binge eating
Behavior Analysis, 36, 449–458. disorder: Evidence for general rather than specific
Estle, S. J., Green, L., Myerson, J., & Holt, D. D. (2006). differences. The Psychological Record, 61, 561–582.
Differential effects of amount on temporal and pro- Mazur, J. E. (1987). An adjusting procedure for studying
bability discounting of gains and losses. Memory & delayed reinforcement. In M. L. Commons, J. E. Mazur,
Cognition, 34, 914–928. J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of
Estle, S. J., Green, L., Myerson, J., & Holt, D. D. (2007). behavior: Vol. 5. The effect of delay and of intervening events on
Discounting of monetary and directly consumable reinforcement value (pp. 55–73). Hillsdale, NJ: Erlbaum.
rewards. Psychological Science, 18, 58–63. McKerchar, T. L., Green, L., & Myerson, J. (2010). On the
Evenden, J. L. (1999). Varieties of impulsivity. Psychopharma- scaling interpretation of exponents in hyperboloid
cology, 146, 348–361. models of delay and probability discounting. Behavioural
Foxall, G. R., Doyle, J. R., Yani-de-Soriano, M., & Wells, V. K. Processes, 84, 440–444.
(2011). Contexts and individual differences as influen- Metcalfe, J., & Mischel, W. (1999). A hot/cool-system analysis
ces on consumers’ delay discounting. The Psychological of gratification: Dynamics of willpower. Psychological
Record, 61, 599–611. Review, 106, 3–19.
Frederick, S., Loewenstein, G., & O’Donoghue, T. (2002). Mitchell, S. H. (1999). Measures of impulsivity in cigarette
Time discounting and time preference: A critical review. smokers and non-smokers. Psychopharmacology, 146, 455–
Journal of Economic Literature, 40, 351–401. 464.
HOW MANY IMPULSIVITIES? A DISCOUNTING PERSPECTIVE 13

Mitchell, S. H., & Wilson, V. B. (2010). The subjective value Reynolds, B., Richards, J. B., Horn, K., & Karraker, K. (2004).
of delayed and probabilistic outcomes: Outcome size Delay discounting and probability discounting as
matters for gains but not for losses. Behavioural Processes, related to cigarette smoking status in adults. Behavioural
83, 36–40. Processes, 65, 35–42.
Myerson, J., & Green, L. (1995). Discounting of delayed Richards, J. B., Zhang, L., Mitchell, S. H., & de Wit, H. (1999).
rewards: Models of individual choice. Journal of the Delay or probability discounting in a model of impulsive
Experimental Analysis of Behavior, 64, 263–276. behavior: Effect of alcohol. Journal of the Experimental
Myerson, J., Green, L., Hanson, J. S., Holt, D. D., & Estle, S. J. Analysis of Behavior, 71, 121–143.
(2003). Discounting delayed and probabilistic rewards: Shead, N. W., Callan, M. J., & Hodgins, D. C. (2008).
Processes and traits. Journal of Economic Psychology, 24, Probability discounting among gamblers: Differences
619–635. across problem gambling severity and affect-regulation
Myerson, J., Green, L., & Morris, J. (2011). Modeling the expectancies. Personality and Individual Differences, 45,
effect of reward amount on probability discounting. 536–541.
Journal of the Experimental Analysis of Behavior, 95, 175– Shead, N. W., & Hodgins, D. C. (2009). Probability dis-
187. counting of gains and losses: Implications for risk
Odum, A. L., & Rainaud, C. P. (2003). Discounting of attitudes and impulsivity. Journal of the Experimental
delayed hypothetical money, alcohol, and food. Behav- Analysis of Behavior, 92, 1–16.
ioural Processes, 64, 305–313. Skinner, B. F. (1938). The behavior of organisms: An
Ohmura, Y., & Takahashi, T. (2005). Discounting delayed experimental analysis. New York: Appleton-Century.
and probabilistic monetary gains and losses by smokers Stevens, S. S. (1957). On the psychophysical law. Psychological
of cigarettes. Psychopharmacology, 182, 508–515. Review, 64, 153–181.
Ohmura, Y., Takahashi, T., Kitamura, N., & Wehr, P. (2006). Woolverton, W. L., Freeman, K. B., Myerson, J., &
Three-month stability of delay and probability discount- Green, L. (2012). Suppression of cocaine self-
ing measures. Experimental and Clinical Psychopharmacolo- administration in monkeys: Effects of delayed punish-
gy, 14, 318–328. ment. Psychopharmacology, 220, 509–517.
Olson, E. A., Hooper, C. J., Collins, P., & Luciana, M. (2007). Yi, R., Chase, W. D., & Bickel, W. K. (2007). Probability
Adolescents’ performance on delay and probability discounting among cigarette smokers and non-smokers:
discounting tasks: Contributions of age, intelligence, molecular analysis discerns group differences. Behavior-
executive functioning, and self-reported externalizing al Pharmacology, 18, 633–639.
behavior. Personality and Individual Differences, 43, 1886– Yi, R., Mitchell, S. H., & Bickel, W. K. (2010). Delay
1897. discounting and substance abuse-dependence. In
Patton, J. H., Stanford, M. S., & Barratt, E. S. (1995). Factor G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The
structure of the Barratt Impulsiveness Scale. Journal of behavioral and neurological science of discounting (pp. 191–
Clinical Psychology, 51, 768–774. 211). Washington, DC: American Psychological
Petry, N. M. (2001). Pathological gamblers, with and without Association.
substance abuse disorders, discount delayed rewards at
high rates. Journal of Abnormal Psychology, 110, 482– Received: November 9, 2011
487. Final Acceptance: May 31, 2012

You might also like