Download as pdf or txt
Download as pdf or txt
You are on page 1of 26

B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

available at www.sciencedirect.com

www.elsevier.com/locate/brainresrev

Review

Prefrontal cortex and drug abuse vulnerability: Translation to


prevention and treatment interventions

Jennifer L. Perrya,b , Jane E. Josepha,c , Yang Jiang a,d , Rick S. Zimmerman a,e ,
Thomas H. Kelly a,d , Mahesh Darnaa,f , Peter Huettl c ,
Linda P. Dwoskina,f , Michael T. Bardoa,g,⁎
a
Center for Drug Abuse Research Translation, University of Kentucky, Lexington, KY, USA
b
Department of Psychology, Kalamazoo College, Kalamazoo, MI, USA
c
Department of Anatomy and Neurobiology, University of Kentucky, Lexington, KY, USA
d
Department of Behavioral Science, University of Kentucky, Lexington, KY, USA
e
Department of Social and Behavioral Health, Virginia Commonwealth University, Richmond, VA, USA
f
Department of Pharmaceutical Sciences, University of Kentucky, Lexington, KY, USA
g
Department of Psychology, University of Kentucky, Lexington, KY, USA

A R T I C LE I N FO AB S T R A C T

Article history: Vulnerability to drug abuse is related to both reward seeking and impulsivity, two constructs
Accepted 2 September 2010 thought to have a biological basis in the prefrontal cortex (PFC). This review addresses
Available online 15 September 2010 similarities and differences in neuroanatomy, neurochemistry and behavior associated with
PFC function in rodents and humans. Emphasis is placed on monoamine and amino acid
Keywords: neurotransmitter systems located in anatomically distinct subregions: medial prefrontal
Anterior cingulate cortex cortex (mPFC); lateral prefrontal cortex (lPFC); anterior cingulate cortex (ACC); and orbitofrontal
Dopamine cortex (OFC). While there are complex interconnections and overlapping functions among
Drug abuse these regions, each is thought to be involved in various functions related to health-related risk
GABA behaviors and drug abuse vulnerability. Among the various functions implicated, evidence
Glutamate suggests that mPFC is involved in reward processing, attention and drug reinstatement; lPFC is
Impulsivity involved in decision-making, behavioral inhibition and attentional gating; ACC is involved in
Lateral prefrontal cortex attention, emotional processing and self-monitoring; and OFC is involved in behavioral
Medial prefrontal cortex inhibition, signaling of expected outcomes and reward/punishment sensitivity. Individual
Norepinephrine differences (e.g., age and sex) influence functioning of these regions, which, in turn, impacts
Orbitofrontal cortex drug abuse vulnerability. Implications for the development of drug abuse prevention and
Serotonin treatment strategies aimed at engaging PFC inhibitory processes that may reduce risk-related
behaviors are discussed, including the design of effective public service announcements,
cognitive exercises, physical activity, direct current stimulation, feedback control training
and pharmacotherapies. A major challenge in drug abuse prevention and treatment rests
with improving intervention strategies aimed at strengthening PFC inhibitory systems among
at-risk individuals.
© 2010 Elsevier B.V. All rights reserved.

⁎ Corresponding author. Center for Drug Abuse Research Translation, University of Kentucky, 741 S. Limestone, BBSRB, Room 447,
Lexington, KY 40536-0509, USA. Fax: + 1 859 257 5750.
E-mail address: mbardo@uky.edu (M.T. Bardo).

0165-0173/$ – see front matter © 2010 Elsevier B.V. All rights reserved.
doi:10.1016/j.brainresrev.2010.09.001
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 125

Contents

1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
2. Prefrontal cortex (PFC) areas across species . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
2.1. Rodent PFC anatomy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
2.2. Human PFC anatomy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
3. PFC involvement in drug abuse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
3.1. Medial prefrontal cortex (mPFC). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
3.2. Lateral prefrontal cortex (lPFC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130
3.3. Anterior cingulate cortex (ACC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130
3.4. Orbitofrontal cortex (OFC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
4. Neurochemistry of PFC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
4.1. Dopamine (DA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
4.2. Serotonin (5-HT) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
4.3. Norepinephrine (NE) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
4.4. Glutamate. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
4.5. GABA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134
5. Age- and sex-related differences in PFC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134
5.1. Developmental differences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134
5.2. Sex differences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135
6. Translation to applied interventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136
6.1. Prevention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136
6.2. Treatment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138
7. Final comment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139

1. Introduction to punishment. These constructs are similar to “extraversion”


and “constraint” defined by Depue and Collins (1999), and both
Drug abuse vulnerability is related to the personality trait of may underlie or contribute to impulsivity.
“sensation seeking,” as defined by the need for novel Similar to sensation seeking, impulsivity is a multi-faceted
experiences and a willingness to take risks for these experi- construct. Two aspects of impulsivity—impulsive choice (choice
ences (Zuckerman, 1979). Using Cloninger's Novelty Seeking of a small, immediate reinforcer over a large, delayed
Scale or Zuckerman's Sensation Seeking Scale, high sensation reinforcer) and impulsive action (inability to stop a prepotent
seekers consistently use and abuse drugs more often than low behavior) predominate the drug abuse literature (Winstanley
sensation seekers assessed across various populations et al., 2010), and will be the focus of our discussion of
(Andrucci et al., 1989; Ball, 2004; Crawford et al., 2003; impulsivity. Impulsive choice may arise because of reward
Donohew et al., 1991; Kosten et al., 1994; Wills et al., 1994, seeking (i.e., the subject chooses the less advantageous small-
1998; Zuckerman, 1994). In controlled laboratory studies, high immediate reinforcer due to action readiness or an enhanced
sensation seekers are more sensitive than low sensation sensitivity to immediate reinforcement), or because of a lack
seekers to the rewarding effects of abused drugs (Fillmore et of inhibitory control (i.e., the subject chooses a small-
al., 2009; Kelly et al., 2006; Stoops et al., 2007). The association immediate reinforcer because they are not able to inhibit the
between sensation seeking and drug use has led investigators desire for the immediate reinforcer). Similarly, impulsive
to develop more effective anti-drug prevention messages that action may arise from reward seeking (i.e., the action
specifically target high sensation seekers (Donohew et al., readiness or enhanced sensitivity of a subject propels them
1998; Palmgreen et al., 2001). To the extent that sensation into action, even when such action may be disadvantageous)
seeking is biologically-based, a comprehensive understanding or lack of inhibitory control (i.e., subject cannot inhibit
of the neural mechanisms underlying this trait may enhance prepotent responses). Because both impulsive choice and
the design and implementation of targeted interventions. impulsive action have operational measures that allow for
Sensation seeking does not represent a single construct, between-species translation and have been studied frequently
but instead represents at least two component constructs that with respect to drug abuse, these constructs provide insight
can be designated as reward seeking and inhibitory control, each into the relationship between sensation seeking and drug
contributing to drug abuse vulnerability (Baler and Volkow, abuse, as well as the associated neural systems.
2006; Bechara, 2005; Dawe and Loxton, 2004; de Wit and Reward seeking and inhibitory control are each subserved
Richards, 2004; Fillmore, 2003; Jentsch and Taylor, 1999). by a distinct neural system. With reward seeking, ascending
Reward seeking reflects positive incentive motivation and mesocorticolimbic dopamine (DA) projections emanating
action readiness, whereas inhibitory control refers to the from midbrain ventral tegmental area (VTA) to nucleus
general tendency to show response constraint and sensitivity accumbens and prefrontal cortex (PFC) represent an important
126 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

component of the neural circuitry (Bardo et al., 1996; Berridge Coronal


and Robinson, 1998; Kelley and Berridge, 2002; Wise, 1998), and
lfh
this reward circuitry is most dominant during the high-risk
adolescent period (Galvan et al., 2006). With inhibitory control,
various PFC subregions have been implicated, including
medial prefrontal cortex (mPFC), lateral prefrontal cortex
(lPFC), anterior cingulate cortex (ACC) and orbitofrontal cortex
(OFC). Since the biological connection between these traits and
drug abuse vulnerability cannot be assessed fully in human
subjects, this area of investigation has benefited from
controlled experiments using laboratory animal models.
The main purpose of this article is to review key findings
about the involvement of PFC subregions in drug abuse OB
vulnerability based on research from rodents and humans.
While various cortical and subcortical regions are involved in
drug abuse vulnerability, PFC is an important nexus where Sagittal
reward seeking and inhibitory control processes are integrated
(Kalivas and Volkow, 2005). Although several excellent basic
science reviews in rodents and humans have been published
previously (de Wit and Richards, 2004; Jentsch and Taylor,
1999; Kalivas et al., 2006), these reviews have not emphasized
potential applications for drug abuse prevention and treat-
ment. To the extent that the neural substrates of inhibitory
control are understood, it may be possible to tailor interven-
tions that engage inhibitory control processes among indivi-
duals who are at highest risk.

2. Prefrontal cortex (PFC) areas across species

A comprehensive review of PFC neuroanatomy and function is Fig. 1 – Illustrations showing medial prefrontal cortex (in red),
beyond the scope of the current review. However, there are anterior cingulate cortex (in yellow) and orbitofrontal cortex
anatomically-specific PFC subregions implicated in various (in gray) in rat brain viewed in coronal and sagittal planes.
cognitive processes related to risky behaviors. Although a Abbreviations: OB, olfactory bulb; Cb, cerebellum;
variety of nomenclatures and subdivisions of PFC structures lfh, longitudinal fissure of hemisphere; cc, corpus callosum;
have been described, the current review uses the general ac, anterior commissure; CPu, caudate putamen; LV, lateral
definitions described for both rodents and primates by Price ventricle; Th, thalamus; Hi, hippocampus. Figure based on
(2007). Price (2007) differentiates between two major PFC Dalley et al. (2004) and Paxinos and Watson (2005).
networks: the medial and orbital networks. The medial
network is viewed primarily as having visceromotor outputs,
in large part to nucleus accumbens shell. In contrast, the
orbital network is viewed primarily as sensory in nature, and other cortical areas (Dalley et al., 2004; Groenewegen et al.,
receiving input from sensory cortices and sending output to 1997). These projections are largely reciprocal—PFC projects to
striatum and associated nucleus accumbens core. substantia nigra, ventral tegmental area (VTA), amygdala,
The extent to which region-specific neurobehavioral pro- lateral hypothalamus, and hippocampus, as well as lateral
cesses are similar across species is controversial, primarily septum, mesencephalon, and autonomic regions of the
because PFC shows species-specific variation in size relative to brainstem (Dalley et al., 2004; Groenewegen et al., 1997).
other cortical areas (encephalization), anatomical cytoarchi- Because rodent cortex is exclusively agranular (compared to
tecture, neurochemistry and connectivity (Ongur and Price, primate cortex that is made up of agranular, granular, and
2000; Preuss, 1995). Rather than emphasizing cross-species dysgranular regions; Barbas and Pandya, 1989; Carmichael and
differences, this review instead will use a common nomencla- Price, 1994), equivalent areas are based on interconnections
ture where possible to allow for generalizing behavioral results between specific areas within PFC, as well as between PFC and
across rodents and primates. The nomenclature and other brain regions (Price, 2007; Rose and Woolsey, 1948).
corresponding anatomical features are illustrated in Figs. 1 Based on these interconnections, PFC can be divided into
and 2 for rat and human PFC, respectively. medial and orbital networks as described previously.
Rat mPFC often refers to various structures located along
2.1. Rodent PFC anatomy the medial wall of PFC (Dalley et al., 2004; Price, 2007). The
precentral cortex (PrC) and ACC together are often referred to
Rodent PFC receives projections from basal ganglia, substantia as dorsal mPFC, whereas the prelimbic (PrL), infralimbic (IL),
nigra, VTA, amygdala, lateral hypothalamus, hippocampus, medial orbital (MO), and ventral orbital (VO) cortices together
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 127

Dorsal Coronal

Ventral Sagittal

Fig. 2 – Illustrations showing medial prefrontal cortex (in red), lateral prefrontal cortex (in blue), anterior cingulate cortex
(in yellow) and orbitofrontal cortex (in gray) in human brain viewed in dorsal, ventral, coronal and sagittal planes.
Abbreviations: OB, olfactory bulb; Cb, cerebellum; lfh, longitudinal fissure of hemisphere; Oc, occipital cortex; cc, corpus
callosum; ox, optic chiasm; Hy, hypothalamus; py, pyramidal tract; po, pons. Figure based on Mai et al. (1997).

are referred to as ventral mPFC. Two additional structures are (Vertes, 2006). ACC and mPFC also receive dense projections
located more laterally—dorsal agranular insular (AID) and from hippocampus (Swanson, 1981; Tierney et al., 2004;
dorsolateral orbital (DLO) cortex. The inclusion of lateral Vertes, 2006). Together, both mPFC and ACC receive substan-
structures in mPFC may seem surprising (in fact, the AID is tial input from amygdala and other limbic areas (Price, 2007).
sometimes included in OFC; Schoenbaum et al., 2006), but Rat OFC is comprised of ventral lateral orbital (VLO), lateral
there appear to be extensive interconnections between AID orbital (LO), and ventral agranular insular (AIV) cortices (Price,
and PrL/IL areas, which also have strong connections to other 2007). In contrast to mPFC, these areas send few projections to
areas on the medial wall (Conde et al., 1995; Vertes, 2004). For hypothalamus or periaqueductal grey (Price, 2007). VLO and
the purpose of this review, we will demarcate mPFC (PrL + IL) LO project to central parts of caudate–putamen and to the
and ACC as separate PFC regions because, as discussed later, lateral part of nucleus accumbens shell (Schilman et al., 2008).
discrete lesions have dissociated the function of these two There are reciprocal connections between basolateral amyg-
regions. dala and areas within OFC (Kita and Kitai, 1990; Krettek and
mPFC is connected to other brain regions that have been Price, 1977). These regions also receive afferents from medial
implicated in drug abuse. For example, both PrL and IL project temporal lobe, ventral pallidum, and VTA (Groenewegen, 1988;
to amygdala, although IL projects to medial, basomedial, Krettek and Price, 1977; Ray and Price, 1992). Rat OFC is part of
cortical and central nuclei and PrL projects mainly to the the olfactory system, and also receives input from other
basolateral nucleus of amygdala (Vertes, 2004, 2006). PrL also sensory modalities (Price, 1985; Price, 2007).
sends projections to VTA and medial parts of dorsal striatum,
including nucleus accumbens (Vertes, 2004, 2006). mPFC sends 2.2. Human PFC anatomy
projections to hypothalamus and periaqueductal grey (Floyd
et al., 2000, 2001; Price, 2007), as well as to ACC and OFC, In humans, there have been various demarcations for
allowing for communication between different PFC regions different functional networks in PFC. The current review relies
128 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

primarily on the nomenclature outlined by Ridderinkhof et al. mitter systems, such as VTA, lateral tegmental area and locus
(2004b), which divides PFC into three main cytoarchitecturally coeruleus.
distinct divisions, namely medial, lateral and orbital. Within
the medial region, we will further demarcate mPFC and ACC,
as these regions likely represent similar structures in the rat 3. PFC involvement in drug abuse
and are relevant for drug abuse behaviors. One caveat to this
nomenclature is that human lPFC, consisting of dorsolateral As mentioned above, both medial and orbital PFC networks
and ventrolateral subregions, does not generalize directly to are implicated in drug abuse vulnerability. Each of these
rat based on connectivity (Price, 2007). In fact, it has been networks mediates reward-related behaviors in a different
suggested that lPFC may be unique to human and nonhuman way, but they appear to do so in both rodents and primates
primates (Brown and Bowman, 2002), and thus we used the (see Table 1). For example, mPFC monitors task contingencies.
term for humans, but not for rats (cf. Figs. 1 and 2). That is, when a particular response no longer yields reinforce-
The connections involving human mPFC, lPFC, ACC and ment, mPFC activation appears to be associated with altering
OFC are numerous. Although ACC is often considered part of behavior and orienting towards a new response in order to
the limbic system, its close anatomical and functional obtain reinforcement. In contrast, OFC activation is associated
connections with mPFC and other PFC regions makes it a with reward value and is important for reversal learning and
transitory region between cortical and limbic systems. Histor- inhibitory control. However, direct comparison of rodent and
ically, cingulate gyrus (including both anterior and posterior primate literature is difficult because the tasks used are often
extents) has been considered the main interface between species-specific. A challenge for future research will be
cortical regions and subcortical structures like hippocampus, develop more tasks that translate readily across rodents and
parahippocampal cortex, hypothalamus, and thalamus primates (e.g., go/no-go), and to continue to identify between-
(Papez, 1958). Indeed, cingulate gyrus communicates with species similarities in PFC structures.
these structures, but also has connections with amygdala and
brainstem. Importantly, cingulate gyrus is a target region for 3.1. Medial prefrontal cortex (mPFC)
DA projections originating in midbrain VTA as part of the
mesocorticolimbic DA pathway, which is strongly implicated In rats, mPFC activation is associated with “supervisory”
in reward seeking. Primate ACC is a large area that extends functions such as attention to stimulus features and task
posterior to about midway along the cingulate gyrus. While contingencies, attentional set-shifting, and behavioral flexi-
classification of this region is controversial, primate mPFC and bility (Dalley et al., 2004). For example, lesions to this area
ACC cuts across various Brodmann areas that have been impair performance when task contingencies change such
termed the rostral cingulate zone (RCZ; (Ridderinkhof et al., that a previously-reinforced response is no longer reinforced,
2004b). RCZ includes portions of both Brodmann areas 24 and and a new response is reinforced instead. mPFC is also
32, areas that correspond roughly to ACC and mPFC, respec- necessary for learning tasks with increased cognitive
tively, in rat. demands, such as those involving complex discriminations
Human lPFC is an extensive region often demarcated into and working memory (Frysztak and Neafsey, 1991, 1994;
several subregions, each of which is thought to play a role in Runyan and Dash, 2004), and it plays a role in extinction
inhibitory control. Ridderinkhof et al. (2004b) have demarcated (Lebron et al., 2004; Morgan and LeDoux, 1995; Morgan et al.,
three main lPFC subregions: (1) dorsolateral region, which 1993; Quirk et al., 2000), most likely through interactions with
includes Brodmann areas 8, 9 and 46; (2) ventrolateral region, hippocampus (Maren and Quirk, 2004).
which includes Brodmann areas 44 and 45; and (3) inferior PrL and IL subregions within mPFC appear to play distinct
frontal junction, which consists of posterior sulcus located roles in learning and impulsive action. IL may influence
between the medial and inferior frontal gyri, just anterior to habitual responding by inhibiting goal-directed actions, while
Brodmann area 6. These subregions, especially the dorsolat- PrL may maintain representations of goals and the relation-
eral region, have reciprocal connections to OFC. Although ship between actions and goals (Balleine and Dickinson, 1998;
there are no direct connections to primary motor cortex, lPFC Coutureau and Killcross, 2003; Killcross and Coutureau, 2003).
is heavily interconnected with premotor areas, which in turn Results from lesioning studies have also implicated PrL and IL
project to motor cortex and spinal cord, thus making it well in performance on 5-choice serial reaction time task (5CSRT),
situated to control a range of behaviors. which measures impulsive action, attention, and compulsivity
Human OFC receives inputs from numerous cortical and (Carli et al., 1983); the 5CSRT task is based on the continuous
subcortical areas and is highly interconnected with other PFC performance test of sustained and divided attention used in
regions. In both macaque and human brain, Brodmann area clinical settings (Beck et al., 1956). IL damage results in
47/12 has similar cytoarchitecturally distinct regions within impulsive action (i.e., increased premature responses), where-
OFC (Petrides and Pandya, 1999; Wallis, 2007). Functional as PrL damage results in compulsive (i.e., perseverative)
subdivisions within OFC can be demarcated according to the responding (Chudasama and Muir, 2001; Chudasama et al.,
sensory modality providing input to that region. In addition to 2003). PrL may also play a role in active inhibition of habitual
receiving information from visual, somatosensory, olfactory responses, suggesting a mutually inhibitory role for PrL and IL,
and gustatory modalities, OFC also receives visceral informa- and this active inhibition of habits may allow for more planful
tion. Similar to ACC, there are reciprocal connections with cognitive decision-making processes to guide behavior
hippocampus and amygdala. OFC also receives projections (Jentsch and Taylor, 1999). As would be expected, widespread
from midbrain nuclei associated with different neurotrans- damage to both IL and PrL results in a loss of goal-directed
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 129

Table 1 – Summary of some putative functions of mPFC (prelimbic and infralimbic), lPFC, ACC and OFC from rat and human
studies.
Brain Rat Human
region
Putative functions Example references Putative functions Example references

mPFC Reward processing Bardo et al. (1996) Reward processing Kerns et al. (2004)
Attention Cardinal et al. (2001) Attention Ridderinkhof et al. (2004a)
Impulsivity Coutureau and Killcross (2003) Conflict decision making
Drug reinstatement (prelimbic) McLaughlin and See (2003)
Habit learning (infralimbic)
lPFC N/A N/A Decision making Fuster (2008)
Attentional gating Shackman et al. (2009)
Impulsive action Wager et al. (2008)
Working memory
Emotion regulation
ACC Attention Dalley et al. (2004) Attention Fuster (2008)
Discrimination learning Dietrich and Allen (1998) Emotional processing Kringelbach and Rolls (2004)
Timing of reward McFarland et al. (2004) Self-Monitoring Posner et al. (2007)
Drug reinstatement Processing of social stimuli
OFC Behavioral inhibition Chudasama and Robbins (2003b) Behavioral Inhibition Cools et al. (2002)
Signaling expected outcomes Schoenbaum and Roesch (2005) Reward sensitivity (medial) Kringelbach and Rolls (2004)
Reversal learning Winstanley (2007) Punishment sensitivity (lateral) Liu et al. (2007)
Emotional decision-making
Reversal learning

Abbreviations: mPFC, medial prefrontal cortex; lPFC, lateral prefrontal cortex; ACC, anterior cingulate cortex; OFC, orbitofrontal cortex; N/A, not
applicable.

responding, as well as perseverative habitual responding RCZ is associated with sensitivity to reward contingencies (Ito
(Ragozzino et al., 1999). et al., 2003) and is modulated by DA (Holroyd and Coles, 2002).
A number of studies indicate that mPFC function is involved Anatomical studies in non-human primates and humans
in drug abuse behaviors related to impulsivity. Impulsive indicate subregions in RCZ (mPFC and ACC) have extensive
choice has been associated with both serotonin release and DA reciprocal interconnections (Bates and Goldman-Rakic, 1993;
receptor tone in mPFC (Winstanley et al., 2006b). Further, mPFC Koski and Paus, 2000), which may link short-term memory to
lesions increase impulsive choice on the delay discounting goal-directed action (Ridderinkhof et al., 2004b). mPFC neurons
task (Weissenborn et al., 1997). Individual differences in encode past reward-bearing choices (Paulus et al., 2002), thus
impulsive action on the 5CSRT task also predict faster rates providing an update of present reinforcement contingencies. As
of self-administration acquisition using cocaine (Dalley et al., a unit, RCZ activation is associated with conflicts, identification
2007; Perry et al., 2005, 2008) or nicotine (Diergaarde et al., 2008), of errors in choice tasks, and directing attention by recruiting
perhaps reflecting altered mPFC function. Together, these PFC, including OFC, to execute cognitive control (Ridderinkhof et
results implicate an involvement of mPFC in drug self- al., 2004a). Based on this information, one would anticipate that
administration and in both types of impulsivity. a dysfunction in mPFC, or RCZ more broadly, would impair
The involvement of mPFC in drug relapse has been evaluated monitoring of changes in reinforcement contingencies and
using the reinstatement model (see Shaham et al., 2003). Similar thus, would impair decision-making aimed at maximizing
to results cited previously, there is a differential involvement of positive outcomes. In the case of drug use, this could be
IL and PrL subregions within mPFC. Specifically, while inacti- expressed as a relative insensitivity to judging the value of
vation of PrL decreases cocaine- (Capriles et al., 2003), cue- drug and non-drug alternative reinforcers in a choice situation.
(McLaughlin and See, 2003), context- (Fuchs et al., 2005) and Some evidence indicates that drug abuse in humans is
stress- (Capriles et al., 2003) induced reinstatement of cocaine- associated with functional alterations in mPFC, which may
seeking, inactivation of IL has no effect (Capriles et al., 2003; play a role in the deficits in executive cognitive functioning
McFarland et al., 2004; McLaughlin and See, 2003). However, IL and gambling decisions typical among at-risk individuals
inactivation enhances spontaneous recovery of cocaine seeking (Fishbein et al., 2007). Acute cocaine administration increases
(Peters et al., 2008), suggesting that while PrL circuitry excites activity in various PFC regions (Breiter et al., 1997) and
drug-seeking in the presence of reinstating cues, IL circuitry has stimulant abusers show a general loss of gray matter across
an inhibitory influence on spontaneous recovery of drug- these various PFC regions (Matochik et al., 2003). With
seeking (Kalivas et al., 2006). reference to mPFC specifically, abstinent cocaine abusers
It is difficult to ascertain what preclinical information tested in the Iowa gambling task display less activity in left
described above translates directly to human mPFC function. mPFC, as well as right lPFC, compared to controls (Bolla et al.,
Neuroimaging results support the idea that human mPFC is 2003), which may relate to the deficits in decision-making and
involved in evaluation of decision-making processes in conflict response inhibition observed among individuals with sub-
situations (Kerns et al., 2004; Ridderinkhof et al., 2004a,b). As stance use disorders (Monterosso et al., 2005; Paulus et al.,
anatomically demarcated previously, activation of primate 2003). This effect is not specific to mPFC, as individuals with a
130 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

cocaine abuse history also display decreased activity in left Similar findings are obtained following presentation of
ACC and right lPFC while performing a Stroop test (Bolla et al., cigarette-related stimuli to tobacco smokers (Brody et al.,
2004a). However, since these results in humans are correla- 2007; Yalachkov et al., 2009).
tional, they need to be supplemented by experiments in which
discrete PFC regions are manipulated in laboratory animals 3.3. Anterior cingulate cortex (ACC)
under controlled conditions.
ACC is involved in attentional selectivity and discrimination
3.2. Lateral prefrontal cortex (lPFC) learning. In rats, lesions of this area impair acquisition of a
task involving sequencing different responses (Delatour and
As indicated previously, rodent PFC does not have a region Gisquet-Verrier, 2001) and attentional selectivity (Dalley et al.,
similar to primate lPFC. In humans, however, damage to this 2004). ACC may also be involved in impulsive action, as
region leads to the so-called lateral syndrome (Fuster, 2008). A premature responding on the 5CSRT task is increased after
hallmark feature of the lateral syndrome is disordered lesioning this area (Muir et al., 1996; but see Dalley et al., 2004);
attention. Since the lPFC is a relatively large area, including however, the premature responding also may reflect impaired
Brodmann areas 8, 9, 10 and 46, the specific characteristics of timing (Chudasama et al., 2003; Passetti et al., 2002). While
the attentional deficits depend on the subareas most affected. ACC lesions do not alter impulsive choice (Cardinal et al., 2001)
Some lateral syndrome patients show deficits in selective or compulsivity defined by continued responding despite
attention, which is attention focused on a particular item or negative consequences (Joel et al., 2005b), they increase
experience, whereas other patients show deficits in exclu- preference for small, low-effort rewards over larger, high-
sionary attention, which is the inability to suppress unwanted effort rewards (Walton et al., 2002, 2003). The precise
items that interfere with attentional processing. In both cases, involvement of ACC in impulsive action and impulsive choice
the attentional deficits are often overshadowed by aphasia, warrants future study, as these are related to drug abuse.
dysfunction in working memory and general apathy that may A key neural substrate underlying reinstatement of drug-
be profoundly debilitating. seeking behavior involves glutamatergic input to nucleus
Studies conducted with normal human subjects also point accumbens core from dorsal mPFC, including ACC (Kalivas
to a role of lPFC activity in behavioral inhibition and attention. and Volkow, 2005; McFarland et al., 2004). ACC inactivation
Shackman et al. (2009) examined dorsal lPFC activity using decreases cue-induced reinstatement (McLaughlin and See,
high-resolution electroencephalography among individuals 2003), but not context-induced reinstatement (Fuchs et al.,
high or low on the Behavioral Inhibition System (BIS) self- 2005), suggesting that this region processes discrete and
report scale. Individuals high on BIS had greater activity in diffuse drug-associated stimuli differently. In addition, ACC
right lPFC. Right lPFC activation also is associated with activity is increased when rats are presented with cues
impulsive action on a stop-signal task (Aron and Poldrack, associated previously with cocaine self-administration
2006) and reduced emotional experience during appraisal of (Thomas et al., 2003). While inactivation of both ACC and PrL
aversive images (Wager et al., 2008). Evidence from non- has no effect on spontaneous recovery of cocaine-seeking
human primates implicate a dorsal–ventral dissociation (Peters et al., 2008), stress- and cocaine-induced reinstatement
within lPFC, with ventral lPFC being more directly involved is decreased (McFarland et al., 2004; McFarland and Kalivas,
than dorsal lPFC in attentional control (Kennerley and Wallis, 2001), thus implicating these regions in drug relapse.
2009). ACC also plays a crucial role in fast adaptations of behavior
There is strong evidence that lPFC is involved in drug based on immediate reward values. In monkeys, ACC pre-
abuse behaviors. Similar to medications such as amphet- reward activity is correlated with reward value and ACC
amine and methylphenidate that are used to treat attention neuronal activity is observed prior to the monkey's discovery
deficit hyperactivity disorder (ADHD), acute cocaine of the rewarding stimulus value (Amiez et al., 2006). Amiez et
decreases impulsive action (Garavan et al., 2008). In al. (2006) also showed that ACC inactivation impaired the
contrast, however, chronic cocaine abuse increases impul- ability to choose stimuli associated with optimal reward value.
sive action (Fillmore and Rush, 2002), which may explain Consistent with the idea that ACC plays a role in reward value
the escalating pattern of use that typifies addiction. The assessment, discrete cocaine-associated cues elicit sustained
loss of inhibitory control following chronic use is accompa- neuronal firing in ACC (Baeg et al., 2009). These results
nied by reduced activity in lPFC, as well as in ACC, during indicate that ACC guides behavior by encoding general task
performance on a Stroop test (Bolla et al., 2004a). Similar values and received rewards.
results are obtained with abstinent heavy marijuana users ACC and lPFC are proposed to subserve two distinct
(Bolla et al., 2005; Eldreth et al., 2004), indicating drug- inhibitory control systems in humans (Garavan et al., 2002).
induced lPFC impairment is not restricted to a single The first system is thought to be important for fast urgent
pharmacological class. inhibitions, involving primarily ACC. This ACC-driven system
lPFC activation is also implicated in cue-induced craving is especially important for emotional self-regulation (Posner
following a period of drug abstinence. Among individuals with et al., 2007). In contrast, the second system is thought to be
a cocaine abuse history, exposure to drug paraphernalia important for slower deliberate inhibitory processes, involving
increases glucose utilization and brain activity in lPFC (Bonson primarily lPFC. Such a distinction may have important
et al., 2002; Grant et al., 1996). However, cue-elicited brain implications for the inhibitory control of risk-related beha-
activation is not limited to lPFC, but rather involves extensive viors. In the case of drug abuse, exposure to proximal drug
activation in ACC, OFC and associated limbic structures. stimuli, such as being handed a tobacco cigarette, requires a
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 131

rapid decision that may involve ACC. In contrast, a more acquisition of cocaine self-administration using a simple
deliberate decision, such as whether to attend a party where continuous reinforcement schedule in rats (Hutcheson and
drugs will be available, may involve lPFC. Thus, depending on Everitt, 2003). However, under a second-order schedule of
the temporal proximity of the risky event, different PFC areas reinforcement in which completion of a minor chain require-
may be engaged when choosing or refusing drugs. ment leads to presentation of a conditioned stimulus, OFC
Alterations in ACC function have been associated with drug lesions impair acquisition (Hutcheson and Everitt, 2003).
abuse. In non-abusing subjects, methamphetamine increases Inactivation of lateral OFC also attenuates context-induced
activity in ACC and OFC (Vollm et al., 2004), suggesting that reinstatement of cocaine seeking (Lasseter et al., 2009). Thus,
both decision making and action are affected. In a study by the OFC appears to be required for drug-seeking in a task that
Fishbein et al. (2005), abstinent drug abusers and healthy depends on the conditioned reinforcing properties of cocaine-
controls were monitored for brain activity during a risky associated cues (Everitt et al., 2007).
decision-making task. Drug abusers displayed greater risky Clinical case studies and controlled laboratory studies in
choices despite the penalties enforced. The greater risks humans also support a critical role of OFC in risk-related
assumed by the drug abusers was associated with a failure behavior. Humans suffering from OFC damage are often
to activate ACC compared to controls. Thus, the deficit in ACC characterized as pathologically impulsive (Kringelbach and
function among drug abusers may play a role in the escalation Rolls, 2004; Lishman, 1998; Torregrossa et al., 2008). Among the
of intake that occurs during the addiction cycle, despite various tasks that have been assessed following OFC damage,
increasing punishment. impairments in reversal learning are observed consistently in
both human and nonhuman primates (Hornak et al., 2004;
3.4. Orbitofrontal cortex (OFC) Izquierdo et al., 2004; Meunier et al., 1997). A role for OFC in
reversal learning is supported further by imaging studies in
OFC neurons fire in anticipation of expected reward, and normal human subjects (Cools et al., 2002; Hampton et al.,
activity of these neurons reflects the value of the expected 2006). In addition to its involvement in reversal learning, OFC
outcome when assessed across different species (Murray et al., plays a role in guiding behavior based on the value of an
2007; Schoenbaum et al., 2006). With training, these neurons expected outcome (Murray et al., 2007; Schoenbaum and
become active during presentation of cues that predict their Roesch, 2005; Torregrossa et al., 2008). Neuronal activity in
preferred outcomes. Therefore, OFC plays a role in evoking monkey OFC represents not only the value of expected reward
original learning and integrating it with the new value of an (Roesch and Olson, 2004; Tremblay and Schultz, 2000), but also
outcome to guide responding (Murray et al., 2007). Consistent adapts to reflect the importance of different types of reward
with this, OFC lesions impair reversal learning (Chudasama information in different contexts and time periods (Simmons
and Robbins, 2003; Dalley et al., 2004; Murray et al., 2007; and Richmond, 2008). Since many gambling tasks involve
Schoenbaum et al., 2003) and prevent integration of informa- expectations about the value of an outcome, it is not
tion about the consequences of responding for a reward with surprising that OFC-damaged humans make risky gambling
the subjective value of that rewarding outcome (Schoenbaum decisions (Bechara, 2005).
et al., 1999; Winstanley, 2007). Furthermore, OFC lesions OFC dysfunction also is implicated in humans with sub-
increase both impulsive action and compulsive responding stance use disorders. Individuals with cocaine abuse history
(Joel et al., 2005a,b; Winstanley, 2007), and the ability to inhibit show decreased gray matter in OFC (Franklin et al., 2002),
responding is thought to be mediated by connections between suggesting reduced synaptic connectivity. In support of its role
OFC and dorsomedial striatum (Eagle and Robbins, 2003; Eagle in inhibitory control, monkeys exposed to cocaine display a
et al., 2007). deficit in reversal learning and other cognitive deficits indicative
In human drug abusers, impulsive behavior is proposed to of OFC dysfunction (Jentsch et al., 2002; Olausson et al., 2007).
result from drug-induced OFC hyperactivity and this hyper- These results suggest that OFC dysfunction in individuals with a
activity results in a compensatory inhibitory process to substance use disorder is, at least in part, a consequence of drug
normalize OFC activity (Winstanley, 2007). If drug use ceases, exposure, rather than an antecedent condition that precedes
drug-induced OFC hyperactivity is no longer present and the drug exposure.
compensatory inhibitory process acts to suppress normal OFC A general view has emerged that OFC dysfunction pro-
activity. Consistent with this idea, Winstanley et al. (2009) motes risky behavior because OFC plays a primary role in
showed that cocaine self-administration in rats initially decision-making, especially decisions that involve adaptation
increased impulsive action on the 5CSRT, but that tolerance of behavior due to punishing stimuli (Ridderinkhof et al.,
developed with repeated self-administration. Upon withdraw- 2004b; Wrase et al., 2007). Within OFC, the medial portion is
al, rats again displayed increased impulsive action that was proposed to be more sensitive to rewarding stimuli, whereas
associated with an overexpression of the transcription factor the lateral portion is more sensitive to punishing stimuli
ΔFosB in OFC, thus implicating changes in gene expression in (Kringelbach and Rolls, 2004). For example, Liu et al. (2007)
this PFC region. found that human subjects performing a monetary decision-
Accumulating evidence indicates that OFC is involved in making task showed medial OFC activation to reward out-
drug abuse vulnerability (Schoenbaum and Shaham, 2008). comes and lateral OFC activation to loss outcomes. However,
OFC is activated by presentation of stimuli associated not all findings fit the medial-lateral distinction of OFC
previously with self-administered cocaine in rats, nonhuman function put forth by Kringelbach and Rolls (2004). In an fMRI
primates, and humans (Thomas et al., 2003; Thomas and study by Alia-Klein et al. (2007), subjects were exposed to the
Everitt, 2001). Interestingly, OFC lesions have no effect on words “Yes” or “No” in a vocally emphatic manner. Rather
132 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

than observing a medial-lateral distinction in OFC activity, (Schweimer and Hauber, 2006). Similarly, systemic adminis-
“Yes” evoked a positive signal in right lateral OFC, while “No” tration of the D1/D2 antagonist flupenthixol increases impul-
evoked a negative signal in right lateral OFC. These latter sive choice for a low-cost/low-reward response (Floresco
results suggest that verbally presented rewarding and punish- et al., 2008). In OFC, DA utilization is increased during
ing stimuli are processed differently from nonverbal stimuli. performance on a delay discounting task (Winstanley et al.,
Because “Yes” and “No” are words that have important 2006b); however, inactivation of DA receptors in OFC has
meaning for either encouraging or prohibiting various beha- yielded mixed results (Winstanley et al., 2007; Winstanley et
viors, it will be important to determine if such valenced words al., 2004; Zeeb et al., 2010), depending on baseline levels of
are processed differently among individuals who are low or impulsive behavior and whether cues are used to signal the
high for drug abuse risk. For example, at-risk individuals who delay to the larger reward. Nonetheless, the bulk of results
lack strong parental bonding and tend to be noncompliant to suggest that impulsive choice is associated with reduced DA
authority may be less receptive to externally applied con- activity in ACC and OFC.
straints (“no” command) than low-risk individuals who are The role of specific PFC DA systems in impulsive action
more responsive to these constraints. remains to be elucidated. Similar to its effects on impulsive
choice, systemic administration of nonspecific DA agonists
yields inconsistent results on impulsive action (Pattij and
4. Neurochemistry of PFC Vanderschuren, 2008; Perry and Carroll, 2008). In humans,
psychostimulants tend to decrease impulsive action, an effect
Drugs of abuse alter a variety of neurotransmitter systems, that is more dramatic in individuals with high levels of
including DA, serotonin (5-HT), norepinephrine (NE), gluta- impulsive action. These effects are likely moderated by D1 and
mate and γ-aminobutyric acid (GABA) systems. Much of our D2 DA receptors, as antagonism of either of these subtypes
knowledge regarding the neurochemistry of PFC, including the increases impulsive action (Passetti et al., 2003; van Gaalen et
localization and function of these neurotransmitters and the al., 2006).
associated receptors and transporters, has been garnered Related to its involvement in impulsivity, PFC DA also plays
using animal models because neurochemical mechanisms a role in other cognitive functioning that may be important in
underlying drug abuse vulnerability cannot be assessed easily drug abuse vulnerability, especially when stress is involved.
using human subjects. In this section, we highlight some key DA is the most reactive monoamine in response to psycho-
findings about neurotransmitter function within specific PFC logical stress (Goldstein et al., 1996), and high levels of DA
regions as they relate to impulsivity. activity in mPFC lead to working memory impairment. In rats,
stress-induced working memory deficits are correlated with
4.1. Dopamine (DA) increased DA turnover in mPFC (Murphy et al., 1996). These
deficits can be reversed in both rats and monkeys by
Clinical literature shows that nonspecific DA agonists such as administering D1 or D4 DA receptor antagonists (Arnsten
amphetamine or methylphenidate are highly effective in and Goldman-Rakic, 1998; Murphy et al., 1996, 1997). Stress
decreasing impulsivity among individuals with ADHD, likely responses can be mimicked in the rat via direct infusion of a
due to weakened prefrontal catecholamine function (Arnsten, selective D1 antagonist into mPFC (Zahrt et al., 1997), whereas
2009). However, controlled laboratory studies in humans and D4 receptor antagonists block memory deficits induced by a
rats indicate that DA agonists can either decrease or increase pharmacological stressor (Arnsten et al., 2000). Increased DA
impulsive choice, depending on various factors such as the function may impair mPFC-associated memory capacity in
dose used, baseline level of impulsive choice behavior, and non-human primates. External factors (i.e., noise) can impair
methodological details of the task used (i.e., whether the delay memory capacity in a visual memory task, an effect that is
is signaled or unsignaled, type of reinforcer offered), thus improved by administration of DA receptor antagonists
making it difficult to generalize across laboratories (Perry and (Arnsten and Goldman-Rakic, 1998). In contrast, decreases in
Carroll, 2008). In one study, amphetamine decreased impul- PFC DA turnover induced by chronic amphetamine adminis-
sive choice in rats, an effect that was attenuated by the D2 tration also result in impairments in performance in a spatial
receptor antagonist flupenthixol (Winstanley et al., 2003a). delayed response task in nonhuman primates (Castner et al.,
Similarly, increasing extracellular DA concentrations via the 2005), indicating cognitive impairment. Combined, these
DA uptake inhibitor GBR 12909 decreases impulsive choice results suggest that perturbing mPFC DA neurotransmission,
(van Gaalen et al., 2006). However, administration of selective whether it is an increase or decrease in utilization, results in
D1 or D2 DA antagonists has yielded variable results, suggest- cognitive impairments. Further, they may have important
ing that the therapeutic effect of agonist medications involves translational relevance, as cognitive impairments induced by
stimulation of more than one DA receptor subtype. stressful life events may explain, at least in part, the
Dopamine staining is present in most areas of rodent PFC, relationship between impulsive behavior and drug abuse in
except for the most lateral portions of OFC (Van De Werd et humans (Helen et al., 2010).
al., 2010). Regarding the role of DA in PFC subregions in
impulsive choice, results indicate that both ACC and OFC are 4.2. Serotonin (5-HT)
involved, particularly when less effort is required to obtain
the small reinforcer than the larger reinforcer. In ACC, PFC receives 5-HT innervation from medial and dorsal raphe
blockade of D1 DA receptors, but not D2 DA receptors, nuclei (Mamounas et al., 1991; Steinbusch, 1981; Wilson and
enhances preference for a low-cost/low-reward response Molliver, 1991a,b). 5-HT raphe neurons synthesize and release
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 133

5-HT from growing axonal processes as soon as one day after by MAO metabolism (Bonisch and Bruss, 2006; Dostert et al.,
their appearance in brain (Lambe et al., 2000; Lidov and 1989). Three families of receptors are activated by NE,
Molliver, 1982), and the effects of 5-HT within the synapse are including α1-, α2-, and β-adrenergic receptors (Bylund et al.,
terminated by re-uptake of the neurotransmitter into the 1994). α2 NE receptors have received the most research focus,
presynaptic nerve terminals through a high-affinity 5-HT because ADHD is proposed to involve a deficit in PFC α2 NE
transporter (SERT). After re-uptake, 5-HT is degraded subse- activity (Arnsten et al., 2000). α2 NE agonists reduce impulsive
quently by monoamine oxidase (MAO). choice, impulsive action and inattention in mice (Franowicz et
Both preclinical and clinical evidence points to a role of PFC al., 2002), rats (Tanila et al., 1996), monkeys (Arnsten et al.,
5-HT in impulsivity. Among humans with pathological impul- 1988; Rama et al., 1996) and humans (Jakala et al., 1999a,b).
sive aggressivity, deficits in 5-HT exist in ACC (Frankle et al., NE plays a role in both impulsive choice and impulsive
2005). Rats that display high impulsive action on a go/no-go action. While impulsive choice is decreased by elevating
task also show deficits in 5-HT turnover in mPFC and ACC extracellular NE via NET inhibition (Blondeau and Dellu-
(Masaki et al., 2006). While these results suggest that PFC 5-HT Hagedorn, 2007; Robinson et al., 2007), it is increased by direct
deficits lead to impulsivity, contradictory evidence exists. For stimulation of the α2 receptors with clonidine (van Gaalen et
example, 5-HT release in mPFC increases impulsive action al., 2006). These contradictory results likely reflect a preferen-
on the 5CSRT task (Dalley et al., 2002; Puumala and Sirvio, tial activation of presynaptic α2 autoreceptors by clonidine,
1998). Moreover, the role of specific 5-HT receptor subtypes are which may decrease NE release, thus resulting in an increase
poorly understood and are complicated by the identification of in impulsivity similar to NET inhibition. In any case, results
15 different 5-HT receptor subtypes belonging to one of seven from these studies suggest that α2 receptors, rather than α1 or
families (5-HT1–7; Barnes and Sharp, 1999; Hoyer et al., 2002). β receptors, have a key role in impulsive choice.
The 5-HT1 (specifically the 5-HT1A/1B/1D) and 5HT2 (5-HT2A/2B/2C) Similar to impulsive choice, α2 NE receptors appear to play
receptor families have received the most attention for their a role in impulsive action. Saporin-induced lesions of NE
ability to alter impulsivity, with somewhat mixed results afferents to PFC do not alter impulsive action (Milstein et al.,
(Evenden and Ryan, 1999; Pattij and Vanderschuren, 2008). 2007). However, NET inhibition decreases impulsive action on
In general, impulsive choice is increased following admin- 5CSRT and stop-signal tasks (Robinson et al., 2007; van Gaalen
istration of 5-HT1A receptor agonists (Evenden and Ryan, 1999; et al., 2006). Consistent with these preclinical observations,
Liu et al., 2004; van den Bergh et al., 2006; Winstanley et al., the NET inhibitor atomoxetine decreases stop-signal reaction
2005), an effect blocked by antagonism of 5-HT1A receptors time in healthy human volunteers (Chamberlain et al., 2006).
(Winstanley et al., 2003b). When administered alone, however, Inhibition of NE transport would be expected to increase
5-HT1A receptor antagonists have no effect on impulsive activation of postsynaptic NE receptors, thus leading to the
choice, nor do 5-HT1B receptor agonists (van den Bergh et al., observed reduction in impulsive action. The reduction in
2006). Impulsive choice is decreased, however, following impulsive action likely reflects α2 NE receptor stimulation, as
administration of the 5-HT2C antagonist SER082 (Winstanley the α2 NE antagonist yohimbine increases premature
et al., 2004). Therefore, 5-HT1A and 5-HT2C receptors appear to responding in the 5CSRT task, as well as increasing phos-
have opposing roles in impulsive choice. phorylation of cyclic adenosine monophosphate response
In contrast to impulsive choice, a role for 5-HT1A/1B element binding (CREB) protein in OFC (Sun et al., 2010).
receptors has not been found in impulsive action. Instead, Further, impulsive action in the 5CSRT task is increased by α2
impulsive action is increased following systemic and intra- NE antagonists, but not by α1 NE antagonists (Koskinen et al.,
OFC administration of the 5-HT2A/2C receptor agonist (±)-2, 5- 2003), indicating a selective involvement of α2 receptors.
dimethoxy-4-iodoamphetamine (DOI; Hadamitzky and Koch, However, the α1 NE antagonist prazosin reduces impulsive
2009; Koskinen et al., 2000; Koskinen and Sirvio 2001), and action induced by methylphenidate, and the β-adrenoceptor
decreased following both systemic and intra-mPFC adminis- antagonist propranolol eliminates methylphenidate-induced
tration of 5-HT2A antagonists (Fletcher et al., 2007; Higgins et increases in impulsive action (Milstein et al., 2010). Combined,
al., 2003; Passetti et al., 2003; Robinson et al., 2008a; Ruotsa- these results suggest that NE α2 receptors, perhaps in OFC,
lainen et al., 1997; Winstanley et al., 2003b). Blockade of 5-HT2C play a primary role in both types of impulsivity under normal
receptors also increases impulsive action in the 5CSRT task conditions, but that α1 and β NE receptors also may contribute
(Fletcher et al., 2007; Robinson et al., 2008a). The differential in the presence of high extracellular DA levels induced by
roles of 5-HT1A/1B and 5-HT2A/2C subtypes in impulsive choice stimulant drugs.
and impulsive action, respectively, suggests that selective
pharmacotherapies may be useful for treating different facets 4.4. Glutamate
of impulsive behavior.
Glutamate is a major excitatory neurotransmitter in PFC,
4.3. Norepinephrine (NE) including both corticostriatal and corticothalamic efferents
(Bromberg et al., 1981; Fonnum et al., 1981a,b). Excitatory
Central NE neurons are localized in brainstem nuclei and glutamatergic neurons from PFC control DA release in VTA
project diffusely to almost every part of the brain, including and nucleus accumbens (Del Arco and Mora, 2008; Krystal et
PFC. NE cell bodies in locus coeruleus receive reciprocal al., 2003). An imbalance in glutamate homeostasis (synaptic
innervation from mPFC (Heidbreder and Groenewegen, 2003). and non-synaptic glutamate balance), which impairs commu-
NE release into the synapse is deactivated by rapid uptake by nication between PFC and nucleus accumbens, has been
the NE transporter (NET) into presynaptic terminals, followed linked to impulsive drug seeking behavior and drug abuse
134 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

(Hyman et al., 2006; Kalivas, 2009). Recent clinical research Few studies have investigated the role of GABA in
also reveals a positive correlation between ACC glutamate impulsivity, although some evidence implicates a role for
levels and self-reported levels of impulsivity measured on the GABAA receptors. Local injections of the GABAA antagonist
Barrett scale (Hoerst et al., 2010). bicuculline into nonhuman primate PFC increases impulsive
Glutamate acts via stimulation of both ionotropic glutamate action (Sawaguchi et al., 1988). In human subjects, oral
receptors (iGluRs) and metabotropic receptors (mGluRs). iGluRs, administration of benzodiazepines, which allosterically aug-
including N-methyl-D-aspartate (NMDA), kainate and α-amino- ment GABAA receptor function and increase extracellular
3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) recep- concentrations of GABA in brain, is positively correlated with
tors, are ligand-gated nonselective cation channels, which allow increased self-reports of impulsivity (Deakin et al., 2004; Lane
K+, Na+ and sometimes Ca2+ flux in response to glutamate et al., 2005). However, controlled laboratory studies evaluating
binding to its recognition site on the protein (Tikhonov and the effects of benzodiazepines on impulsivity are mixed. One
Magazanik, 2009). NMDA receptors and the associated specific report showed that diazepam does not alter impulsive choice
subunits NR1-3 have been studied in detail, since these are or impulsive action (Reynolds et al., 2004), while another
thought to be involved in learning and memory (Dingledine, found that triazolam increases impulsive action on a stop-
1983). mGluRs, which include mGlu1-8 receptors, are a hetero- signal task (Fillmore et al., 2001). In rats, benzodiazepines are
geneous family of G-protein-coupled receptors which function reported to either increase or produce no change in impulsive
to modulate brain excitability via presynaptic, postsynaptic and choice (Cardinal et al., 2001; Charrier and Thiebot, 1996;
glial mechanisms (Conn and Pin, 1997; Schoepp, 2001). Evenden and Ryan, 1996). Thus, more research is necessary
Impulsivity is modulated by NMDA receptors, specifically to elucidate the effects of benzodiazepines on impulsivity.
the NR2B subunit. Impulsive choice is increased after admin- The GABAA agonist muscimol decreases lever pressing for
istration of ketamine, an NMDA antagonist (Floresco, 2007). preferred food and increases consumption of a less preferred
Similarly, impulsive action is increased by NMDA antagonists food, a possible measure of impulsive choice (Farrar et al.,
administered either systemically or into mPFC (Higgins et al., 2008). In addition, microinjection of muscimol into median
2003; Mirjana et al., 2004; Murphy et al., 2005; Paine et al., 2007). raphe increases impulsive action and reinstates alcohol
The selective NR2B NMDA receptor antagonist Ro63-1908 seeking in alcohol-dependent rats (Le et al., 2008), indicating
increases impulsive action (Higgins et al., 2003). an interaction between GABA and 5-HT systems. Thus,
mGluRs also have a role in impulsivity, particularly GABAA antagonists may represent a novel target for inter-
mGluR1 and mGluR5 subtypes. Blockade of mGluR1 receptors vention of impulsive behaviors involved in reinstatement of
in rats improves working memory and reduces impulsive drug seeking.
choice (Sukhotina et al., 2008). In contrast, mGluR1 receptor
antagonists increase impulsive action (Sukhotina et al., 2008).
Antagonism of the mGluR5 receptor has similar effects 5. Age- and sex-related differences in PFC
(i.e., increased impulsive action); however, antagonism of
mGluR2/3 receptors has no effect on impulsive action 5.1. Developmental differences
(Semenova and Markou, 2007). Collectively, these findings
indicate that inhibition of glutamate neurotransmission Initiation of drug use occurs most often during adolescence
increases both impulsive choice and impulsive action, and early adulthood (Spear, 2000). One of the most important
although little is known about the PFC subregions involved features that characterizes the transition from childhood to
beyond mPFC. adolescence is a shift away from parental control to social
bonding with peers. The move away from a parent-centered
4.5. GABA life to a peer-centered life is necessary for reproductive fitness
and mating. During this developmental period, it is not
About one fourth of all PFC neurons utilize GABA, the prime surprising that risk-related behaviors become more promi-
inhibitory synaptic transmitter and most abundant of all nent, with hedonic limbic structures being more dominant
neurotransmitters in the CNS. PFC GABA neurons generally do than inhibitory PFC structures. Although many regions of the
not project directly the reward-relevant nucleus accumbens brain undergo structural changes during this period, mPFC
(Christie et al., 1987); however, subcortical regions can be and superior temporal sulcus sculpt the social brain (Blake-
affected indirectly due to the inhibitory role of GABA in several more, 2008). The functional consequence of this anatomical
PFC regions (Brailowsky et al., 1986; Matsumura et al., 1992). maturation includes changes in face recognition and mental-
There are two types of GABA receptors: GABAA and GABAB. state attribution (Blakemore, 2008), with each of these
GABAA is the postsynaptic receptor and GABAB has been processes playing a role in social interaction.
identified as mainly an autoreceptor involved in the self- Considerable work with laboratory animals shows that
regulation of GABA. GABAB receptors are widely distributed in synaptogenesis during development initially yields an excess
several brain areas related to drug seeking, where they of potential synaptic connections, but that many nonfunctional
modulate both excitatory and inhibitory effects via pre- and connections are pruned during maturation (Cragg, 1974, 1975;
postsynaptic mechanisms (Thompson and Gahwiler, 1992). In Zecevic et al., 1989). In humans, several longitudinal and cross-
PFC, GABAB receptors are localized on the presynaptic sectional neuroimaging studies have captured the changes in
terminals of the glutamatergic nerve endings and/or cell white and gray matter volumes in various brain regions from
bodies, (Margeta-Mitrovic et al., 1999) and on GABA neurons childhood to young adulthood (Giedd et al., 1999; Gogtay et al.,
where they act as autoreceptors (Calver et al., 2002). 2004; Olson et al., 2009; Paus et al., 1999; Sowell et al., 2003). A
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 135

general conclusion from these studies is that PFC white matter that individuals who are most responsive to novel stimuli (i.e.,
increases linearly across this age period, whereas gray matter high novelty seekers) are also more responsive to drugs of
decreases. Studies using functional magnetic resonance imag- abuse (Bardo et al., 1996). To the extent that an immature PFC
ing (fMRI) show that activity in mPFC is highest during the enhances the relative novelty of various stimuli that motivate
adolescent period, which coincides with synaptic pruning behavior, this may represent an important factor to explain
leading to a higher signal-to-noise ratio for PFC networks in why periadolescents are at increased risk for drug use.
the mature brain (Blakemore, 2008). In rat, mPFC also shows a Environmental influences during development may alter
loss of neurons from adolescence to adulthood (Markham et al., the trajectory of PFC connectivity and functionality. Among
2007), consistent with the idea of streamlining of PFC connec- the most important influences is the amount of social and
tivity across this transitional developmental period. environmental enrichment experienced during development.
Although adolescents show superior performance on Adolescent rats reared in an enriched environment with social
various inhibitory tasks compared to children (Lamm et al., cohorts and novel objects show an accelerated cortical
2006), evidence indicates that PFC connections are not maturation compared to isolated rats raised without cohorts
developed fully until early adulthood (Cunningham et al., or objects (Renner and Rosenzweig, 1987). Enriched rats also
2002; Gogtay et al., 2004). Galvan et al. (2006) examined event- show decreased vulnerability to stimulant self-administration
related fMRI activity of OFC and nucleus accumbens in (Bardo et al., 2001), which is associated with decreased DA
children, adolescents and young adults participating in a transporter function in mPFC (Zhu et al., 2005). While exposure
task that measured choice of varying reward values. Across to novel objects is thought to play a role in the enrichment
these age groups, adult-like patterns of accumbal activity effects, a strong influence of social factors is also important. In
occurred earlier in development than OFC activity. A direct particular, maternal interactions early in life have long-lasting
comparison between adolescents and adults indicated that consequences for PFC function during young adulthood
OFC activity was lower in adolescents than adults at the (Denenberg, 1964; Meaney et al., 1996). Bock et al. (2008)
anticipatory stage of the task. Similarly, other work has shown found that early social experience was especially important in
that adolescents have lower OFC activation than adults at the promoting dendritic spine density in ACC.
decision point of a risky economic choice (Eshel et al., 2007). To Environment-dependent neurobehavioral changes also have
the extent that the nucleus accumbens mediates reward been observed in non-human primates. Lyons et al. (2002)
seeking and OFC mediates behavioral inhibition, these find- separated young squirrel monkeys from their mothers on
ings provide neural evidence that attraction to rewarding intermittent occasions from 13 to 21 weeks of age. These
stimuli during adolescence is not counterbalanced by the type separations provoked repetitive peep-calls, agitated locomotion
of inhibitory control that characterizes most adults. and elevated cortisol levels in the offspring, effects indicative of
The reduced PFC activity noted in children and adolescents distress. When evaluated as young adults, separated monkeys
compared to adults does not generalize across all tasks. For had a larger ventromedial PFC, consisting of portions of both
example, in contrast to results obtained with risky choice mPFC and lPFC, compared to non-separated controls. This
tasks, children show greater mPFC, lPFC, ACC and OFC activity cytoarchitectural change was asymmetric, being evident in the
than adults when instructed to suppress their reactions to right hemisphere only. This asymmetry may be important
emotional stimuli (Levesque et al., 2004). One interpretation of because negative emotional experiences are thought to be
this finding is that emotional self-regulation in children linked to the right hemisphere in humans (Ahern et al., 1994).
requires the recruitment of more connections within the Clinical studies in children with ADHD show an altered
immature PFC compared to more practiced adults. This developmental trajectory in PFC maturation. Anomalous PFC
interpretation is consistent with work showing that adoles- functioning has been observed in children with ADHD
cents with conduct disorder recruit relatively more PFC tissue compared to controls (Bush et al., 1999; Ernst et al., 2003). An
than controls in order to normalize their performance on the interesting feature of ADHD, however, is that a substantial
Stroop test (Banich et al., 2007). However, an alternative portion of children with ADHD show a normalization of
interpretation of the greater PFC activation in children is behavior with age. To determine if there is an anatomical
that this age-related difference may be secondary to differ- dissociation among ADHD children with positive or negative
ences in amygdala activity, since PFC and amygdala have clinical trajectories, Shaw et al. (2006) conducted a longitudi-
reciprocal connections (Lewis and Stieben, 2004). nal study that examined cortical thickness in various PFC
In addition to maturation of emotional self-regulatory regions from approximately 8 to 15 years of age. At the
processes, PFC development across the periadolescent period younger age, individuals with ADHD had a thinned mPFC
is thought to play a vital role in memory processing. Ofen et al. and ACC compared to controls, an effect that persisted across
(2007) investigated declarative memory in children and adults the study. Children with the worst clinical outcomes had
in a neuroimaging study. Subjects studied various scenes and thinner left mPFC at baseline compared to children with a
were asked to remember the scenes for later view. When better clinical outcome. However, it is not clear to what extent
subsequently asked whether the scenes were old or new, this difference in mPFC thickness reflects an alteration in
recognition memory improved with age and this age-related synaptic density related to attention or impulsivity.
improvement in memory was accompanied by greater acti-
vation in various PFC regions. These results suggest that the 5.2. Sex differences
immature PFC in children hinders the ability to retrieve old
information, thus making previously viewed stimuli appear as Notable sex differences exist in brain structure (Luders et al.,
novel. Interestingly, there is considerable evidence suggesting 2004), basal measures of brain functioning (Andreason et al.,
136 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

1994; Gur et al., 1995) and functional measures of neural conditions seem to play an important role in these mixed
responding (Cahill et al., 2001). Sex differences also exist in results, possibly because males and females use different
cognitive functioning and working memory on tasks that strategies on the various tasks employed. For example,
require PFC regions (Overman, 2004). Furthermore, following females discount delayed hypothetical reinforcers at a higher
exposure to stress, there is a sexual dimorphism in perfor- rate than males (i.e., show greater impulsive choice), but when
mance on behavioral tasks and associated neurochemical real reinforcers were offered, males discount at a higher rate
changes in PFC (Bowman et al., 2003, 2009; Lin et al., 2009). than females (Heyman and Gibb, 2006). Understanding sex
Among the various tasks used to assess sex differences in differences in making risky or impulsive decisions may have
decision-making and cognitive impulsivity in humans, the important implications for maximizing prevention and treat-
Iowa Gambling Task has been studied the most widely. This ment strategies targeted toward either males or females.
task requires participants to choose from decks of cards that
result in either high reward with infrequent but high sporadic
losses (disadvantageous decks) or low reward with more 6. Translation to applied interventions
frequent but low sporadic losses (advantageous decks).
While control participants learn to choose the advantageous 6.1. Prevention
decks, this winning strategy is impaired among patients with
PFC damage (Bechara et al., 1994, 1997; Clark et al., 2008), drug Drug abuse prevention interventions commonly consist of
abusers (Grant et al., 2000), violent offenders (Fishbein, 2000), educational, family- or peer-based programs aimed at middle
individuals with eating disorders (Liao et al., 2009), and and high school age adolescents (Botvin and Griffin, 2007;
pathological gamblers (Cavedini et al., 2002; Forbush et al., Sussman et al., 2004; Velleman et al., 2005). Some interven-
2008). Interestingly, normal males also choose the advanta- tions, termed universal interventions, are designed for use
geous decks more than females (Crone et al., 2005; Garon and among all members of a population. Other “targeted” inter-
Moore, 2004; Kerr and Zelazo, 2004; Overman, 2004; Reavis and ventions are designed specifically for a subset of individuals
Overman, 2001), likely due to a sex difference in the strategy characterized by some common endophenotype associated
employed (Overman, 2004). While males learn to maximize with risk, such as high sensation seekers or adolescents with
monetary outcomes in the long run by choosing only conduct disorder (Fishbein et al., 2006). With both universal-
advantageous decks, females tend to choose decks that have istic and targeted approaches, prevention can result from
the lowest probability of resulting in a loss, even if the loss is teaching refusal skills, as well as from reinforcing choices that
large (as it is with disadvantageous decks). This suggests that promote healthier lifestyles. A major hurdle in conducting
males are more sensitive to long-term monetary gains, while prevention science relates to the high cost of evaluation
females are more sensitive to immediate loss. studies. As a case in point, the National Youth Anti-Drug
Sex differences in PFC activity during performance on the Media Campaign sponsored by the U.S. Office of National Drug
Iowa Gambling Task accompany the sex differences in Control Policy took 5 years to develop and test, at a total cost of
performance on this task. In males, brain activation is more $2 billion (Palmgreen et al., 2007). Thus, the use of controlled
lateralized to the right hemisphere, and males show more laboratory-based experiments that establish proof-of-concept
activation in right lPFC and right lateral OFC than females results are desirable prior to implementing time-consuming
(Bolla et al., 2004b). While females show activation in both and expensive interventions.
hemispheres, more activation in left lPFC also occurs in One way to establish proof-of-concept results is to use
females than in males (Bolla et al., 2004b). Previous studies neuroimaging results to determine if a novel prevention
have shown that right PFC damage results in impairment on intervention engenders PFC activation patterns associated
the Iowa Gambling Task and decision-making in real life, with self-controlled decisions and desired behavioral out-
whereas left PFC damage has no effect (Bechara et al., 2000a,b; comes. For example, development of televised public service
Manes et al., 2002; Tranel et al., 2002). Taken together, these announcements (PSAs) may benefit from neuroimaging
results suggest that increased activity in right lPFC and/or technologies (Ray et al., 2008). Mass media campaigns that
lateral OFC could underlie the propensity of males to select target high sensation seekers with high arousal messages
cards from advantageous decks. reliably decrease risky decision-making involving drug use
Other measures of decision-making and impulsivity have and unsafe sex (Palmgreen and Donohew, 2003). Recent
yielded inconsistent sex differences in both performance and neuroimaging studies have examined the activation patterns
brain activation. No reliable sex differences in performance of PFC and related structures following presentation of
are observed on impulsive action measured by the stop signal arousing stimuli. For example, Joseph et al. (2009) examined
reaction time task, even though sex differences in brain brain activation patterns during an emotional induction task
activation may occur (Li et al., 2006). In the Stroop task, no in high and low sensation seekers. When exposed to
reliable sex differences in brain activation are observed (Bolla emotional images, high sensation seekers displayed a rapid
et al., 2004b). On other measures of risk taking or impulsivity, and pronounced activation of insula, a brain region implicated
discrepant reports have shown males to be more impulsive in arousal (Craig, 2005) and drug craving (Naqvi and Bechara,
(Kirby and Marakovic, 1996; Rosenblitt et al., 2001; Van 2009). Insula activation was followed rapidly by ACC activa-
Leijenhorst et al., 2008; Whiteside and Lynam, 2003), less tion. In contrast to high sensation seekers, however, low
impulsive (Reynolds et al., 2006; Wallace, 1979) or equally sensation seekers showed an early response in ACC, but a
impulsive (Fillmore and Weafer, 2004; Reynolds et al., 2006; minimal response in insula, which may explain why they
Skinner et al., 2004), compared to females. Experimental have greater emotional control than high sensation seekers.
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 137

ACC activation may reflect a compensatory mechanism that enon has been demonstrated in laboratory experiments in
inhibits the initial arousal response in insula. which subjects that are required to exert inhibitory control in
Likewise, high and low sensation seekers show differences one task show a deficit in inhibitory control in a second task
in brain anatomy (Martin et al., 2007) and brain function in a that requires the same resource (Baumeister and Heatherton,
novelty detection task (Jiang et al., 2009; Smith et al., 2008). 1996; Muraven et al., 1998). This finding may have important
Jiang et al. (2009) measured cortical evoked potentials implications for prevention interventions aimed at enhancing
following exposure to a series of familiar or novel visual inhibitory control over drug use. Rather than being protective,
stimuli. High sensation seekers had reduced ventral PFC intervention strategies that drain self-control resources im-
responses to novel stimuli compared to low sensation seekers. mediately prior to the opportunity to use or refuse drugs may
These results are consistent with a report by De Pascalis et al. actually exacerbate the problem of drug use. This “boomer-
(2009) showing that subjects high on impulsivity measured on ang” effect may be negated by insuring that training exercises
the Zuckerman–Kuhlman Personality Questionnaire show in self-control are not implemented shortly before entering a
delayed event-related neural potentials. These formative situation where drugs are available.
results illustrate how neuroimaging techniques may be used The depletion of self-control resources that occurs with
to identify pre-existing differences in brain function associat- repeated exertion involves ACC. Inzlicht and Gutsell (2007)
ed with sensation-seeking status. Moreover, neuroimaging monitored electroencephalographic waveforms associated
technologies may prove to be useful for screening various with ACC in subjects that were instructed to suppress their
intervention stimulus materials prior to the design and emotions while viewing a movie depicting animals that were
implementation of expensive and time-consuming field- suffering. Subjects subsequently performed the Stroop test in
based prevention efficacy trials. which good performance required suppression of the tenden-
Although high message sensation value PSAs may be cy to read a word (red or green) in order to rapidly name the
important for attracting the attention of high sensation color used to print the word. Subjects instructed to suppress
seekers, there is some evidence that “deep” processing of their emotions in the movie performed worse on the Stroop
message content may be more effective when delivered with test compared to control subjects. This deficit in performance
low message sensation value. Langleben et al. (2009) examined was associated with a diminution of ACC activity, suggesting a
brain activity and recognition memory in regular tobacco depletion of inhibitory function in this region.
smokers exposed to anti-smoking PSAs. Although it is not Engaging in physical activity also may be an effective
clear whether the subjects used in this study were high or low strategy for promoting PFC-mediated inhibitory processes.
sensation seekers, low sensation value PSAs were recognized Using a confirmatory multivariate analysis in adolescents,
more accurately and produced greater PFC activation than Wills et al. (2007) found that self-control constructs are related
high sensation value PSAs. These results suggest that to both dietary intake and physical activity. Individuals who
attention-intensive formats may compete with message were poor at self-control (i.e., impulsive) were least likely to
information for cognitive resources. Thus, when combined engage in physical activity, thus raising the risk for drug use.
with previous results (Palmgreen et al., 2001), it is possible that Consistent with this, children showing good aerobic fitness
PSAs that initially attract attention with high arousal stimuli between the ages of 7 and 12 years have better Stroop test
and then transition into a low arousal persuasive message for performance (Buck et al., 2008), while obese children show less
deep processing may be most effective. inhibitory control compared to lean counterparts (Nederkoorn
Since at-risk adolescents are thought to be impulsive due to et al., 2006).
immature PFC function, training exercises that specifically Preclinical evidence also indicates that physical activity
engage PFC areas involved in decision-making may offer a has direct neurobehavioral effects on PFC functioning. Rats
useful prevention intervention strategy. Conrod et al. (2006) given access to a running wheel display an increase in
implemented a prevention intervention that targeted adoles- glioneogenesis in mPFC, including greater numbers of both
cents high in either sensation seeking or anxiety. The astrocytes and oligodendrocytes that support neuronal activ-
intervention was a multi-dimensional cognitive-behavioral ity (Mandyam et al., 2007). Similarly, rats raised during the
approach that included lessons on the consequences of coping periadolescent period in an enriched environment that
strategies that centered around high-risk personality dimen- promotes physical activity display a decrease in DA trans-
sions such as sensation seeking. Subjects completed activities porter function in mPFC (Zhu et al., 2005), which presumably
designed to recognize automatic thoughts and engaged in leads to an increase in extracellular DA available in this region.
group exercises based on real-life scenarios. Compared to a Physical activity induced by access to a running wheel or
non-intervention control group, impulsive binge drinking was exposure to enrichment decreases cocaine and amphetamine
reduced by the intervention. It would be interesting to self-administration (Bardo et al., 2001; Cosgrove et al., 2002;
determine if the reduction in binge drinking was associated Smith et al., 2008), as well as decreasing impulsive choice on a
with increased activity in PFC regions. delay discounting task (Perry et al., 2008). Thus, physical
Although training exercises designed to engage PFC activity and enriched environments appear to protect against
inhibitory processes may seem like an appealing idea to PFC-mediated impulsivity and drug abuse vulnerability, at
reduce drug abuse vulnerability, there may be a paradoxical least in preclinical models.
risk to such a strategy. While the ability to exert inhibitory One of the most salient examples of how an understanding
control over thoughts, emotions and actions is a central of PFC dysfunction may inform prevention intervention
process of human existence, self-control is a limited resource strategies rests with work conducted in maltreated children
that can be exhausted under certain situations. This phenom- raised in foster care. Children raised in foster care display a
138 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

deficit in salivary cortisol levels measured in the early abusing humans tested during a period of abstinence show
morning and this deficit may be normalized with suitable hypoactivity in this PFC region (Volkow et al., 2004).
interventions (Fisher et al., 2000, 2007; Gunnar and Fisher, Medication is a viable treatment intervention approach
2006). mPFC is an important component of the neurocircuitry (Vocci, 2008). Among the various pharmacotherapeutic
that regulates pituitary secretion of adrenocorticotropic hor- options, perhaps the most relevant for altering PFC function
mone via the paraventricular nucleus of the hypothalamus are drugs that work selectively on monoamine and amino acid
(Gunnar and Fisher, 2006). This raises the possibility that neurotransmission. As described previously, these neuro-
maltreated children have a deficit in mPFC inhibitory pro- transmitter systems subserve PFC circuitry and impulsivity
cesses involved in the hypothalamic-pituitary adrenal axis, as (Pattij and Vanderschuren, 2008). Preclinical evidence indi-
well as in self-control. To the extent that an intervention can cates that impulsive action in the 5CSRT task is decreased by
normalize the blunted cortisol response, this may serve as a the NE reuptake inhibitor atomoxetine (Robinson et al., 2008b)
marker for determining the effectiveness of intervention and increased by the NE autoreceptor agonist clonidine (van
strategies targeting stress-related risky behaviors. Gaalen et al., 2006). In humans, atomoxetine is used to treat
Among the various predisposing psychopathological fac- ADHD and shows promise for treatment of stimulant abuse
tors that predict risk for drug abuse, the presence of ADHD is (Sofuoglu and Sewell, 2009; Stoops et al., 2008). Buspirone may
thought to be a significant contributor. Adolescents with also be useful, as it a partial agonist at 5-HT autoreceptors and
ADHD are impulsive in a variety of tasks (Solanto, 2002) and it is currently used to treat anxiety. Consistent with this,
stimulant drugs such as amphetamine and methylphenidate repeated administration of buspirone lowers 5-HT levels in
are effective in treating ADHD. While there is some contro- mPFC and decreases impulsive choice (Liu et al., 2004). Finally,
versy in the field, evidence suggests that non-medicated antagonism of mGluRs may also have utility because recent
ADHD children are at increased risk for drug abuse, and this preclinical evidence indicates that blockade of these receptors
risk factor may be mitigated by medication (Winstanley et al., decreases impulsive action (Sukhotina et al., 2008).
2006a). ADHD is thought to stem, at least in part, from PFC An alternative neurobehavioral approach to reduce risky
dysfunction (Castellanos and Tannock, 2002), suggesting that behavior involves the application of direct current stimulation
stimulant drugs may decrease risk by normalizing inhibitory to PFC. High-frequency transcortical magnetic stimulation of
control in PFC. the skull overlying the right PFC reduces craving for cocaine
(Camprodon et al., 2007). While the precise mechanisms and
6.2. Treatment extent of brain subregions affected need to be characterized
more fully, the decrease in craving likely relates to enhanced
A more complete understanding of PFC involvement in cortical excitability of critical inhibitory areas of right lPFC in
behavioral inhibition also may have important implications proximity to the stimulation site. In contrast to the decrease in
for drug abuse treatment. Impulsivity confers greater risk for drug craving, however, low-frequency transcortical magnetic
initiation and escalation of drug use among adolescents and is stimulation of the right lPFC increases risky behavior in a
known to accompany substance use disorders. While it is decision-making task (Knoch et al., 2006), an outcome that
difficult to disentangle whether impulsivity precedes or would be disadvantageous for promoting abstinence.
results from drug use, controlled studies using laboratory Simultaneous application of excitatory anodal current to
animals indicate that drug use can decrease inhibitory the right lPFC and inhibitory cathodal current to the left lPFC
control, thus leading to greater impulsive choice and impul- also has been investigated. Fecteau et al. (2007) examined the
sive action. However, in a delay discounting task, impulsive effect of this asymmetrical transcortical technique on perfor-
choice is decreased by methamphetamine (Richards et al., mance among healthy young adults in a gambling task
1999) and increased by nicotine (Dallery and Locey, 2005), involving rewards and penalties. Treated subjects showed a
indicating that general conclusions cannot be made across significant increase in choosing low-risk options compared to
different stimulant drugs. Nonetheless, repeated administra- sham-stimulated subjects, as well as compared to subjects
tion of amphetamine, methamphetamine or nicotine who were stimulated with a reverse procedure (i.e., anodal
enhances impulsive choice, even when rats are tested in a current to left lPFC and cathodal current to right lPFC). These
drug free state following withdrawal (Dallery and Locey, 2005; results suggest that excitation of the right PFC and/or
Richards et al., 1999). These latter findings indicate that inhibition of the left PFC enhances inhibitory control. While
chronic exposure to stimulant drugs produces lasting deficits this noninvasive and safe treatment is innovative, the
in inhibitory control. treatment is limited primarily to surface brain structures. It
Similar to the effects observed with experimenter- would be interesting to determine if selective stimulation of
administered stimulants, repeated self-administration of deeper brain regions, such as OFC, would alter risk-taking.
stimulants in rats increases impulsive choice in a delay Individuals also can learn to control fMRI activation of
discounting task (Gipson and Bardo, 2009). Rats learning to selected brain regions using feedback training. Posse et al.
self-administer cocaine show an initial loss of inhibitory (2003) used real-time fMRI feedback in subjects exposed to sad
control, although tolerance to this effect is observed across and neutral faces. Subjects given immediate feedback of
repeated testing (Winstanley, 2007). Upon termination of the amygdala activation to reinforce mood induction displayed
cocaine self-administration, a deficit in inhibitory control re- heightened left-side amygdala activation, which correlated
emerges, suggesting a long-term neural adaptation due to the with the intensity of self-rated sadness, indicating that
cocaine self-administration regimen. OFC may be altered by individuals may be able to control discrete limbic brain
cocaine self-administration, as fMRI studies with cocaine- regions. More recent evidence indicates that PFC regions also
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 139

may be trained by feedback control. deCharms et al. (2005) section, a number of strategies for promoting PFC-mediated
used real-time fMRI to train chronic pain patients to alter inhibitory control are emerging. It would be beneficial for these
activity of right ACC, a structure involved in pain perception. strategies to be employed in a manner that appeals to or
Patients trained to control right ACC brain activation reported targets vulnerable populations (e.g., high sensation seekers,
a reduction in ongoing pain. Perhaps similar technology could adolescents). Thus, a major challenge in drug abuse prevention
be used to train individuals to recruit discrete PFC regions and treatment rests with identifying individuals at risk due to
involved in inhibitory control in order to reduce impulsive and deficits in PFC function and improving intervention strategies
unhealthy behaviors. aimed at strengthening PFC inhibitory systems among these
Finally, craving among drug abusing subjects may be individuals.
especially sensitive to treatments designed to alter PFC
activity. When drug abusing individuals are exposed to cues
associated previously with cocaine, such as a crack pipe or
Acknowledgments
syringe, there is an increase in subject-rated and physiological
craving. Although many cortical and subcortical brain regions
This work was supported by NIH grants P50 DA05312, R01
subserve craving, PFC areas play a prominent role (Bonson et
DA012964 and R21 DA024401. J. L. Perry was supported by an
al., 2002; Childress et al., 1999; Grant et al., 1996; Wang et al.,
NIH training grant (T32 DA007304). We acknowledge the
1999). For example, Childress et al. (1999) reported that
assistance of Emily Denehy in preparing the manuscript and
detoxified male cocaine users exposed to cocaine-related
Kenn Minter in preparing the anatomical drawings.
videos experienced craving and showed limbic activation,
including ACC. Bonson et al. (2002) extended these findings by
showing that cue-elicited cocaine craving also involves OFC
REFERENCES
activation (defined by increased glucose metabolism mea-
sured with positron emission tomography) and that this
activation is correlated with craving intensity. Cue-elicited Ahern, G.L., Herring, A.M., Tackenberg, J.N., Schwartz, G.E., Seeger,
craving was also associated with mPFC deactivation, suggest- J.F., Labiner, D.M., Weinand, M.E., Oommen, K.J., 1994. Affective
ing that craving involves a neural network of co-activation and self-report during the intracarotid sodium amobarbital test
deactivation of multiple PFC regions. Future research should J. Clin. Exp. Neuropsychol. 16, 372–376.
determine what specific therapeutic approaches are most Alia-Klein, N., Goldstein, R.Z., Tomasi, D., Zhang, L., Fagin-Jones,
effective in reducing drug craving mediated by PFC circuits. S., Telang, F., Wang, G.J., Fowler, J.S., Volkow, N.D., 2007. What
is in a word? No versus Yes differentially engage the lateral
orbitofrontal cortex. Emotion 7, 649–659.
Amiez, C., Joseph, J.P., Procyk, E., 2006. Reward encoding in the
7. Final comment monkey anterior cingulate cortex. Cereb. Cortex 16, 1040–1055.
Andreason, P.J., Zametkin, A.J., Guo, A.C., Baldwin, P., Cohen, R.M.,
While this review has emphasized the role of PFC in inhibitory 1994. Gender-related differences in regional cerebral glucose
control related to drug abuse and other risk-related behaviors, metabolism in normal volunteers. Psychiatry Res. 51, 175–183.
Andrucci, G.L., Archer, R.P., Pancoast, D.L., Gordon, R.A., 1989. The
much information about PFC function has been ignored for the
relationship of MMPI and Sensation Seeking Scales to
sake of clarity. The large human PFC, which accounts for 30% of
adolescent drug use. J. Pers. Assess. 53, 253–266.
cortical mass, is inextricably tied to many functions that define Arnsten, A.F., 2009. The emerging neurobiology of attention deficit
the whole human experience, including emotion, attention, hyperactivity disorder: the key role of the prefrontal
reward, rule learning and memory formation. While a long- association cortex. J. Pediatr. 154, I-S43.
standing idea is that mPFC and OFC are associated with Arnsten, A.F., Goldman-Rakic, P.S., 1998. Noise stress impairs
behavioral inhibition and lPFC is associated with attention and prefrontal cortical cognitive function in monkeys: evidence for
a hyperdopaminergic mechanism. Arch. Gen. Psychiatry 55,
memory (Goldman-Rakic, 1987), this demarcation is more
362–368.
heuristic than precise. Nonetheless, there is a general view Arnsten, A.F., Cai, J.X., Goldman-Rakic, P.S., 1988. The alpha-2
that PFC serves as a “top-down” modulator of underlying adrenergic agonist guanfacine improves memory in aged
neural circuits, rather than being in series with underlying monkeys without sedative or hypotensive side effects:
neural circuits (Miller and Cohen, 2001). This view suggests evidence for alpha-2 receptor subtypes. J. Neurosci. 8, 4287–4298.
that PFC exerts influence on other brain structures, thus Arnsten, A.F., Murphy, B., Merchant, K., 2000. The selective
integrating behaviorally relevant information that maximizes dopamine D4 receptor antagonist, PNU-101387G, prevents
stress-induced cognitive deficits in monkeys
an adaptive capacity which prevents an overreliance on fixed
Neuropsychopharmacology 23, 405–410.
action patterns, prepotent thoughts and feelings. Without PFC, Aron, A.R., Poldrack, R.A., 2006. Cortical and subcortical
compulsive behaviors driven by structures in the lower brain contributions to Stop signal response inhibition: role of the
(e.g., VTA) would dominate. In the case of drug abuse subthalamic nucleus. J. Neurosci. 26, 2424–2433.
vulnerability, these well-established neural pathways would Baeg, E.H., Jackson, M.E., Jedema, H.P., Bradberry, C.W., 2009.
be those that subserve addictive behaviors, such as ascending Orbitofrontal and anterior cingulate cortex neurons selectively
process cocaine-associated environmental cues in the rhesus
mesocorticolimbic DA projections. Therefore, strengthening
monkey. J. Neurosci. 29, 11619–11627.
the descending projections from the prefrontal cortex that are
Baler, R.D., Volkow, N.D., 2006. Drug addiction: the neurobiology of
responsible for inhibitory control could decrease drug abuse disrupted self-control. Trends Mol. Med. 12, 559–566.
vulnerability or the likelihood of relapse, and may be especially Ball, S.A., 2004. Personality Traits, Disorders, and Substance
important for at-risk individuals. As mentioned in the previous Abuse. Elsevier, New York.
140 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

Balleine, B.W., Dickinson, A., 1998. Goal-directed instrumental Bonson, K.R., Grant, S.J., Contoreggi, C.S., Links, J.M., Metcalfe, J.,
action: contingency and incentive learning and their cortical Weyl, H.L., Kurian, V., Ernst, M., London, E.D., 2002. Neural
substrates. Neuropharmacology 37, 407–419. systems and cue-induced cocaine craving
Banich, M.T., Crowley, T.J., Thompson, L.L., Jacobson, B.L., Liu, X., Neuropsychopharmacology 26, 376–386.
Raymond, K.M., Claus, E.D., 2007. Brain activation during the Botvin, G.J., Griffin, K.W., 2007. School-based programmes to
Stroop task in adolescents with severe substance and conduct prevent alcohol, tobacco and other drug use. Int. Rev.
problems: a pilot study. Drug Alcohol Depend. 90, 175–182. Psychiatry 19, 607–615.
Barbas, H., Pandya, D.N., 1989. Architecture and intrinsic Bowman, R.E., Beck, K.D., Luine, V.N., 2003. Chronic stress effects
connections of the prefrontal cortex in the rhesus monkey on memory: sex differences in performance and
J. Comp. Neurol. 286, 353–375. monoaminergic activity. Horm. Behav. 43, 48–59.
Bardo, M.T., Donohew, R.L., Harrington, N.G., 1996. Psychobiology Bowman, R.E., Micik, R., Gautreaux, C., Fernandez, L., Luine, V.N.,
of novelty seeking and drug seeking behavior. Behav. Brain Res. 2009. Sex-dependent changes in anxiety, memory, and
77, 23–43. monoamines following one week of stress. Physiol. Behav. 97,
Bardo, M.T., Klebaur, J.E., Valone, J.M., Deaton, C., 2001. 21–29.
Environmental enrichment decreases intravenous Brailowsky, S., Knight, R.T., Blood, K., Scabini, D., 1986.
self-administration of amphetamine in female and male rats. gamma-Aminobutyric acid-induced potentiation of cortical
Psychopharmacology (Berl.) 155, 278–284. hemiplegia. Brain Res. 362, 322–330.
Barnes, N.M., Sharp, T., 1999. A review of central 5-HT receptors Breiter, H.C., Gollub, R.L., Weisskoff, R.M., Kennedy, D.N., Makris,
and their function. Neuropharmacology 38, 1083–1152. N., Berke, J.D., Goodman, J.M., Kantor, H.L., Gastfriend, D.R.,
Bates, J.F., Goldman-Rakic, P.S., 1993. Prefrontal connections of Riorden, J.P., Mathew, R.T., Rosen, B.R., Hyman, S.E., 1997.
medial motor areas in the rhesus monkey. J. Comp. Neurol. 336, Acute effects of cocaine on human brain activity and emotion.
211–228. Neuron 19, 591–611.
Baumeister, R.F., Heatherton, T.R., 1996. Self-regulation failure: an Brody, A.L., Mandelkern, M.A., Olmstead, R.E., Jou, J., Tiongson, E.,
overview. Psychol. Inq. 7, 1–15. Allen, V., Scheibal, D., London, E.D., Monterosso, J.R., Tiffany, S.
Bechara, A., 2005. Decision making, impulse control and loss of T., Korb, A., Gan, J.J., Cohen, M.S., 2007. Neural substrates of
willpower to resist drugs: a neurocognitive perspective resisting craving during cigarette cue exposure. Biol. Psychiatry
Nat. Neurosci. 8, 1458–1463. 62, 642–651.
Bechara, A., Damasio, A.R., Damasio, H., Anderson, S.W., 1994. Bromberg, M.B., Penney Jr., J.B., Stephenson, B.S., Young, A.B., 1981.
Insensitivity to future consequences following damage to Evidence for glutamate as the neurotransmitter of
human prefrontal cortex. Cognition 50, 7–15. corticothalamic and corticorubral pathways. Brain Res. 215,
Bechara, A., Damasio, H., Tranel, D., Damasio, A.R., 1997. Deciding 369–374.
advantageously before knowing the advantageous strategy. Brown, V.J., Bowman, E.M., 2002. Rodent models of prefrontal
Science 275, 1293–1295. cortical function. Trends Neurosci. 25, 340–343.
Bechara, A., Damasio, H., Damasio, A.R., 2000a. Emotion, decision Buck, S.M., Hillman, C.H., Castelli, D.M., 2008. The relation of
making and the orbitofrontal cortex. Cereb. Cortex 10, 295–307. aerobic fitness to stroop task performance in preadolescent
Bechara, A., Tranel, D., Damasio, H., 2000b. Characterization of the children. Med. Sci. Sports Exerc. 40, 166–172.
decision-making deficit of patients with ventromedial Bush, G., Frazier, J.A., Rauch, S.L., Seidman, L.J., Whalen, P.J.,
prefrontal cortex lesions. Brain 123 (Pt 11), 2189–2202. Jenike, M.A., Rosen, B.R., Biederman, J., 1999. Anterior cingulate
Beck, L.H., Bransome Jr., E.D., Mirsky, A.F., Rosvold, H.E., Sarason, cortex dysfunction in attention-deficit/hyperactivity disorder
I., 1956. A continuous performance test of brain damage revealed by fMRI and the Counting Stroop. Biol. Psychiatry 45,
J. Consult. Psychol. 20, 343–350. 1542–1552.
Berridge, K.C., Robinson, T.E., 1998. What is the role of dopamine in Bylund, D.B., Eikenberg, D.C., Hieble, J.P., Langer, S.Z., Lefkowitz, R.
reward: hedonic impact, reward learning, or incentive J., Minneman, K.P., Molinoff, P.B., Ruffolo Jr., R.R.,
salience? Brain Res. Brain Res. Rev. 28, 309–369. Trendelenburg, U., 1994. International Union of Pharmacology
Blakemore, S.J., 2008. The social brain in adolescence. Nat. Rev. nomenclature of adrenoceptors. Pharmacol. Rev. 46, 121–136.
Neurosci. 9, 267–277. Cahill, L., Haier, R.J., White, N.S., Fallon, J., Kilpatrick, L., Lawrence,
Blondeau, C., Dellu-Hagedorn, F., 2007. Dimensional analysis of C., Potkin, S.G., Alkire, M.T., 2001. Sex-related difference in
ADHD subtypes in rats. Biol. Psychiatry 61, 1340–1350. amygdala activity during emotionally influenced memory
Bock, J., Murmu, R.P., Ferdman, N., Leshem, M., Braun, K., 2008. storage. Neurobiol. Learn. Mem. 75, 1–9.
Refinement of dendritic and synaptic networks in the rodent Calver, A.R., Davies, C.H., Pangalos, M., 2002. GABA(B) receptors:
anterior cingulate and orbitofrontal cortex: critical impact of from monogamy to promiscuity. Neurosignals 11, 299–314.
early and late social experience. Dev. Neurobiol. 68, 685–695. Camprodon, J.A., Martinez-Raga, J., Alonso-Alonso, M., Shih, M.C.,
Bolla, K.I., Eldreth, D.A., London, E.D., Kiehl, K.A., Mouratidis, M., Pascual-Leone, A., 2007. One session of high frequency
Contoreggi, C., Matochik, J.A., Kurian, V., Cadet, J.L., Kimes, A.S., repetitive transcranial magnetic stimulation (rTMS) to the right
Funderburk, F.R., Ernst, M., 2003. Orbitofrontal cortex prefrontal cortex transiently reduces cocaine craving. Drug
dysfunction in abstinent cocaine abusers performing a Alcohol Depend. 86, 91–94.
decision-making task. Neuroimage 19, 1085–1094. Capriles, N., Rodaros, D., Sorge, R.E., Stewart, J., 2003. A role for the
Bolla, K., Ernst, M., Kiehl, K., Mouratidis, M., Eldreth, D., Contoreggi, prefrontal cortex in stress- and cocaine-induced reinstatement
C., Matochik, J., Kurian, V., Cadet, J., Kimes, A., Funderburk, F., of cocaine seeking in rats. Psychopharmacology (Berl.) 168,
London, E., 2004a. Prefrontal cortical dysfunction in abstinent 66–74.
cocaine abusers. J. Neuropsychiatry Clin. Neurosci. 16, 456–464. Cardinal, R.N., Pennicott, D.R., Sugathapala, C.L., Robbins, T.W.,
Bolla, K.I., Eldreth, D.A., Matochik, J.A., Cadet, J.L., 2004b. Everitt, B.J., 2001. Impulsive choice induced in rats by lesions of
Sex-related differences in a gambling task and its neurological the nucleus accumbens core. Science 292, 2499–2501.
correlates. Cereb. Cortex 14, 1226–1232. Carli, M., Robbins, T.W., Evenden, J.L., Everitt, B.J., 1983. Effects of
Bolla, K.I., Eldreth, D.A., Matochik, J.A., Cadet, J.L., 2005. Neural lesions to ascending noradrenergic neurones on
substrates of faulty decision-making in abstinent marijuana performance of a 5-choice serial reaction task in rats;
users. Neuroimage 26, 480–492. implications for theories of dorsal noradrenergic bundle
Bonisch, H., Bruss, M., 2006. The norepinephrine transporter in function based on selective attention and arousal. Behav.
physiology and disease. Handb. Exp. Pharmacol. 485–524. Brain Res. 9, 361–380.
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 141

Carmichael, S.T., Price, J.L., 1994. Architectonic subdivision of the Craig, A.D., 2005. Forebrain emotional asymmetry: a
orbital and medial prefrontal cortex in the macaque monkey neuroanatomical basis? Trends Cogn. Sci. 9, 566–571.
J. Comp. Neurol. 346, 366–402. Crawford, A.M., Pentz, M.A., Chou, C.P., Li, C., Dwyer, J.H., 2003.
Castellanos, F.X., Tannock, R., 2002. Neuroscience of Parallel developmental trajectories of sensation seeking and
attention-deficit/hyperactivity disorder: the search for regular substance use in adolescents. Psychol. Addict. Behav.
endophenotypes. Nat. Rev. Neurosci. 3, 617–628. 17, 179–192.
Castner, S.A., Vosler, P.S., Goldman-Rakic, P.S., 2005. Crone, E.A., Bunge, S.A., Latenstein, H., van der Molen, M.W., 2005.
Amphetamine sensitization impairs cognition and reduces Characterization of children's decision making: sensitivity to
dopamine turnover in primate prefrontal cortex. Biol. punishment frequency, not task complexity. Child
Psychiatry 57, 743–751. Neuropsychol. 11, 245–263.
Cavedini, P., Riboldi, G., Keller, R., D'Annucci, A., Bellodi, L., 2002. Cunningham, M.G., Bhattacharyya, S., Benes, F.M., 2002.
Frontal lobe dysfunction in pathological gambling patients. Amygdalo-cortical sprouting continues into early adulthood:
Biol. Psychiatry 51, 334–341. implications for the development of normal and abnormal
Chamberlain, S.R., Muller, U., Blackwell, A.D., Clark, L., Robbins, T.W., function during adolescence. J. Comp. Neurol. 453, 116–130.
Sahakian, B.J., 2006. Neurochemical modulation of Dallery, J., Locey, M.L., 2005. Effects of acute and chronic nicotine
response inhibition and probabilistic learning in humans. on impulsive choice in rats. Behav. Pharmacol. 16, 15–23.
Science 311, 861–863. Dalley, J.W., Theobald, D.E., Eagle, D.M., Passetti, F., Robbins, T.W.,
Charrier, D., Thiebot, M.H., 1996. Effects of psychotropic drugs on 2002. Deficits in impulse control associated with
rat responding in an operant paradigm involving choice tonically-elevated serotonergic function in rat prefrontal
between delayed reinforcers. Pharmacol. Biochem. Behav. 54, cortex. Neuropsychopharmacology 26, 716–728.
149–157. Dalley, J.W., Cardinal, R.N., Robbins, T.W., 2004. Prefrontal
Childress, A.R., Mozley, P.D., McElgin, W., Fitzgerald, J., Reivich, M., executive and cognitive functions in rodents: neural and
O'Brien, C.P., 1999. Limbic activation during cue-induced neurochemical substrates. Neurosci. Biobehav. Rev. 28,
cocaine craving. Am. J. Psychiatry 156, 11–18. 771–784.
Christie, M.J., Summers, R.J., Stephenson, J.A., Cook, C.J., Beart, P.M., Dalley, J.W., Fryer, T.D., Brichard, L., Robinson, E.S., Theobald, D.E.,
1987. Excitatory amino acid projections to the nucleus Laane, K., Pena, Y., Murphy, E.R., Shah, Y., Probst, K., Abakumova,
accumbens septi in the rat: a retrograde transport study utilizing I., Aigbirhio, F.I., Richards, H.K., Hong, Y., Baron, J.C., Everitt, B.J.,
D[3H]aspartate and [3H]GABA. Neuroscience 22, 425–439. Robbins, T.W., 2007. Nucleus accumbens D2/3 receptors predict
Chudasama, Y., Muir, J.L., 2001. Visual attention in the rat: a role trait impulsivity and cocaine reinforcement. Science 315,
for the prelimbic cortex and thalamic nuclei? Behav. Neurosci. 1267–1270.
115, 417–428. Dawe, S., Loxton, N.J., 2004. The role of impulsivity in the
Chudasama, Y., Robbins, T.W., 2003. Dissociable contributions of development of substance use and eating disorders. Neurosci.
the orbitofrontal and infralimbic cortex to pavlovian Biobehav. Rev. 28, 343–351.
autoshaping and discrimination reversal learning: further De Pascalis, V., Arwari, B., D'Antuono, L., Cacace, I., 2009.
evidence for the functional heterogeneity of the rodent frontal Impulsivity and semantic/emotional processing: an
cortex. J. Neurosci. 23, 8771–8780. examination of the N400 wave. Clin. Neurophysiol. 120, 85–92.
Chudasama, Y., Passetti, F., Rhodes, S.E., Lopian, D., Desai, A., de Wit, H., Richards, J.B., 2004. Dual determinants of drug use in
Robbins, T.W., 2003. Dissociable aspects of performance on the humans: reward and impulsivity. Nebr. Symp. Motiv. 50, 19–55.
5-choice serial reaction time task following lesions of the Deakin, J., Aitken, M., Robbins, T., Sahakian, B.J., 2004. Risk taking
dorsal anterior cingulate, infralimbic and orbitofrontal cortex during decision-making in normal volunteers changes with
in the rat: differential effects on selectivity, impulsivity and age. J. Int. Neuropsychol. Soc. 10, 590–598.
compulsivity. Behav. Brain Res. 146, 105–119. deCharms, R.C., Maeda, F., Glover, G.H., Ludlow, D., Pauly, J.M.,
Clark, L., Bechara, A., Damasio, H., Aitken, M.R., Sahakian, B.J., Soneji, D., Gabrieli, J.D., Mackey, S.C., 2005. Control over brain
Robbins, T.W., 2008. Differential effects of insular and activation and pain learned by using real-time functional MRI.
ventromedial prefrontal cortex lesions on risky Proc. Natl. Acad. Sci. U. S. A. 102, 18626–18631.
decision-making. Brain 131, 1311–1322. Del Arco, A., Mora, F., 2008. Prefrontal cortex-nucleus accumbens
Conde, F., Maire-Lepoivre, E., Audinat, E., Crepel, F., 1995. Afferent interaction: in vivo modulation by dopamine and glutamate in
connections of the medial frontal cortex of the rat. II. Cortical the prefrontal cortex. Pharmacol. Biochem. Behav. 90, 226–235.
and subcortical afferents. J. Comp. Neurol. 352, 567–593. Delatour, B., Gisquet-Verrier, P., 2001. Involvement of the dorsal
Conn, P.J., Pin, J.P., 1997. Pharmacology and functions of anterior cingulate cortex in temporal behavioral sequencing:
metabotropic glutamate receptors. Annu. Rev. Pharmacol. subregional analysis of the medial prefrontal cortex in rat.
Toxicol. 37, 205–237. Behav. Brain Res. 126, 105–114.
Conrod, P.J., Stewart, S.H., Comeau, N., Maclean, A.M., 2006. Denenberg, V.H., 1964. Critical periods, stimulus input, and
Efficacy of cognitive-behavioral interventions targeting emotional reactivity: a theory of infantile stimulation. Psychol.
personality risk factors for youth alcohol misuse. J. Clin. Child Rev. 71, 335–351.
Adolesc. Psychol. 35, 550–563. Depue, R.A., Collins, P.F., 1999. Neurobiology of the structure of
Cools, R., Clark, L., Owen, A.M., Robbins, T.W., 2002. Defining the personality: dopamine, facilitation of incentive motivation,
neural mechanisms of probabilistic reversal learning using and extraversion. Behav. Brain Sci. 22, 491–517
event-related functional magnetic resonance imaging. (discussion 518-469).
J. Neurosci. 22, 4563–4567. Diergaarde, L., Pattij, T., Poortvliet, I., Hogenboom, F., de Vries, W.,
Cosgrove, K.P., Hunter, R.G., Carroll, M.E., 2002. Wheel-running Schoffelmeer, A.N., De Vries, T.J., 2008. Impulsive choice and
attenuates intravenous cocaine self-administration in rats: sex impulsive action predict vulnerability to distinct stages of
differences. Pharmacol. Biochem. Behav. 73, 663–671. nicotine seeking in rats. Biol. Psychiatry 63, 301–308.
Coutureau, E., Killcross, S., 2003. Inactivation of the infralimbic Dietrich, A., Allen, J.D., 1998. Functional dissociation of the
prefrontal cortex reinstates goal-directed responding in prefrontal cortex and the hippocampus in timing behavior.
overtrained rats. Behav. Brain Res. 146, 167–174. Behav. Neurosci. 112, 1043–1047.
Cragg, B.G., 1974. Plasticity of synapses. Br. Med. Bull. 30, 141–144. Dingledine, R., 1983. N-methyl aspartate activates
Cragg, B.G., 1975. The development of synapses in the visual voltage-dependent calcium conductance in rat hippocampal
system of the cat. J. Comp. Neurol. 160, 147–166. pyramidal cells. J. Physiol. 343, 385–405.
142 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

Donohew, R.L., Lorch, E.P., Palmgreen, P., 1991. In: Persuasive Fishbein, D.H., Eldreth, D.L., Hyde, C., Matochik, J.A., London, E.D.,
communication and drug abuse prevention. Vol., L. Donohew, Contoreggi, C., Kurian, V., Kimes, A.S., Breeden, A., Grant, S.,
H. Sypher, Bukoski, ed.^eds. Lawrence Erlbaum, Hillsdale, 2005. Risky decision making and the anterior cingulate cortex
pp. 209-226. in abstinent drug abusers and nonusers. Brain Res. Cogn. Brain
Donohew, L., Lorch, E.P., Palmgreen, P., 1998. Applications of a Res. 23, 119–136.
theoretic model of information exposure to health Fishbein, D.H., Hyde, C., Eldreth, D., Paschall, M.J., Hubal, R., Das,
interventions. Hum. Commun. Res. 24, 454–468. A., Tarter, R., Ialongo, N., Hubbard, S., Yung, B., 2006.
Dostert, P.L., Strolin Benedetti, M., Tipton, K.F., 1989. Interactions Neurocognitive skills moderate urban male adolescents'
of monoamine oxidase with substrates and inhibitors. Med. responses to preventive intervention materials. Drug Alcohol
Res. Rev. 9, 45–89. Depend. 82, 47–60.
Eagle, D.M., Robbins, T.W., 2003. Inhibitory control in rats Fishbein, D.H., Krupitsky, E., Flannery, B.A., Langevin, D.J.,
performing a stop-signal reaction-time task: effects of lesions Bobashev, G., Verbitskaya, E., Augustine, C.B., Bolla, K.I.,
of the medial striatum and D-amphetamine. Behav. Neurosci. Zvartau, E., Schech, B., Egorova, V., Bushara, N., Tsoy, M., 2007.
117, 1302–1317. Neurocognitive characterizations of Russian heroin addicts
Eagle, D.M., Tufft, M.R., Goodchild, H.L., Robbins, T.W., 2007. without a significant history of other drug use. Drug Alcohol
Differential effects of modafinil and methylphenidate on Depend. 90, 25–38.
stop-signal reaction time task performance in the rat, and Fisher, P.A., Gunnar, M.R., Chamberlain, P., Reid, J.B., 2000.
interactions with the dopamine receptor antagonist Preventive intervention for maltreated preschool children:
cis-flupenthixol. Psychopharmacology (Berl.) 192, 193–206. impact on children's behavior, neuroendocrine activity, and
Eldreth, D.A., Matochik, J.A., Cadet, J.L., Bolla, K.I., 2004. Abnormal foster parent functioning. J. Am. Acad. Child Adolesc.
brain activity in prefrontal brain regions in abstinent Psychiatry 39, 1356–1364.
marijuana users. Neuroimage 23, 914–920. Fisher, P.A., Stoolmiller, M., Gunnar, M.R., Burraston, B.O., 2007.
Ernst, M., Kimes, A.S., London, E.D., Matochik, J.A., Eldreth, D., Effects of a therapeutic intervention for foster preschoolers on
Tata, S., Contoreggi, C., Leff, M., Bolla, K., 2003. Neural diurnal cortisol activity. Psychoneuroendocrinology 32,
substrates of decision making in adults with attention 892–905.
deficit hyperactivity disorder. Am. J. Psychiatry 160, 1061–1070. Fletcher, P.J., Tampakeras, M., Sinyard, J., Higgins, G.A., 2007.
Eshel, N., Nelson, E.E., Blair, R.J., Pine, D.S., Ernst, M., 2007. Neural Opposing effects of 5-HT(2A) and 5-HT(2C) receptor
substrates of choice selection in adults and adolescents: antagonists in the rat and mouse on premature responding in
development of the ventrolateral prefrontal and anterior the five-choice serial reaction time test. Psychopharmacology
cingulate cortices. Neuropsychologia 45, 1270–1279. (Berl.) 195, 223–234.
Evenden, J.L., Ryan, C.N., 1996. The pharmacology of impulsive Floresco, S.B., 2007. Dopaminergic regulation of limbic-striatal
behaviour in rats: the effects of drugs on response choice with interplay. J. Psychiatry Neurosci. 32, 400–411.
varying delays of reinforcement. Psychopharmacology (Berl.) Floresco, S.B., Tse, M.T., Ghods-Sharifi, S., 2008. Dopaminergic and
128, 161–170. glutamatergic regulation of effort- and delay-based decision
Evenden, J.L., Ryan, C.N., 1999. The pharmacology of impulsive making. Neuropsychopharmacology 33, 1966–1979.
behaviour in rats VI: the effects of ethanol and selective Floyd, N.S., Price, J.L., Ferry, A.T., Keay, K.A., Bandler, R., 2000.
serotonergic drugs on response choice with varying Orbitomedial prefrontal cortical projections to distinct
delays of reinforcement. Psychopharmacology (Berl.) 146, longitudinal columns of the periaqueductal gray in the rat.
413–421. J. Comp. Neurol. 422, 556–578.
Everitt, B.J., Hutcheson, D.M., Ersche, K.D., Pelloux, Y., Dalley, J.W., Floyd, N.S., Price, J.L., Ferry, A.T., Keay, K.A., Bandler, R., 2001.
Robbins, T.W., 2007. The orbital prefrontal cortex and drug Orbitomedial prefrontal cortical projections to hypothalamus
addiction in laboratory animals and humans. Ann. N. Y. Acad. in the rat. J. Comp. Neurol. 432, 307–328.
Sci. 1121, 576–597. Fonnum, F., Soreide, A., Kvale, I., Walker, J., Walaas, I., 1981a.
Farrar, A.M., Font, L., Pereira, M., Mingote, S., Bunce, J.G., Chrobak, Glutamate in cortical fibers. Adv. Biochem. Psychopharmacol.
J.J., Salamone, J.D., 2008. Forebrain circuitry involved in 27, 29–41.
effort-related choice: injections of the GABAA agonist Fonnum, F., Storm-Mathisen, J., Divac, I., 1981b. Biochemical
muscimol into ventral pallidum alter response allocation in evidence for glutamate as neurotransmitter in corticostriatal
food-seeking behavior. Neuroscience 152, 321–330. and corticothalamic fibres in rat brain. Neuroscience 6,
Fecteau, S., Knoch, D., Fregni, F., Sultani, N., Boggio, P., 863–873.
Pascual-Leone, A., 2007. Diminishing risk-taking behavior by Forbush, K.T., Shaw, M., Graeber, M.A., Hovick, L., Meyer, V.J.,
modulating activity in the prefrontal cortex: a direct current Moser, D.J., Bayless, J., Watson, D., Black, D.W., 2008.
stimulation study. J. Neurosci. 27, 12500–12505. Neuropsychological characteristics and personality traits in
Fillmore, M.T., 2003. Drug abuse as a problem of impaired control: pathological gambling. CNS Spectr. 13, 306–315.
current approaches and findings. Behav. Cogn. Neurosci. Rev. Frankle, W.G., Lombardo, I., New, A.S., Goodman, M., Talbot, P.S.,
2, 179–197. Huang, Y., Hwang, D.R., Slifstein, M., Curry, S., Abi-Dargham,
Fillmore, M.T., Rush, C.R., 2002. Impaired inhibitory control of A., Laruelle, M., Siever, L.J., 2005. Brain serotonin transporter
behavior in chronic cocaine users. Drug Alcohol Depend. 66, distribution in subjects with impulsive aggressivity: a positron
265–273. emission study with [11C]McN 5652. Am. J. Psychiatry 162,
Fillmore, M.T., Weafer, J., 2004. Alcohol impairment of behavior in 915–923.
men and women. Addiction 99, 1237–1246. Franklin, T.R., Acton, P.D., Maldjian, J.A., Gray, J.D., Croft, J.R.,
Fillmore, M.T., Rush, C.R., Kelly, T.H., Hays, L., 2001. Triazolam Dackis, C.A., O'Brien, C.P., Childress, A.R., 2002. Decreased gray
impairs inhibitory control of behavior in humans. Exp. Clin. matter concentration in the insular, orbitofrontal, cingulate,
Psychopharmacol. 9, 363–371. and temporal cortices of cocaine patients. Biol. Psychiatry 51,
Fillmore, M.T., Ostling, E.W., Martin, C.A., Kelly, T.H., 2009. Acute 134–142.
effects of alcohol on inhibitory control and information Franowicz, J.S., Kessler, L.E., Borja, C.M., Kobilka, B.K., Limbird, L.E.,
processing in high and low sensation-seekers. Drug Alcohol Arnsten, A.F., 2002. Mutation of the alpha2A-adrenoceptor
Depend. 100, 91–99. impairs working memory performance and annuls
Fishbein, D., 2000. The importance of neurobiological research to cognitive enhancement by guanfacine. J. Neurosci. 22,
the prevention of psychopathology. Prev. Sci. 1, 89–106. 8771–8777.
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 143

Frysztak, R.J., Neafsey, E.J., 1991. The effect of medial frontal cortex ketanserin on impulse control in rats. Behav. Brain Res. 204,
lesions on respiration, “freezing,” and ultrasonic vocalizations 88–92.
during conditioned emotional responses in rats. Cereb. Cortex Hampton, A.N., Bossaerts, P., O'Doherty, J.P., 2006. The role of the
1, 418–425. ventromedial prefrontal cortex in abstract state-based
Frysztak, R.J., Neafsey, E.J., 1994. The effect of medial prefrontal inference during decision making in humans. J. Neurosci. 26,
cortex lesions on cardiovascular conditioned emotional 8360–8367.
responses in the rat. Brain Res. 643, 181–193. Heidbreder, C.A., Groenewegen, H.J., 2003. The medial prefrontal
Fuchs, R.A., Evans, K.A., Ledford, C.C., Parker, M.P., Case, J.M., cortex in the rat: evidence for a dorso-ventral distinction based
Mehta, R.H., See, R.E., 2005. The role of the dorsomedial upon functional and anatomical characteristics. Neurosci.
prefrontal cortex, basolateral amygdala, and dorsal Biobehav. Rev. 27, 555–579.
hippocampus in contextual reinstatement of cocaine seeking Helen, C.F., Keri, L.B., Peihua, G., Rajita, S., 2010. Interactive effects
in rats. Neuropsychopharmacology 30, 296–309. of cumulative stress and impulsivity on alcohol consumption.
Fuster, J.M., 2008. The prefrontal cortex. Elsevier, Amsterdam. Alcohol. Clin. Exp. Res. 34, 1376–1385.
Galvan, A., Hare, T.A., Parra, C.E., Penn, J., Voss, H., Glover, G., Heyman, G.M., Gibb, S.P., 2006. Delay discounting in college
Casey, B.J., 2006. Earlier development of the accumbens relative cigarette chippers. Behav. Pharmacol. 17, 669–679.
to orbitofrontal cortex might underlie risk-taking behavior in Higgins, G.A., Enderlin, M., Haman, M., Fletcher, P.J., 2003. The
adolescents. J. Neurosci. 26, 6885–6892. 5-HT2A receptor antagonist M100, 907 attenuates motor and
Garavan, H., Ross, T.J., Murphy, K., Roche, R.A., Stein, E.A., 2002. 'impulsive-type' behaviours produced by NMDA receptor
Dissociable executive functions in the dynamic control of antagonism. Psychopharmacology (Berl.) 170, 309–319.
behavior: inhibition, error detection, and correction Hoerst, M., Weber-Fahr, W., Tunc-Skarka, N., Ruf, M., Bohus, M.,
Neuroimage 17, 1820–1829. Schmahl, C., Ende, G., 2010. Correlation of glutamate levels in
Garavan, H., Kaufman, J.N., Hester, R., 2008. Acute effects of the anterior cingulate cortex with self-reported impulsivity in
cocaine on the neurobiology of cognitive control. Philos. Trans. patients with borderline personality disorder and healthy
R. Soc. Lond. B Biol. Sci. 363, 3267–3276. controls. Arch. Gen. Psychiatry 67, 946–954.
Garon, N., Moore, C., 2004. Complex decision-making in early Holroyd, C.B., Coles, M.G., 2002. The neural basis of human error
childhood. Brain Cogn. 55, 158–170. processing: reinforcement learning, dopamine, and the
Giedd, J.N., Blumenthal, J., Jeffries, N.O., Castellanos, F.X., Liu, H., error-related negativity. Psychol. Rev. 109, 679–709.
Zijdenbos, A., Paus, T., Evans, A.C., Rapoport, J.L., 1999. Brain Hornak, J., O'Doherty, J., Bramham, J., Rolls, E.T., Morris, R.G.,
development during childhood and adolescence: a Bullock, P.R., Polkey, C.E., 2004. Reward-related reversal
longitudinal MRI study. Nat. Neurosci. 2, 861–863. learning after surgical excisions in orbito-frontal or
Gipson, C.D., Bardo, M.T., 2009. Effect of varied access to dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 16,
D-amphetamine self-administration on impulsive choice in a 463–478.
delay discounting task in rats. Psychopharmacology (Berl.) 207, Hoyer, D., Hannon, J.P., Martin, G.R., 2002. Molecular,
391–400. pharmacological and functional diversity of 5-HT receptors.
Gogtay, N., Giedd, J.N., Lusk, L., Hayashi, K.M., Greenstein, D., Pharmacol. Biochem. Behav. 71, 533–554.
Vaituzis, A.C., Nugent III, T.F., Herman, D.H., Clasen, L.S., Toga, Hutcheson, D.M., Everitt, B.J., 2003. The effects of selective
A.W., Rapoport, J.L., Thompson, P.M., 2004. Dynamic mapping orbitofrontal cortex lesions on the acquisition and
of human cortical development during childhood through performance of cue-controlled cocaine seeking in rats
early adulthood. Proc. Natl. Acad. Sci. U. S. A. 101, 8174–8179. Ann. N. Y. Acad. Sci. 1003, 410–411.
Goldman-Rakic, P.S., 1987. Motor control function of the prefrontal Hyman, S.E., Malenka, R.C., Nestler, E.J., 2006. Neural mechanisms
cortex. Ciba Found. Symp. 132, 187–200. of addiction: the role of reward-related learning and memory.
Goldstein, L.E., Rasmusson, A.M., Bunney, B.S., Roth, R.H., 1996. Annu. Rev. Neurosci. 29, 565–598.
Role of the amygdala in the coordination of behavioral, Inzlicht, M., Gutsell, J.N., 2007. Running on empty: neural signals
neuroendocrine, and prefrontal cortical monoamine for self-control failure. Psychol. Sci. 18, 933–937.
responses to psychological stress in the rat. J. Neurosci. 16, Ito, S., Stuphorn, V., Brown, J.W., Schall, J.D., 2003. Performance
4787–4798. monitoring by the anterior cingulate cortex during saccade
Grant, S., London, E.D., Newlin, D.B., Villemagne, V.L., Liu, X., countermanding. Science 302, 120–122.
Contoreggi, C., Phillips, R.L., Kimes, A.S., Margolin, A., 1996. Izquierdo, A., Suda, R.K., Murray, E.A., 2004. Bilateral orbital
Activation of memory circuits during cue-elicited cocaine prefrontal cortex lesions in rhesus monkeys disrupt choices
craving. Proc. Natl. Acad. Sci. U. S. A. 93, 12040–12045. guided by both reward value and reward contingency.
Grant, S., Contoreggi, C., London, E.D., 2000. Drug abusers show J. Neurosci. 24, 7540–7548.
impaired performance in a laboratory test of decision making. Jakala, P., Riekkinen, M., Sirvio, J., Koivisto, E., Riekkinen Jr., P.,
Neuropsychologia 38, 1180–1187. 1999a. Clonidine, but not guanfacine, impairs choice reaction
Groenewegen, H.J., 1988. Organization of the afferent connections time performance in young healthy volunteers
of the mediodorsal thalamic nucleus in the rat, related to the Neuropsychopharmacology 21, 495–502.
mediodorsal–prefrontal topography. Neuroscience 24, 379–431. Jakala, P., Sirvio, J., Riekkinen, M., Koivisto, E., Kejonen, K.,
Groenewegen, H.J., Wright, C.I., Uylings, H.B., 1997. The anatomical Vanhanen, M., Riekkinen Jr., P., 1999b. Guanfacine and
relationships of the prefrontal cortex with limbic structures clonidine, alpha 2-agonists, improve paired associates
and the basal ganglia. J. Psychopharmacol. 11, 99–106. learning, but not delayed matching to sample, in humans.
Gunnar, M.R., Fisher, P.A., 2006. Bringing basic research on early Neuropsychopharmacology 20, 119–130.
experience and stress neurobiology to bear on preventive Jentsch, J.D., Taylor, J.R., 1999. Impulsivity resulting from
interventions for neglected and maltreated children. Dev. frontostriatal dysfunction in drug abuse: implications for the
Psychopathol. 18, 651–677. control of behavior by reward-related stimuli
Gur, R.C., Mozley, L.H., Mozley, P.D., Resnick, S.M., Karp, J.S., Alavi, Psychopharmacology (Berl.) 146, 373–390.
A., Arnold, S.E., Gur, R.E., 1995. Sex differences in regional Jentsch, J.D., Olausson, P., De La Garza II, R., Taylor, J.R., 2002.
cerebral glucose metabolism during a resting state. Science Impairments of reversal learning and response
267, 528–531. perseveration after repeated, intermittent cocaine
Hadamitzky, M., Koch, M., 2009. Effects of acute intra-cerebral administrations to monkeys. Neuropsychopharmacology 26,
administration of the 5-HT(2A/C) receptor ligands DOI and 183–190.
144 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

Jiang, Y., Lianekhammy, J., Lawson, A., Guo, C., Lynam, D., Joseph, Krettek, J.E., Price, J.L., 1977. The cortical projections of the
J.E., Gold, B.T., Kelly, T.H., 2009. Brain responses to repeated mediodorsal nucleus and adjacent thalamic nuclei in the rat.
visual experience among low and high sensation seekers: J. Comp. Neurol. 171, 157–191.
role of boredom susceptibility. Psychiatry Res. 173, 100–106. Kringelbach, M.L., Rolls, E.T., 2004. The functional neuroanatomy
Joel, D., Doljansky, J., Roz, N., Rehavi, M., 2005a. Role of the orbital of the human orbitofrontal cortex: evidence from
cortex and of the serotonergic system in a rat model of neuroimaging and neuropsychology. Prog. Neurobiol. 72,
obsessive compulsive disorder. Neuroscience 130, 25–36. 341–372.
Joel, D., Doljansky, J., Schiller, D., 2005b. 'Compulsive' lever Krystal, J.H., D'Souza, D.C., Mathalon, D., Perry, E., Belger, A.,
pressing in rats is enhanced following lesions to the orbital Hoffman, R., 2003. NMDA receptor antagonist effects, cortical
cortex, but not to the basolateral nucleus of the amygdala or to glutamatergic function, and schizophrenia: toward a paradigm
the dorsal medial prefrontal cortex. Eur. J. Neurosci. 21, shift in medication development. Psychopharmacology (Berl.)
2252–2262. 169, 215–233.
Joseph, J.E., Liu, X., Jiang, Y., Lynam, D., Kelly, T.H., 2009. Neural Lambe, E.K., Krimer, L.S., Goldman-Rakic, P.S., 2000. Differential
correlates of emotional reactivity in sensation seeking postnatal development of catecholamine and serotonin inputs
Psychol. Sci. 20, 215–223. to identified neurons in prefrontal cortex of rhesus monkey.
Kalivas, P.W., 2009. The glutamate homeostasis hypothesis of J. Neurosci. 20, 8780–8787.
addiction. Nat. Rev. Neurosci. 10, 561–572. Lamm, C., Zelazo, P.D., Lewis, M.D., 2006. Neural correlates of
Kalivas, P.W., Volkow, N.D., 2005. The neural basis of addiction: a cognitive control in childhood and adolescence: disentangling
pathology of motivation and choice. Am. J. Psychiatry 162, the contributions of age and executive function
1403–1413. Neuropsychologia 44, 2139–2148.
Kalivas, P.W., Peters, J., Knackstedt, L., 2006. Animal models and Lane, S.D., Tcheremissine, O.V., Lieving, L.M., Nouvion, S.,
brain circuits in drug addiction. Mol. Interv. 6, 339–344. Cherek, D.R., 2005. Acute effects of alprazolam on risky
Kelley, A.E., Berridge, K.C., 2002. The neuroscience of natural decision making in humans. Psychopharmacology (Berl.) 181,
rewards: relevance to addictive drugs. J. Neurosci. 22, 364–373.
3306–3311. Langleben, D.D., Loughead, J.W., Ruparel, K., Hakun, J.G.,
Kelly, T.H., Robbins, G., Martin, C.A., Fillmore, M.T., Lane, S.D., Busch-Winokur, S., Holloway, M.B., Strasser, A.A., Cappella, J.N.,
Harrington, N.G., Rush, C.R., 2006. Individual differences in Lerman, C., 2009. Reduced prefrontal and temporal
drug abuse vulnerability: D-amphetamine and processing and recall of high “sensation value” ads
sensation-seeking status. Psychopharmacology (Berl.) 189, Neuroimage 46, 219–225.
17–25. Lasseter, H.C., Ramirez, D.R., Xie, X., Fuchs, R.A., 2009.
Kennerley, S.W., Wallis, J.D., 2009. Reward-dependent modulation Involvement of the lateral orbitofrontal cortex in drug
of working memory in lateral prefrontal cortex. J. Neurosci. 29, context-induced reinstatement of cocaine-seeking behavior in
3259–3270. rats. Eur. J. Neurosci. 30, 1370–1381.
Kerns, J.G., Cohen, J.D., MacDonald III, A.W., Cho, R.Y., Stenger, V.A., Le, A.D., Funk, D., Harding, S., Juzytsch, W., Li, Z., Fletcher, P.J.,
Carter, C.S., 2004. Anterior cingulate conflict monitoring and 2008. Intra-median raphe nucleus (MRN) infusions of
adjustments in control. Science 303, 1023–1026. muscimol, a GABA-A receptor agonist, reinstate alcohol
Kerr, A., Zelazo, P.D., 2004. Development of “hot” executive seeking in rats: role of impulsivity and reward
function: the children's gambling task. Brain Cogn. 55, 148–157. Psychopharmacology (Berl.) 195, 605–615.
Killcross, S., Coutureau, E., 2003. Coordination of actions and Lebron, K., Milad, M.R., Quirk, G.J., 2004. Delayed recall of fear
habits in the medial prefrontal cortex of rats. Cereb. Cortex 13, extinction in rats with lesions of ventral medial prefrontal
400–408. cortex. Learn. Mem. 11, 544–548.
Kirby, K.N., Marakovic, N.N., 1996. Delay-discounting probabilistic Levesque, J., Joanette, Y., Mensour, B., Beaudoin, G., Leroux, J.M.,
rewards: rates decrease as amounts increase. Psychon. Bull. Bourgouin, P., Beauregard, M., 2004. Neural basis of
Rev. 3, 100–104. emotional self-regulation in childhood. Neuroscience 129,
Kita, H., Kitai, S.T., 1990. Amygdaloid projections to the frontal 361–369.
cortex and the striatum in the rat. J. Comp. Neurol. 298, 40–49. Lewis, M.D., Stieben, J., 2004. Emotion regulation in the brain:
Knoch, D., Gianotti, L.R., Pascual-Leone, A., Treyer, V., Regard, M., conceptual issues and directions for developmental research.
Hohmann, M., Brugger, P., 2006. Disruption of right prefrontal Child Dev. 75, 371–376.
cortex by low-frequency repetitive transcranial magnetic Li, C.S., Huang, C., Constable, R.T., Sinha, R., 2006. Gender
stimulation induces risk-taking behavior. J. Neurosci. 26, differences in the neural correlates of response inhibition
6469–6472. during a stop signal task. Neuroimage 32, 1918–1929.
Koski, L., Paus, T., 2000. Functional connectivity of the anterior Liao, P.C., Uher, R., Lawrence, N., Treasure, J., Schmidt, U.,
cingulate cortex within the human frontal lobe: a Campbell, I.C., Collier, D.A., Tchanturia, K., 2009. An
brain-mapping meta-analysis. Exp. Brain Res. 133, 55–65. examination of decision making in bulimia nervosa. J. Clin.
Koskinen, T., Sirvio, J., 2001. Studies on the involvement of the Exp. Neuropsychol. 31, 455–461.
dopaminergic system in the 5-HT2 agonist (DOI)-induced Lidov, H.G., Molliver, M.E., 1982. Immunohistochemical study of
premature responding in a five-choice serial reaction time the development of serotonergic neurons in the rat CNS. Brain
task. Brain Res. Bull. 54, 65–75. Res. Bull. 9, 559–604.
Koskinen, T., Ruotsalainen, S., Puumala, T., Lappalainen, R., Lin, Y., Ter Horst, G.J., Wichmann, R., Bakker, P., Liu, A., Li, X.,
Koivisto, E., Mannisto, P.T., Sirvio, J., 2000. Activation of 5-HT2A Westenbroek, C., 2009. Sex differences in the effects of
receptors impairs response control of rats in a five-choice acute and chronic stress and recovery after long-term stress
serial reaction time task. Neuropharmacology 39, 471–481. on stress-related brain regions of rats. Cereb. Cortex 19,
Koskinen, T., Haapalinna, A., Sirvio, J., 2003. 1978–1989.
Alpha-adrenoceptor-mediated modulation of 5-HT2 receptor Lishman, W.A., 1998. Cerebral beriberi (Wernicke's encephalopathy).
agonist induced impulsive responding in a 5-choice serial J. Psychosom. Res. 44, 631–632.
reaction time task. Pharmacol. Toxicol. 92, 214–225. Liu, Y.P., Wilkinson, L.S., Robbins, T.W., 2004. Effects of acute and
Kosten, T.A., Ball, S.A., Rounsaville, B.J., 1994. A sibling study of chronic buspirone on impulsive choice and efflux of 5-HT and
sensation seeking and opiate addiction. J. Nerv. Ment. Dis. 182, dopamine in hippocampus, nucleus accumbens and prefrontal
284–289. cortex. Psychopharmacology (Berl.) 173, 175–185.
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 145

Liu, X., Powell, D.K., Wang, H., Gold, B.T., Corbly, C.R., Joseph, J.E., Meunier, M., Bachevalier, J., Mishkin, M., 1997. Effects of orbital
2007. Functional dissociation in frontal and striatal areas for frontal and anterior cingulate lesions on object and
processing of positive and negative reward information. spatial memory in rhesus monkeys. Neuropsychologia 35,
J. Neurosci. 27, 4587–4597. 999–1015.
Luders, E., Narr, K.L., Thompson, P.M., Rex, D.E., Jancke, L., Miller, E.K., Cohen, J.D., 2001. An integrative theory of prefrontal
Steinmetz, H., Toga, A.W., 2004. Gender differences in cortical cortex function. Annu. Rev. Neurosci. 24, 167–202.
complexity. Nat. Neurosci. 7, 799–800. Milstein, J.A., Lehmann, O., Theobald, D.E., Dalley, J.W., Robbins, T.W.,
Lyons, D.M., Afarian, H., Schatzberg, A.F., Sawyer-Glover, A., 2007. Selective depletion of cortical noradrenaline by
Moseley, M.E., 2002. Experience-dependent asymmetric anti-dopamine beta-hydroxylase-saporin impairs attentional
variation in primate prefrontal morphology. Behav. Brain Res. function and enhances the effects of guanfacine in the rat.
136, 51–59. Psychopharmacology (Berl.) 190, 51–63.
Mai, J.K., Assheuer, J., Paxinos, G., 1997. Atlas of the Human Brain. Milstein, J.A., Dalley, J.W., Robbins, T.W., 2010.
Academic Press, San Diego. Methylphenidate-induced impulsivity: pharmacological
Mamounas, L.A., Mullen, C.A., O'Hearn, E., Molliver, M.E., 1991. antagonism by beta-adrenoreceptor blockade.
Dual serotoninergic projections to forebrain in the rat: J. Psychopharmacol. 24, 309–321.
morphologically distinct 5-HT axon terminals exhibit Mirjana, C., Baviera, M., Invernizzi, R.W., Balducci, C., 2004. The
differential vulnerability to neurotoxic amphetamine serotonin 5-HT2A receptors antagonist M100907 prevents
derivatives. J. Comp. Neurol. 314, 558–586. impairment in attentional performance by NMDA receptor
Mandyam, C.D., Wee, S., Eisch, A.J., Richardson, H.N., Koob, G.F., blockade in the rat prefrontal cortex
2007. Methamphetamine self-administration and voluntary Neuropsychopharmacology 29, 1637–1647.
exercise have opposing effects on medial prefrontal cortex Monterosso, J.R., Aron, A.R., Cordova, X., Xu, J., London, E.D., 2005.
gliogenesis. J. Neurosci. 27, 11442–11450. Deficits in response inhibition associated with chronic
Manes, F., Sahakian, B., Clark, L., Rogers, R., Antoun, N., Aitken, M., methamphetamine abuse. Drug Alcohol Depend. 79, 273–277.
Robbins, T., 2002. Decision-making processes following Morgan, M.A., LeDoux, J.E., 1995. Differential contribution of dorsal
damage to the prefrontal cortex. Brain 125, 624–639. and ventral medial prefrontal cortex to the acquisition and
Maren, S., Quirk, G.J., 2004. Neuronal signalling of fear memory. extinction of conditioned fear in rats. Behav. Neurosci. 109,
Nat. Rev. Neurosci. 5, 844–852. 681–688.
Margeta-Mitrovic, M., Mitrovic, I., Riley, R.C., Jan, L.Y., Basbaum, A.I., Morgan, M.A., Romanski, L.M., LeDoux, J.E., 1993. Extinction of
1999. Immunohistochemical localization of GABA(B) receptors emotional learning: contribution of medial prefrontal cortex.
in the rat central nervous system. J. Comp. Neurol. 405, 299–321. Neurosci. Lett. 163, 109–113.
Markham, J.A., Morris, J.R., Juraska, J.M., 2007. Neuron number Muir, J.L., Everitt, B.J., Robbins, T.W., 1996. The cerebral cortex of
decreases in the rat ventral, but not dorsal, medial prefrontal the rat and visual attentional function: dissociable effects of
cortex between adolescence and adulthood. Neuroscience 144, mediofrontal, cingulate, anterior dorsolateral, and parietal
961–968. cortex lesions on a five-choice serial reaction time task. Cereb.
Martin, S.B., Covell, D.J., Joseph, J.E., Chebrolu, H., Smith, C.D., Cortex 6, 470–481.
Kelly, T.H., Jiang, Y., Gold, B.T., 2007. Human experience Muraven, M., Tice, D.M., Baumeister, R.F., 1998. Self-control as
seeking correlates with hippocampus volume: convergent limited resource: regulatory depletion patterns. J. Pers. Soc.
evidence from manual tracing and voxel-based morphometry. Psychol. 74, 774–789.
Neuropsychologia 45, 2874–2881. Murphy, B.L., Arnsten, A.F., Goldman-Rakic, P.S., Roth, R.H., 1996.
Masaki, D., Yokoyama, C., Kinoshita, S., Tsuchida, H., Nakatomi, Increased dopamine turnover in the prefrontal cortex impairs
Y., Yoshimoto, K., Fukui, K., 2006. Relationship between limbic spatial working memory performance in rats and monkeys.
and cortical 5-HT neurotransmission and acquisition and Proc. Natl. Acad. Sci. U. S. A. 93, 1325–1329.
reversal learning in a go/no-go task in rats Murphy, B.L., Roth, R.H., Arnsten, A.F., 1997. Clozapine reverses
Psychopharmacology (Berl.) 189, 249–258. the spatial working memory deficits induced by FG7142 in
Matochik, J.A., London, E.D., Eldreth, D.A., Cadet, J.L., Bolla, K.I., monkeys. Neuropsychopharmacology 16, 433–437.
2003. Frontal cortical tissue composition in abstinent cocaine Murphy, E.R., Dalley, J.W., Robbins, T.W., 2005. Local glutamate
abusers: a magnetic resonance imaging study. Neuroimage 19, receptor antagonism in the rat prefrontal cortex disrupts
1095–1102. response inhibition in a visuospatial attentional task
Matsumura, M., Sawaguchi, T., Kubota, K., 1992. GABAergic Psychopharmacology (Berl.) 179, 99–107.
inhibition of neuronal activity in the primate motor and Murray, E.A., O'Doherty, J.P., Schoenbaum, G., 2007. What we know
premotor cortex during voluntary movement. J. Neurophysiol. and do not know about the functions of the orbitofrontal cortex
68, 692–702. after 20 years of cross-species studies. J. Neurosci. 27,
McFarland, K., Kalivas, P.W., 2001. The circuitry mediating 8166–8169.
cocaine-induced reinstatement of drug-seeking behavior. J. Naqvi, N.H., Bechara, A., 2009. The hidden island of addiction: the
Neurosci. 21, 8655–8663. insula. Trends Neurosci. 32, 56–67.
McFarland, K., Davidge, S.B., Lapish, C.C., Kalivas, P.W., 2004. Nederkoorn, C., Braet, C., Van Eijs, Y., Tanghe, A., Jansen, A., 2006.
Limbic and motor circuitry underlying footshock-induced Why obese children cannot resist food: the role of impulsivity.
reinstatement of cocaine-seeking behavior. J. Neurosci. 24, Eat. Behav. 7, 315–322.
1551–1560. Ofen, N., Kao, Y.C., Sokol-Hessner, P., Kim, H., Whitfield-Gabrieli,
McLaughlin, J., See, R.E., 2003. Selective inactivation of the S., Gabrieli, J.D., 2007. Development of the declarative
dorsomedial prefrontal cortex and the basolateral amygdala memory system in the human brain. Nat. Neurosci. 10,
attenuates conditioned-cued reinstatement of extinguished 1198–1205.
cocaine-seeking behavior in rats. Psychopharmacology (Berl.) Olausson, P., Jentsch, J.D., Krueger, D.D., Tronson, N.C., Nairn, A.C.,
168, 57–65. Taylor, J.R., 2007. Orbitofrontal cortex and
Meaney, M.J., Diorio, J., Francis, D., Widdowson, J., LaPlante, P., cognitive-motivational impairments in psychostimulant
Caldji, C., Sharma, S., Seckl, J.R., Plotsky, P.M., 1996. Early addiction: evidence from experiments in the non-human
environmental regulation of forebrain glucocorticoid receptor primate. Ann. N. Y. Acad. Sci. 1121, 610–638.
gene expression: implications for adrenocortical responses to Olson, E.A., Collins, P.F., Hooper, C.J., Muetzel, R., Lim, K.O.,
stress. Dev. Neurosci. 18, 49–72. Luciana, M., 2009. White matter integrity predicts delay
146 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

discounting behavior in 9- to 23-year-olds: a diffusion tensor Posner, M.I., Rothbart, M.K., Sheese, B.E., Tang, Y., 2007. The
imaging study. J. Cogn. Neurosci. 21, 1406–1421. anterior cingulate gyrus and the mechanism of self-regulation.
Ongur, D., Price, J.L., 2000. The organization of networks within the Cogn. Affect. Behav. Neurosci. 7, 391–395.
orbital and medial prefrontal cortex of rats, monkeys and Posse, S., Fitzgerald, D., Gao, K., Habel, U., Rosenberg, D., Moore, G.J.,
humans. Cereb. Cortex 10, 206–219. Schneider, F., 2003. Real-time fMRI of temporolimbic regions
Overman, W.H., 2004. Sex differences in early childhood, detects amygdala activation during single-trial self-induced
adolescence, and adulthood on cognitive tasks that rely on sadness. Neuroimage 18, 760–768.
orbital prefrontal cortex. Brain Cogn. 55, 134–147. Preuss, T.M., 1995. Do rats have prefrontal cortex? The
Paine, T.A., Tomasiewicz, H.C., Zhang, K., Carlezon Jr., W.A., 2007. Rose-Woolsey-Akert program reconsidered. J. Cogn. Neurosci.
Sensitivity of the five-choice serial reaction time task to the 7, 1–24.
effects of various psychotropic drugs in Sprague–Dawley rats. Price, J.L., 1985. Beyond the primary olfactory cortex:
Biol. Psychiatry 62, 687–693. olfactory-related areas in the neocortex, thalamus, and
Palmgreen, P., Donohew, L., 2003. Effective mass media strategies hypothalamus. Chem. Senses 10, 235–258.
for drug abuse prevention campaigns. In: Bukoski, W.J., Price, J.L., 2007. Definition of the orbital cortex in relation to
Sloboda, Z. (Eds.), Handbook of drug abuse theory, science and specific connections with limbic and visceral structures and
practice. Plenum, New York. other cortical regions. Ann. N. Y. Acad. Sci. 1121, 54–71.
Palmgreen, P., Donohew, L., Lorch, E.P., Hoyle, R.H., Stephenson, Puumala, T., Sirvio, J., 1998. Changes in activities of dopamine and
M.T., 2001. Television campaigns and adolescent marijuana serotonin systems in the frontal cortex underlie poor choice
use: tests of sensation seeking targeting. Am. J. Public Health accuracy and impulsivity of rats in an attention task
91, 292–296. Neuroscience 83, 489–499.
Palmgreen, P., Lorch, E.P., Stephenson, M.T., Hoyle, R.H., Donohew, Quirk, G.J., Russo, G.K., Barron, J.L., Lebron, K., 2000. The role of
L., 2007. Effects of the Office of National Drug Control Policy's ventromedial prefrontal cortex in the recovery of extinguished
Marijuana Initiative Campaign on high-sensation-seeking fear. J. Neurosci. 20, 6225–6231.
adolescents. Am. J. Public Health 97, 1644–1649. Ragozzino, M.E., Detrick, S., Kesner, R.P., 1999. Involvement of the
Papez, J.W., 1958. Visceral brain, its component parts and their prelimbic-infralimbic areas of the rodent prefrontal cortex in
connections. J. Nerv. Ment. Dis. 126, 40–56. behavioral flexibility for place and response learning.
Passetti, F., Chudasama, Y., Robbins, T.W., 2002. The frontal cortex J. Neurosci. 19, 4585–4594.
of the rat and visual attentional performance: dissociable Rama, P., Linnankoski, I., Tanila, H., Pertovaara, A., Carlson, S.,
functions of distinct medial prefrontal subregions. Cereb. 1996. Medetomidine, atipamezole, and guanfacine in delayed
Cortex 12, 1254–1268. response performance of aged monkeys. Pharmacol. Biochem.
Passetti, F., Dalley, J.W., Robbins, T.W., 2003. Double dissociation of Behav. 55, 415–422.
serotonergic and dopaminergic mechanisms on attentional Ray, J.P., Price, J.L., 1992. The organization of the thalamocortical
performance using a rodent five-choice reaction time task. connections of the mediodorsal thalamic nucleus in the rat,
Psychopharmacology (Berl.) 165, 136–145. related to the ventral forebrain-prefrontal cortex topography.
Pattij, T., Vanderschuren, L.J., 2008. The neuropharmacology of J. Comp. Neurol. 323, 167–197.
impulsive behaviour. Trends Pharmacol. Sci. 29, 192–199. Ray, R., Loughead, J., Wang, Z., Detre, J., Yang, E., Gur, R., Lerman,
Paulus, M.P., Hozack, N., Frank, L., Brown, G.G., 2002. Error rate and C., 2008. Neuroimaging, genetics and the treatment of nicotine
outcome predictability affect neural activation in prefrontal addiction. Behav. Brain Res. 193, 159–169.
cortex and anterior cingulate during decision-making Reavis, R., Overman, W.H., 2001. Adult sex differences on a
Neuroimage 15, 836–846. decision-making task previously shown to depend on the
Paulus, M.P., Hozack, N., Frank, L., Brown, G.G., Schuckit, M.A., orbital prefrontal cortex. Behav. Neurosci. 115, 196–206.
2003. Decision making by methamphetamine-dependent Renner, M.J., Rosenzweig, M.R., 1987. The golden-mantled ground
subjects is associated with error-rate-independent decrease squirrel (Spermophilus lateralis) as a model for the effects of
in prefrontal and parietal activation. Biol. Psychiatry 53, environmental enrichment in solitary animals
65–74. Dev. Psychobiol. 20, 19–24.
Paus, T., Zijdenbos, A., Worsley, K., Collins, D.L., Blumenthal, J., Reynolds, B., Richards, J.B., Dassinger, M., de Wit, H., 2004.
Giedd, J.N., Rapoport, J.L., Evans, A.C., 1999. Structural Therapeutic doses of diazepam do not alter impulsive behavior
maturation of neural pathways in children and adolescents: in humans. Pharmacol. Biochem. Behav. 79, 17–24.
in vivo study. Science 283, 1908–1911. Reynolds, B., Richards, J.B., de Wit, H., 2006. Acute-alcohol effects
Paxinos, G., Watson, C., 2005. The Rat Brain In Stereotaxic on the Experiential Discounting Task (EDT) and a
Coordinates. Academic Press, Amsterdam. question-based measure of delay discounting. Pharmacol.
Perry, J.L., Carroll, M.E., 2008. The role of impulsive behavior in Biochem. Behav. 83, 194–202.
drug abuse. Psychopharmacology (Berl.) 200, 1–26. Richards, J.B., Sabol, K.E., de Wit, H., 1999. Effects of
Perry, J.L., Larson, E.B., German, J.P., Madden, G.J., Carroll, M.E., methamphetamine on the adjusting amount procedure, a
2005. Impulsivity (delay discounting) as a predictor of model of impulsive behavior in rats. Psychopharmacology
acquisition of IV cocaine self-administration in female rats. (Berl.) 146, 432–439.
Psychopharmacology (Berl.) 178, 193–201. Ridderinkhof, K.R., Ullsperger, M., Crone, E.A., Nieuwenhuis, S.,
Perry, J.L., Nelson, S.E., Carroll, M.E., 2008. Impulsive choice as a 2004a. The role of the medial frontal cortex in cognitive control.
predictor of acquisition of IV cocaine self- administration and Science 306, 443–447.
reinstatement of cocaine-seeking behavior in male and female Ridderinkhof, K.R., van den Wildenberg, W.P., Segalowitz, S.J.,
rats. Exp. Clin. Psychopharmacol. 16, 165–177. Carter, C.S., 2004b. Neurocognitive mechanisms of cognitive
Peters, J., Vallone, J., Laurendi, K., Kalivas, P.W., 2008. Opposing control: the role of prefrontal cortex in action selection,
roles for the ventral prefrontal cortex and the basolateral response inhibition, performance monitoring, and
amygdala on the spontaneous recovery of cocaine-seeking in reward-based learning. Brain Cogn. 56, 129–140.
rats. Psychopharmacology (Berl.) 197, 319–326. Robinson, D.S., Gilmor, M.L., Yang, Y., Moonsammy, G., Azzaro, A.J.,
Petrides, M., Pandya, D.N., 1999. Dorsolateral prefrontal cortex: Oren, D.A., Campbell, B.J., 2007. Treatment effects of selegiline
comparative cytoarchitectonic analysis in the human and the transdermal system on symptoms of major depressive disorder:
macaque brain and corticocortical connection patterns. Eur. J. a meta-analysis of short-term, placebo-controlled, efficacy trials.
Neurosci. 11, 1011–1036. Psychopharmacol. Bull. 40, 15–28.
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 147

Robinson, E.S., Dalley, J.W., Theobald, D.E., Glennon, J.C., Pezze, M.A., and adolescents with attention-deficit/hyperactivity disorder.
Murphy, E.R., Robbins, T.W., 2008a. Opposing roles for Arch. Gen. Psychiatry 63, 540–549.
5-HT2A and 5-HT2C receptors in the nucleus accumbens on Simmons, J.M., Richmond, B.J., 2008. Dynamic changes in
inhibitory response control in the 5-choice serial reaction time representations of preceding and upcoming reward in monkey
task. Neuropsychopharmacology 33, 2398–2406. orbitofrontal cortex. Cereb. Cortex 18, 93–103.
Robinson, E.S., Eagle, D.M., Mar, A.C., Bari, A., Banerjee, G., Jiang, X., Skinner, M.D., Aubin, H.J., Berlin, I., 2004. Impulsivity in smoking,
Dalley, J.W., Robbins, T.W., 2008b. Similar effects of the nonsmoking, and ex-smoking alcoholics. Addict. Behav. 29,
selective noradrenaline reuptake inhibitor atomoxetine on 973–978.
three distinct forms of impulsivity in the rat Smith, M.A., Schmidt, K.T., Iordanou, J.C., Mustroph, M.L., 2008.
Neuropsychopharmacology 33, 1028–1037. Aerobic exercise decreases the positive-reinforcing effects of
Roesch, M.R., Olson, C.R., 2004. Neuronal activity related to reward cocaine. Drug Alcohol Depend. 98, 129–135.
value and motivation in primate frontal cortex. Science 304, Sofuoglu, M., Sewell, R.A., 2009. Norepinephrine and stimulant
307–310. addiction. Addict. Biol. 14, 119–129.
Rose, J.E., Woolsey, C.N., 1948. The orbitofrontal cortex and its Solanto, M.V., 2002. Dopamine dysfunction in AD/HD: integrating
connections with the mediodorsal nucleus in rabbit, sheep and clinical and basic neuroscience research. Behav. Brain Res. 130,
cat. Res. Publ. Assoc. Res. Nerv. Ment. Dis. 27 (1 vol.), 210–232. 65–71.
Rosenblitt, J.C., Soler, H., Johnson, S.E., Quadagno, D.M., 2001. Sowell, E.R., Peterson, B.S., Thompson, P.M., Welcome, S.E.,
Sensation seeking and hormones in men and women: Henkenius, A.L., Toga, A.W., 2003. Mapping cortical change
exploring the link. Horm. Behav. 40, 396–402. across the human life span. Nat. Neurosci. 6, 309–315.
Runyan, J.D., Dash, P.K., 2004. Intra-medial prefrontal Spear, L.P., 2000. The adolescent brain and age-related behavioral
administration of SCH-23390 attenuates ERK phosphorylation manifestations. Neurosci. Biobehav. Rev. 24, 417–463.
and long-term memory for trace fear conditioning in rats. Steinbusch, H.W., 1981. Distribution of
Neurobiol. Learn. Mem. 82, 65–70. serotonin-immunoreactivity in the central nervous system of
Ruotsalainen, S., Sirvio, J., Jakala, P., Puumala, T., MacDonald, E., the rat-cell bodies and terminals. Neuroscience 6, 557–618.
Riekkinen Sr., P., 1997. Differential effects of three 5-HT Stoops, W.W., Lile, J.A., Robbins, C.G., Martin, C.A., Rush, C.R.,
receptor antagonists on the performance of rats in attentional Kelly, T.H., 2007. The reinforcing, subject-rated, performance,
and working memory tasks. Eur. Neuropsychopharmacol. 7, and cardiovascular effects of d-amphetamine: influence of
99–108. sensation-seeking status. Addict. Behav. 32, 1177–1188.
Sawaguchi, T., Matsumura, M., Kubota, K., 1988. Delayed response Stoops, W.W., Blackburn, J.W., Hudson, D.A., Hays, L.R., Rush, C.R.,
deficit in monkeys by locally disturbed prefrontal neuronal 2008. Safety, tolerability and subject-rated effects of acute
activity by bicuculline. Behav. Brain Res. 31, 193–198. intranasal cocaine administration during atomoxetine
Schilman, E.A., Uylings, H.B., Galis-de Graaf, Y., Joel, D., maintenance. Drug Alcohol Depend. 92, 282–285.
Groenewegen, H.J., 2008. The orbital cortex in rats Sukhotina, I.A., Dravolina, O.A., Novitskaya, Y., Zvartau, E.E.,
topographically projects to central parts of the Danysz, W., Bespalov, A.Y., 2008. Effects of mGlu1 receptor
caudate–putamen complex. Neurosci. Lett. 432, 40–45. blockade on working memory, time estimation, and
Schoenbaum, G., Roesch, M., 2005. Orbitofrontal cortex, impulsivity in rats. Psychopharmacology (Berl.) 196, 211–220.
associative learning, and expectancies. Neuron 47, 633–636. Sun, H., Green, T.A., Theobald, D.E., Birnbaum, S.G., Graham, D.L.,
Schoenbaum, G., Shaham, Y., 2008. The role of orbitofrontal cortex Zeeb, F.D., Nestler, E.J., Winstanley, C.A., 2010. Yohimbine
in drug addiction: a review of preclinical studies. Biol. increases impulsivity through activation of cAMP response
Psychiatry 63, 256–262. element binding in the orbitofrontal cortex. Biol. Psychiatry 67,
Schoenbaum, G., Chiba, A.A., Gallagher, M., 1999. Neural encoding 649–656.
in orbitofrontal cortex and basolateral amygdala during Sussman, S., Earleywine, M., Wills, T., Cody, C., Biglan, T., Dent, C.W.,
olfactory discrimination learning. J. Neurosci. 19, 1876–1884. Newcomb, M.D., 2004. The motivation, skills, and
Schoenbaum, G., Setlow, B., Nugent, S.L., Saddoris, M.P., Gallagher, decision-making model of “drug abuse” prevention. Subst.
M., 2003. Lesions of orbitofrontal cortex and basolateral Use Misuse 39, 1971–2016.
amygdala complex disrupt acquisition of odor-guided Swanson, L.W., 1981. Tracing central pathways with the
discriminations and reversals. Learn. Mem. 10, 129–140. autoradiographic method. J. Histochem. Cytochem. 29,
Schoenbaum, G., Roesch, M.R., Stalnaker, T.A., 2006. Orbitofrontal 117–124.
cortex, decision-making and drug addiction. Trends Neurosci. Tanila, H., Rama, P., Carlson, S., 1996. The effects of prefrontal
29, 116–124. intracortical microinjections of an alpha-2 agonist, alpha-2
Schoepp, D.D., 2001. Unveiling the functions of presynaptic antagonist and lidocaine on the delayed alternation
metabotropic glutamate receptors in the central nervous performance of aged rats. Brain Res. Bull. 40, 117–119.
system. J. Pharmacol. Exp. Ther. 299, 12–20. Thomas, K.L., Everitt, B.J., 2001. Limbic-cortical-ventral striatal
Schweimer, J., Hauber, W., 2006. Dopamine D1 receptors in the activation during retrieval of a discrete cocaine-associated
anterior cingulate cortex regulate effort-based decision stimulus: a cellular imaging study with gamma protein kinase
making. Learn. Mem. 13, 777–782. C expression. J. Neurosci. 21, 2526–2535.
Semenova, S., Markou, A., 2007. The effects of the mGluR5 Thomas, K.L., Arroyo, M., Everitt, B.J., 2003. Induction of the
antagonist MPEP and the mGluR2/3 antagonist LY341495 on learning and plasticity-associated gene Zif268 following
rats' performance in the 5-choice serial reaction time task. exposure to a discrete cocaine-associated stimulus. Eur. J.
Neuropharmacology 52, 863–872. Neurosci. 17, 1964–1972.
Shackman, A.J., McMenamin, B.W., Maxwell, J.S., Greischar, L.L., Thompson, S.M., Gahwiler, B.H., 1992. Effects of the GABA uptake
Davidson, R.J., 2009. Right dorsolateral prefrontal cortical inhibitor tiagabine on inhibitory synaptic potentials in rat
activity and behavioral inhibition. Psychol. Sci. 20, 1500–1506. hippocampal slice cultures. J. Neurophysiol. 67, 1698–1701.
Shaham, Y., Shalev, U., Lu, L., De Wit, H., Stewart, J., 2003. The Tierney, P.L., Degenetais, E., Thierry, A.M., Glowinski, J., Gioanni,
reinstatement model of drug relapse: history, methodology Y., 2004. Influence of the hippocampus on interneurons of the
and major findings. Psychopharmacology (Berl.) 168, 3–20. rat prefrontal cortex. Eur. J. Neurosci. 20, 514–524.
Shaw, P., Lerch, J., Greenstein, D., Sharp, W., Clasen, L., Evans, A., Tikhonov, D.B., Magazanik, L.G., 2009. Origin and molecular
Giedd, J., Castellanos, F.X., Rapoport, J., 2006. Longitudinal evolution of ionotropic glutamate receptors
mapping of cortical thickness and clinical outcome in children Neurosci. Behav. Physiol. 39, 763–773.
148 B RA I N R E SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9

Torregrossa, M.M., Quinn, J.J., Taylor, J.R., 2008. Impulsivity, reinforcement in rats. Psychopharmacology (Berl.) 134,
compulsivity, and habit: the role of orbitofrontal cortex 242–257.
revisited. Biol. Psychiatry 63, 253–255. Whiteside, S.P., Lynam, D.R., 2003. Understanding the role of
Tranel, D., Bechara, A., Denburg, N.L., 2002. Asymmetric functional impulsivity and externalizing psychopathology in alcohol
roles of right and left ventromedial prefrontal cortices in social abuse: application of the UPPS impulsive behavior scale
conduct, decision-making, and emotional processing. Cortex Exp. Clin. Psychopharmacol. 11, 210–217.
38, 589–612. Wills, T.A., Vaccaro, D., McNamara, G., 1994. Novelty seeking, risk
Tremblay, L., Schultz, W., 2000. Modifications of reward taking, and related constructs as predictors of adolescent
expectation-related neuronal activity during learning in substance use: an application of Cloninger's theory. J. Subst.
primate orbitofrontal cortex. J. Neurophysiol. 83, 1877–1885. Abuse 6, 1–20.
Van De Werd, H.J., Rajkowska, G., Evers, P., Uylings, H.B., 2010. Wills, T.A., Windle, M., Cleary, S.D., 1998. Temperament and
Cytoarchitectonic and chemoarchitectonic characterization of novelty seeking in adolescent substance use: convergence of
the prefrontal cortical areas in the mouse. Brain Struct. Funct. dimensions of temperament with constructs from Cloninger's
214, 339–353. theory. J. Pers. Soc. Psychol. 74, 387–406.
van den Bergh, F.S., Bloemarts, E., Groenink, L., Olivier, B., Oosting, Wills, T.A., Isasi, C.R., Mendoza, D., Ainette, M.G., 2007. Self-control
R.S., 2006. Delay aversion: effects of 7-OH-DPAT, constructs related to measures of dietary intake and physical
5-HT1A/1B-receptor stimulation and D-cycloserine activity in adolescents. J. Adolesc. Health 41, 551–558.
Pharmacol. Biochem. Behav. 85, 736–743. Wilson, M.A., Molliver, M.E., 1991a. The organization of serotonergic
van Gaalen, M.M., van Koten, R., Schoffelmeer, A.N., projections to cerebral cortex in primates: regional distribution
Vanderschuren, L.J., 2006. Critical involvement of of axon terminals. Neuroscience 44, 537–553.
dopaminergic neurotransmission in impulsive decision Wilson, M.A., Molliver, M.E., 1991b. The organization of
making. Biol. Psychiatry 60, 66–73. serotonergic projections to cerebral cortex in primates:
Van Leijenhorst, L., Westenberg, P.M., Crone, E.A., 2008. A retrograde transport studies. Neuroscience 44, 555–570.
developmental study of risky decisions on the cake gambling Winstanley, C.A., 2007. The orbitofrontal cortex, impulsivity, and
task: age and gender analyses of probability estimation and addiction: probing orbitofrontal dysfunction at the neural,
reward evaluation. Dev. Neuropsychol. 33, 179–196. neurochemical, and molecular level. Ann. N. Y. Acad. Sci. 1121,
Velleman, R.D., Templeton, L.J., Copello, A.G., 2005. The role of the 639–655.
family in preventing and intervening with substance use and Winstanley, C.A., Chudasama, Y., Dalley, J.W., Theobald, D.E.,
misuse: a comprehensive review of family interventions, with Glennon, J.C., Robbins, T.W., 2003a. Intra-prefrontal
a focus on young people. Drug Alcohol Rev. 24, 93–109. 8-OH-DPAT and M100907 improve visuospatial attention and
Vertes, R.P., 2004. Differential projections of the infralimbic and decrease impulsivity on the five-choice serial reaction time
prelimbic cortex in the rat. Synapse 51, 32–58. task in rats. Psychopharmacology (Berl.) 167, 304–314.
Vertes, R.P., 2006. Interactions among the medial prefrontal Winstanley, C.A., Dalley, J.W., Theobald, D.E., Robbins, T.W.,
cortex, hippocampus and midline thalamus in emotional and 2003b. Global 5-HT depletion attenuates the ability of
cognitive processing in the rat. Neuroscience 142, 1–20. amphetamine to decrease impulsive choice on a
Vocci, F.J., 2008. Cognitive remediation in the treatment of delay-discounting task in rats. Psychopharmacology (Berl.) 170,
stimulant abuse disorders: A research agenda. Exp. Clin. 320–331.
Psychopharmacol. 16, 484–497. Winstanley, C.A., Theobald, D.E., Cardinal, R.N., Robbins, T.W.,
Volkow, N.D., Fowler, J.S., Wang, G.J., 2004. The addicted human 2004. Contrasting roles of basolateral amygdala and
brain viewed in the light of imaging studies: brain circuits orbitofrontal cortex in impulsive choice. J. Neurosci. 24,
and treatment strategies. Neuropharmacology 47 (Suppl 1), 4718–4722.
3–13. Winstanley, C.A., Theobald, D.E., Dalley, J.W., Robbins, T.W., 2005.
Vollm, B.A., de Araujo, I.E., Cowen, P.J., Rolls, E.T., Kringelbach, M.L., Interactions between serotonin and dopamine in the control of
Smith, K.A., Jezzard, P., Heal, R.J., Matthews, P.M., 2004. impulsive choice in rats: therapeutic implications for impulse
Methamphetamine activates reward circuitry in drug naive control disorders. Neuropsychopharmacology 30, 669–682.
human subjects. Neuropsychopharmacology 29, 1715–1722. Winstanley, C.A., Eagle, D.M., Robbins, T.W., 2006a. Behavioral
Wager, T.D., Davidson, M.L., Hughes, B.L., Lindquist, M.A., models of impulsivity in relation to ADHD: translation between
Ochsner, K.N., 2008. Prefrontal–subcortical pathways clinical and preclinical studies. Clin. Psychol. Rev. 26, 379–395.
mediating successful emotion regulation. Neuron 59, Winstanley, C.A., Theobald, D.E., Dalley, J.W., Cardinal, R.N.,
1037–1050. Robbins, T.W., 2006b. Double dissociation between
Wallace, C.J., 1979. The effects of delayed rewards, social pressure, serotonergic and dopaminergic modulation of medial
and frustration on the responses of opiate addicts. NIDA Res. prefrontal and orbitofrontal cortex during a test of impulsive
Monogr. 6–25. choice. Cereb. Cortex 16, 106–114.
Wallis, J.D., 2007. Orbitofrontal cortex and its contribution to Winstanley, C.A., LaPlant, Q., Theobald, D.E., Green, T.A., Bachtell,
decision-making. Annu. Rev. Neurosci. 30, 31–56. R.K., Perrotti, L.I., DiLeone, R.J., Russo, S.J., Garth, W.J., Self, D.W.,
Walton, M.E., Bannerman, D.M., Rushworth, M.F., 2002. The role of Nestler, E.J., 2007. DeltaFosB induction in orbitofrontal cortex
rat medial frontal cortex in effort-based decision making. mediates tolerance to cocaine-induced cognitive
J. Neurosci. 22, 10996–11003. dysfunction. J. Neurosci. 27, 10497–10507.
Walton, M.E., Bannerman, D.M., Alterescu, K., Rushworth, M.F., Winstanley, C.A., Green, T.A., Theobald, D.E., Renthal, W., LaPlant,
2003. Functional specialization within medial frontal cortex of Q., DiLeone, R.J., Chakravarty, S., Nestler, E.J., 2009. DeltaFosB
the anterior cingulate for evaluating effort-related decisions. induction in orbitofrontal cortex potentiates locomotor
J. Neurosci. 23, 6475–6479. sensitization despite attenuating the cognitive dysfunction
Wang, G.J., Volkow, N.D., Fowler, J.S., Cervany, P., Hitzemann, R.J., caused by cocaine. Pharmacol. Biochem. Behav. 93, 278–284.
Pappas, N.R., Wong, C.T., Felder, C., 1999. Regional brain Winstanley, C.A., Olausson, P., Taylor, J.R., Jentsch, J.D., 2010.
metabolic activation during craving elicited by recall of Insight into the relationship between impulsivity and
previous drug experiences. Life Sci. 64, 775–784. substance abuse from studies using animal models. Alcohol.
Weissenborn, R., Robbins, T.W., Everitt, B.J., 1997. Effects of medial Clin. Exp. Res. 34, 1306–1318.
prefrontal or anterior cingulate cortex lesions on responding Wise, R.A., 1998. Drug-activation of brain reward pathways
for cocaine under fixed-ratio and second-order schedules of Drug Alcohol Depend. 51, 13–22.
B RA I N RE SE A R CH RE V I EW S 65 ( 20 1 1 ) 1 2 4–1 4 9 149

Wrase, J., Kahnt, T., Schlagenhauf, F., Beck, A., Cohen, M.X., Zeeb, F.D., Floresco, S.B., Winstanley, C.A., 2010. Contributions
Knutson, B., Heinz, A., 2007. Different neural systems adjust of the orbitofrontal cortex to impulsive choice: interactions
motor behavior in response to reward and punishment. with basal levels of impulsivity, dopamine signalling,
Neuroimage 36, 1253–1262. and reward-related cues. Psychopharmacology (Berl.) 211,
Yalachkov, Y., Kaiser, J., Naumer, M.J., 2009. Brain regions related 87–98.
to tool use and action knowledge reflect nicotine dependence. Zhu, J., Apparsundaram, S., Bardo, M.T., Dwoskin, L.P., 2005.
J. Neurosci. 29, 4922–4929. Environmental enrichment decreases cell surface expression
Zahrt, J., Taylor, J.R., Mathew, R.G., Arnsten, A.F., 1997. of the dopamine transporter in rat medial prefrontal cortex
Supranormal stimulation of D1 dopamine receptors in the J. Neurochem. 93, 1434–1443.
rodent prefrontal cortex impairs spatial working memory Zuckerman, M., 1979. Sensation seeking: beyond the optimal level
performance. J. Neurosci. 17, 8528–8535. of arousal. Lawrence Erlbaum Associates, Hillsdale.
Zecevic, N., Bourgeois, J.P., Rakic, P., 1989. Changes in synaptic Zuckerman, M., 1994. Behavioral expressions and biosocial
density in motor cortex of rhesus monkey during fetal and bases of sensation seeking. Cambridge University Press,
postnatal life. Brain Res. Dev. Brain Res. 50, 11–32. Cambridge.

You might also like