Common neural coding

across domains of decision

making identified through
meta-analysis

Manisha Chawla
Krishna Miyapuram
Cognitive Science & Computer
Science
Indian Institute of Technology
Gandhinagar
kprasad@iitgn.ac.in
Overwhelming number of studies!!

 Data Explosion
 One Participant data
 Voxel size: 3 × 3 × 5 mm
 # of slices: ~ 20
 Matrix size: 64 × 64 per slice (in-plane
resolution)
 Total # of voxels (raw data) Number
= 81920of fMRI Studies
30000
 One study 25000

~ 20 participants 20000

Multiple Studies
15000

10000

 Studies over the years !! 5000

0
1990
1991
1992
1993
1994
1995
1996
1997
1998
1999
2000
2001

2003
2004
2005
2006
2007
2008
2009
2010
2011

2013

2014
2002

2012
 Classical analysis
y = Xb +
e
Statistical
fMRI
time series
Analysis
General Linear Model
z Design matrix
roll
Parameter estimation
pitch
x
Within-subject registration Statistical Inference
slice-timing correction Linear Contrasts
Realignment Thresholding
y yaw
Coregistration
(structural to functional) Random Effects Analysis
AB Between-subject registration
(Group analysis only)

spatial normalization
Statistical
Spatial smoothing Parametric Map

Preprocessin
g
Reverse Inferencing in single studies

P(Activation|Cognitive
State)

P(Cognitive State|Activation)
What happens to Variability ??

Across Participants Across

Experiments

Analysis
Techniques
Different People Different Brains!!

Scanner Strength
 Meta Analysis
 Number of studies which look at a single psychological
phenomenon are pooled together
 analyzed for consistency and specificity of findings

Multi-level kernel Density

Analysis
Image based
Intra-subject
Inter-subject
modelling of each
analysis for
subject’s fMRI time
each study
series data

In
te
r-
st
Activation Likelihood u
Estimation d
y
Kernel Density Analysis m
et
a-
a
Co-ordinate based n
al
ys
is
Meta analysis of reward processing studies

ALE analysis

MKDA

Prefrontal Striatum
Cortex

Substantia
Nigra

Orbitofrontal cortex

Ventral Tegmental Area

Case Study of reward processing

NeuroSynth forward inferencing

NeuroSynth reverse inferencing

 0.00 0.20 0.40 0.60 0.80 1.00 0.00 0.20 0.40 0.60 0.80 1.00

Pallidum Pallidum
Caudate Caudate
Putamen Putamen
Amygdala Amygdala
Cingulum_Ant Cingulum_Ant
Olfactory Olfactory
Thalamus Thalamus
Frontal_Med_Orb Frontal_Med_Orb
Insula Insula
Cingulum_Mid Cingulum_Mid
Cingulum_Post Cingulum_Post
Hippocampus Hippocampus
Supp_Motor_Area Supp_Motor_Area
Rectus Rectus
Frontal_Inf_Oper Frontal_Inf_Oper
Frontal_Inf_Tri Frontal_Inf_Tri
Frontal_Sup_Medial Frontal_Sup_Medial
Parietal_Inf Parietal_Inf
Frontal_Inf_Orb Frontal_Inf_Orb
Frontal_Mid Frontal_Mid
Frontal_Mid_Orb Frontal_Mid_Orb
Parietal_Sup Parietal_Sup
Lingual Lingual
Angular Angular
Precentral Precentral
ParaHippocampal ParaHippocampal
Occipital_Sup Occipital_Sup
Occipital_Inf Occipital_Inf
Frontal_Sup_Orb Frontal_Sup_Orb
Fusiform Fusiform
Rolandic_Oper Rolandic_Oper
Precuneus
ALE_only Precuneus Forward_only
Vermis_4_5 both Vermis_4_5
both
Calcarine Calcarine
Occipital_Mid MKDA_only Occipital_Mid Reverse_only
Cerebelum_6 Cerebelum_6
Postcentral Postcentral
Decision Making in different domains

Perceptual Decision Making Value-based Decision Making

What do you prefer?

Social Decision Making

Utimatum Game
$10 Accept

$2

$0
Reject
Customised Meta Analysis pipeline
Keywords

 508 studies identified with the terms

 reward, decision, choice, value, social,
percept
 Filtering criteria:
 value: 84
 social: 61
 perceptual: 36
 Data Mining: Steps
1. Database (pubmed ids) extracted
from http://Neurosynth.org
(February 2014)
2. Title and abstract extracted from
pubmed database (8061 studies)
3. 2518 studies that contained at least
one of the keywords – decision,
value, social, percept, choice (and
corresponding word forms, chose,
choose)
 (2718 studies including the additional
keyword reward)
4. 639 studies had necessarily
contained the substring decision or
choice (chose, choose) – final subset
Perceptual Decision making

Value-based decision making

Social decision making

Analysis: Steps
 3 separate meta-analyses were carried out for value-
based, perceptual, and social decision making, using
GingerALE
 These were further entered into a pair-wise contrast
analyses
 Each meta- analysis contrasts included the conjunction of
activations and
 two directional contrasts for each pair
 Contrast maps were labeled with the help of WFU-
pickatlas an Automated Anatomic Labeling software
 We calculated the number of supra-threshold voxels and
the proportion of each brain region activated (Using
labeling procedure)
 Results Percept Value Social

 Common neural activation across all three

pairs
 primarily in basal ganglia (Caudate,Putamen,
Pallidum) and Insula, Left Inferior frontal area,
Supplementary Motor Area, Right Thalamus.

0% 1 0% 20% 3 0% 40% 50% 60% 7 0%

Caudate

Putamen

Pallidum

Insula 0% 10% 20% 30% 40% 50% 60% 70%

Caudate

Putamen

Pallidum Left
Insula
Right
Left
Right
 Conjunction Analysis

 Perceptual and social decision making was

found to activate Anterior Cingulate Cortex,
 Value and perceptual decision making activated
Left Inferior parietal area, and
 Social and value based decision making
activated left Angular gyrus, Left Caudate,
Anterior Cingulate Cortex, medial orbitofrontal
and superior medial frontal areas.
 Suggests common brain areas in pair-wise
combinations of domains of decision making.
All three domains Value and social decision making
0% 10% 20% 30% 40% 50% 60% 70% 0% 20% 40% 60% 80% 100%

Caudate Caudate

Putamen Putamen

Pallidum Pallidum

Insula Insula

Amygdala
Left Left

Anterior
Right Cingulate Right

Thalamus

Angular gyrus

olfactory area

medial ofc

sup. Medial fg
Domain dependent
Activations
 Social alone – Rt. Amygdala (21%)
 Value based alone – several regions in prev.
slide + mid & post. Cingulate (19%, 57%), Lt
Inf. Frontal tri (17%), gyrus rectus (L 13%, R
10%)
 Perceptual alone – Lt front Inf oper (20%), Inf.
Parietal area (L 20%, R 11%), Lt precentral
gyrus (13%), SMA (14%)
 Possibly reflecting task related activity
 Pairwise comparisonPercept Value Social

 Inferior frontal areas were more active in perceptual

dm vs.value-based and social decision making
 Social dm vs. Perceptual dm, greater activity in
Anterior Cingulate and medial prefrontal areas
(medial orbitofrontal, superior medial frontal)

PerceptVsSocial

medial ofc, superior medial frontal, anterior cingulate, bil precentral/ inf frontal, inf parietal
 Pairwise comparisonPercept Value Social

 Bil. Precentral gyri, and Inferior parietal areas to be more

active in perceptual dm vs. value-based and social dm
PerceptVsValue

medial ofc, caudate, ant cingulate, post cingulate, inf frontal, inf parietal
SocialVsValue

Right Insula, caudate, putamen, pallidum, mid cingulate

 Pairwise comparison
 Right Insula was more active in the contrast
Social compared to Value-based decision
making
PerceptVsValue

medial ofc, caudate, ant cingulate, post cingulate, inf frontal, inf parietal
SocialVsValue

Right Insula, caudate, putamen, pallidum, mid cingulate

Further Steps

Reward vs decision studies

Choice vs decision studies
Rest studies vs common decision making
studies
Value, social, perceptual studies without
decision making
Intrinsic Connectivity Networks
Reported Activation sites
Smoothed images
Figure-4.11: The
metadata matrix of
behavioral domains
and paradigms was
extracted directly
from experiments
archived in
NeuroSynth (5809
experiments × 525
metadata classes)
Figure-4.12 : Correlogram of the concatenated metadata matrix for
NeuroSynth behavioral domains and paradigms provides a per-
network mapping of the functional properties of each ICN, ordered to
reflect the groupings set forth by the behavioral- and network-driven
HCA results.
Graph-theory Based Clustering Method for Meta-analysis of Neuroimaging Studies

Word Frequency of Occurrence of each fo the Key

Concepts

Pairwise Distances across al the Key Concepts

Jaccard Metric between Key Concepts

Construction of Dendrogram for the Jaccard Metric

Results

Clustering using Graph Theory Approach

Jaccard Distance with a Threshold of 1 Occurrence of

Key Concept in Every 1000 Words
 Figure-3.4: Scatter plot inferring the nodes the associated to the
key concept “written” (Y-axis: 264 value).
Figure-3.2: Histogram for 525 key concepts
Figure-3.3: Histogram for 524 key concepts
 525 key 524 key
Term-1 Term-2
concepts concepts 525 key 524 key
Actions action No Yes term1 term2 term3 concept concept
Ambiguity ambiguous Yes Yes
Animals animal No Yes s s
Aphasia grammatical Yes Yes Adolescen adolesce
Awareness conscious Yes Yes childhood Yes Yes
ts nce
Bottomup topdown Yes Yes
Chinese japanese Yes Yes Depressi
Bipolar ptsd Yes Yes
Distractor distractors Yes Yes ve
Dopamine dopaminergic Yes Yes
intelligen
Episodic retrieval No Yes Child fluency Yes Yes
Facial expressions Yes No ce
Female Male Yes No Congruen congruen incongrue
Females males Yes No Yes Yes
Gesture gestures Yes Yes
t cy nt
Judgment judgments Yes Yes age
Elderly Aging Yes Yes
Letters Letter Yes Yes related
Masked masking Yes Yes
Musical Music Yes Yes
Executive Working memory Yes No
Negative positive Yes Yes Execution Planning solving No Yes
Object objects Yes Yes probabiliti
Olfactory Taste Yes Yes Explicit Implicit Yes Yes
Outcome outcomes No Yes
es
Overt covert Yes Yes expressio expressio
Facial Yes No
Pain painful Yes Yes n ns
Pairs Pair Yes Yes
Picture pictures No Yes
Happy Angry fearful Yes Yes
Prosody prosodic Yes Yes Autobiog
Memories famous No Yes
Rating ratings No Yes raphical
Scene scenes Yes Yes
Motivatio
Schizophrenic antipsychotic Yes Yes Food eating Yes No
Selfreferential thoughts Yes Yes n
Sentences sentence Yes Yes Mouth Lip oral Yes Yes
Skin Heart Yes Yes
Sleep restingstate Yes Yes Muscle Muscles limb Yes Yes
Sound sounds Yes Yes Names Name naming Yes Yes
Switching switch Yes Yes Nback 1back 2back Yes Yes
Unattended attended Yes Yes
Verb Noun Yes Yes errorrelat
Nogo Gonogo Yes Yes
Violations violation Yes Yes ed
Working memory Yes No Numerical Digits digit Yes Yes
 Thresholding the Frequency

Figure-3.5: Histogram thresholded key concepts.

 S.No Term-1 Term-2 S.No Term-1 Term-2 Term-3
1. Cues Cue 1. Priming repetition Prime
2. preparation Visuomotor 2. Invalid pair Pairs
3. repetitions Presentations 3. Pleasant food Unpleasant
4. Judgment Judgments 4. Experience work Future
5. Verbal Fluency 5. Semantic words Word
6. Saccadic Lip 6. Motivation anger Disgust
7. Targets Target 7. Finger hand Tapping
8. anticipation Expectation 8. Explicit knowledge Implicit
9. Fingers Tactile 9. Mouth biological Motion
10. audiovisual Crossmodal 10. Subjective ratings Stimulation
11. Persons Empathic 11. Sequences sequence Planning
12. Nonverbal Phonology 12. Females categorization Males
13. Foot Limb 13. Masked conscious Subtraction
14. engagement Adolescence 14. Decision decisions Decisionmaking
15. Inhibitory Inhibition 15. Probes probe Delay
16. Pressure Heart 16. Executive errors Error
17. Adults Children 17. Sound hearing Noise
18. Unattended Attended 18. Gestures hands Dominant
19. Plasticity longterm Shortterm
19. Working Memory
20. Emotionally sadness Voice
20. Object Objects
21. Losses choice Choices
21. Sentences Sentence
22. Training practice Mental
22. photographs Categorical
23. Counting learned Endogenous
23. Scene Scenes
24. Social negative Positive
24. Actions Action 25. Musical listening Music
25. Encoding Retrieval 26. Engaged remembered Taskrelevant
26. Taste Eating 27. Cocaine Salience Adhd
27. Attention Attentional 28. Tracking Epilepsy Probabilistic
28. Perspective Person 29. Habituation Thought Novelty
29. Effort Visuospatial 30. Physical Sexual Women
30. Face Faces 31. Animals Drugs Reactivity
Figure-3.6: Graphical representation of cluster size-17 for thresholded key concepts.
Thank You

kprasad@iitgn.ac.in