Professional Documents
Culture Documents
Haxby Etal01
Haxby Etal01
Haxby Etal01
net/publication/11771685
CITATIONS READS
3,453 3,271
6 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Alumit Ishai on 19 May 2014.
All ventral temporal 22.9 ⫾ 2.8 100*** 100*** 98 ⫾ 2*** 90 ⫾ 6*** 92 ⫾ 6*** 92 ⫾ 7*** 96 ⫾ 2*** 100***
object-selective cortex
Minus regions that were 15.4 ⫾ 1.8 100*** 100*** 95 ⫾ 2*** 89 ⫾ 6*** 85 ⫾ 9** 90 ⫾ 8** 98 ⫾ 1*** 100***
maximally responsive to
categories being compared
Regions maximally
responsive to:
Faces 3.1 ⫾ 0.9 94 ⫾ 7*** 99 ⫾ 1*** 76 ⫾ 13* 81 ⫾ 14* 77 ⫾ 9* 70 ⫾ 16 77 ⫾ 11* 92 ⫾ 7***
Houses 9.6 ⫾ 1.8 100*** 100*** 88 ⫾ 5*** 85 ⫾ 10** 81 ⫾ 6** 96 ⫾ 2*** 94 ⫾ 3*** 100***
Cats 2.6 ⫾ 0.4 96 ⫾ 4*** 96 ⫾ 2*** 82 ⫾ 8** 65 ⫾ 11 69 ⫾ 5** 76 ⫾ 9* 95 ⫾ 4*** 100***
Small objects 6.9 ⫾ 1.1 100*** 100*** 95 ⫾ 3*** 83 ⫾ 7** 92 ⫾ 8** 94 ⫾ 6*** 90 ⫾ 6*** 96 ⫾ 4***
Differs from chance (50%): *, P ⬍ 0.05; **, P ⬍ 0.01; ***, P ⬍ 0.001.
regions that are putatively specialized for re- chairs, and nonsense patterns. The categories were gory correlation (for example, response to category A
stricted categories of stimuli (faces and plac- chosen so that all stimuli from a given category on even and odd runs) was larger than the between-
would have the same base level name. The specific category correlation (correlation of the response to
es) (5, 7) or specific perceptual processes categories were selected to allow comparison with category A on even runs with the response to category
(visual expertise) (9 –11) provide no explicit our previous studies (faces, houses, chairs, animals, B on odd runs), that comparison was counted as a
account for how neural representations of all and tools) or ongoing studies (shoes and bottles). correct identification. For each pair of categories, there-
Control nonsense patterns were phase-scrambled im- fore, there were four such comparisons (within-catego-
object categories differ (39). By contrast, our ages of the intact objects. Twelve time series were ry A versus category A on odd runs with category B on
results indicate how ventral extrastriate cor- obtained in each subject. Each time series began and even runs, within-category A versus category A on even
tex can produce unique representations for all ended with 12 s of rest and contained eight stimulus runs with category B on odd runs, and similar compar-
blocks of 24-s duration, one for each category, sep- isons involving the within-category correlation for cat-
object categories. Fortuitously, these repre- arated by 12-s intervals of rest. Stimuli were present- egory B). The probability that the accuracy of identify-
sentations have a consistent topographic ar- ed for 500 ms with an interstimulus interval of 1500 ing each individual category exceeded chance was de-
rangement that may provide a key for decod- ms. Repetitions of meaningful stimuli were pictures termined with a simple test: The accuracy of identifying
of the same face or object photographed from dif- that category was determined for each subject as the
ing the information that underlies face and ferent angles. Stimuli for each meaningful category proportion of pairwise comparisons that yielded correct
object recognition. were four images each of 12 different exemplars. identifications, and a t test (df ⫽ 5) was used to test
Image data were analyzed with multiple regression whether the mean accuracy across subjects exceeded
with no spatial smoothing (40). To identify object- chance (50%).
References and Notes
1. C. G. Gross, C. E. Rocha-Miranda, D. B. Bender, J. Neu- selective cortex, we used an eight-regressor model. 20. The category being viewed was correctly identified
rophysiol. 35, 96 (1972). The first regressor was the contrast between stimulus against all other categories in 83% of cases (within-
2. K. Tanaka, Annu. Rev. Neurosci. 19, 109 (1996). blocks and rest. The remaining seven regressors mod- category correlation for a given category was the
3. N. K. Logothetis, D. L. Scheinberg, Annu. Rev. Neuro- eled the response to each meaningful category. The greatest of all correlations between the response to
sci. 19, 577 (1996). omnibus effect of these seven regressors was used as that category in one half of the data and the respons-
4. S. Edelman, Trends Cogn. Sci. 1, 296 (1997). a test of the significance of differences among the es to that and other categories in the other half of
5. N. Kanwisher, J. McDermott, M. Chun, J. Neurosci. 17, responses to stimulus categories. To determine the the data; chance accuracy would be 12.5%). Accura-
4302 (1997). patterns of response to each category on even-num- cies for identifying patterns for individual categories
6. G. McCarthy, A. Puce, J. C. Gore, T. Allison, J. Cognit. bered and odd-numbered runs, we used a 16-regres- as compared with all other categories ranged from
Neurosci. 9, 605 (1997). sor model— eight regressors to model the response 100% (faces, houses, and scrambled pictures) to 67%
7. R. Epstein, N. Kanwisher, Nature 392, 598 (1999). to each category relative to rest on even runs and (bottles and scissors). Detailed results are published
8. G. K. Aguirre, E. Zarahn, M. D’Esposito, Neuron 21, eight regressors to model the response to each cat- as supplemental material (24).
373 (1998). egory on odd runs with no regressor that contrasted 21. Identification of the category being viewed when
9. I. Gauthier, M. J. Tarr, A. W. Anderson, P. Skudlarski, all stimulus blocks to rest. The  weight for each
that category was one of the four, small, man-made
J. C. Gore, Nature Neurosci. 2, 568 (1999). regressor was used as an estimate of the strength of
categories (bottles, scissors, shoes, and chairs) was
response relative to rest. Volumes of interest (VOI)
㛬㛬㛬㛬
10. I. Gauthier, Trends Cognit. Sci. 4, 1 (2000). significantly better than chance even when only the
were drawn on the high-resolution structural images
11. , P. Skudlarski, J. C. Gore, A. W. Anderson, comparisons among these categories were consid-
to identify ventral temporal, lateral temporal, and
Nature Neurosci. 3, 191 (2000). ered, both for all object-selective ventral temporal
ventrolateral occipital cortex. The VOI for ventral
12. J. V. Haxby et al., Neuron 22, 189 (1999). cortex (bottles: mean accuracy across subjects was
temporal cortex extended from 70 to 20 mm poste-
13. A. Ishai, L. G. Ungerleider, A. Martin, J. L. Schouten, J. 83% for pairwise comparisons among small man-
rior to the anterior commissure in Talairach brain
V. Haxby, Proc. Natl. Acad. Sci. U.S.A. 96, 9379 made objects, differs from 50%, P ⬍ 0.02; scissors:
atlas coordinates (41) and consisted of the lingual,
(1999). 86%, P ⬍ 0.01; shoes: 86%, P ⬍ 0.02; chairs: 97%,
parahippocampal, fusiform, and inferior temporal
14. L. L. Chao, J. V. Haxby, A. Martin, Nature Neurosci. 2, P ⬍ 0.001) and for only cortex that responded max-
gyri. The VOI for lateral temporal cortex also extend-
913 (1999). imally to other categories (bottles: 86%, P ⬍ 0.01;
ed from 70 to 20 mm posterior to the anterior
15. J. V. Haxby, A. Ishai, L. L. Chao, L. G. Ungerleider, A. scissors: 83%, P ⬍ 0.01; shoes: 86%, P ⬍ 0.02; chairs:
commissure and consisted of the middle temporal
Martin, Trends Cognit. Sci. 4, 3 (2000). 100%). The analysis concentrated on patterns of
gyrus and both banks of the superior temporal sulcus.
16. S. Edelman, K. Grill-Spector, T. Kushnir, R. Malach, response in ventral temporal cortex, where the cat-
The VOI for ventrolateral occipital cortex extended
Psychobiology 26, 309 (1998). egory being viewed could be identified with greatest
from the occipital pole to 70 mm posterior to the
17. K. Grill-Spector et al., Neuron 24, 187 (1999). accuracy, but identification accuracies were nearly as
anterior commissure and consisted of the lingual,
18. Neural responses, as reflected in hemodynamic great for lateral temporal (94%) and ventrolateral
fusiform, inferior occipital, and middle occipital gyri.
changes, were measured in six subjects (five female occipital cortices (92%). The ability to identify the
Voxels within these VOIs that were significantly ob-
and one male) with gradient echo echoplanar imag- category being viewed on the basis of the patterns of
ject-selective (P ⬍ 10⫺6, uncorrected) were used for
ing on a GE 3T scanner (General Electric, Milwaukee, response within several subregions of ventral tempo-
the analysis of within-category and between-catego-
WI) [repetition time (TR) ⫽ 2500 ms, 40 3.5-mm- ral cortex as well as in ventral occipital and lateral
ry correlations.
thick sagittal images, field of view (FOV) ⫽ 24 cm, temporal cortex suggests the existence of multiple
echo time (TE) ⫽ 30 ms, flip angle ⫽ 90] while they 19. Analysis of the accuracy with which the category representations that encode different types of infor-
performed a one-back repetition detection task. being viewed could be identified focused on compar- mation about categories, such as visual form, typical
High-resolution T1-weighted spoiled gradient recall isons between patterns of response for pairs of cat- patterns of motion, and internal spatial arrange-
(SPGR) images were obtained for each subject to egories, as illustrated in Fig. 3. Mean response in each ments. We have suggested, for example, that the
provide detailed anatomy (124 1.2-mm-thick sagittal voxel across categories was subtracted from the re- lateral temporal cortex represents different patterns
images, FOV ⫽ 24 cm). Stimuli were gray-scale sponse to each individual category in each half of the of motion that are associated with faces and differ-
images of faces, houses, cats, bottles, scissors, shoes, data before calculating correlations. If the within-cate- ent categories of objects (42, 43).
REPORTS