Metamers of the ventral stream

Jeremy Freeman, Eero Simoncelli

Research output: Contribution to journalArticle

Abstract

The human capacity to recognize complex visual patterns emerges in a sequence of brain areas known as the ventral stream, beginning with primary visual cortex (V1). We developed a population model for mid-ventral processing, in which nonlinear combinations of V1 responses are averaged in receptive fields that grow with eccentricity. To test the model, we generated novel forms of visual metamers, stimuli that differ physically but look the same. We developed a behavioral protocol that uses metameric stimuli to estimate the receptive field sizes in which the model features are represented. Because receptive field sizes change along the ventral stream, our behavioral results can identify the visual area corresponding to the representation. Measurements in human observers implicate visual area V2, providing a new functional account of neurons in this area. The model also explains deficits of peripheral vision known as crowding, and provides a quantitative framework for assessing the capabilities and limitations of everyday vision.

Original languageEnglish (US)
Pages (from-to)1195-1204
Number of pages10
JournalNature Neuroscience
Volume14
Issue number9
DOIs
StatePublished - Sep 2011

Fingerprint

Crowding
Visual Cortex
Neurons
Brain
Population

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Metamers of the ventral stream. / Freeman, Jeremy; Simoncelli, Eero.

In: Nature Neuroscience, Vol. 14, No. 9, 09.2011, p. 1195-1204.

Research output: Contribution to journalArticle

Freeman, Jeremy ; Simoncelli, Eero. / Metamers of the ventral stream. In: Nature Neuroscience. 2011 ; Vol. 14, No. 9. pp. 1195-1204.
@article{583e8c1670e04b8c94ae43c0dae8f6d1,
title = "Metamers of the ventral stream",
abstract = "The human capacity to recognize complex visual patterns emerges in a sequence of brain areas known as the ventral stream, beginning with primary visual cortex (V1). We developed a population model for mid-ventral processing, in which nonlinear combinations of V1 responses are averaged in receptive fields that grow with eccentricity. To test the model, we generated novel forms of visual metamers, stimuli that differ physically but look the same. We developed a behavioral protocol that uses metameric stimuli to estimate the receptive field sizes in which the model features are represented. Because receptive field sizes change along the ventral stream, our behavioral results can identify the visual area corresponding to the representation. Measurements in human observers implicate visual area V2, providing a new functional account of neurons in this area. The model also explains deficits of peripheral vision known as crowding, and provides a quantitative framework for assessing the capabilities and limitations of everyday vision.",
author = "Jeremy Freeman and Eero Simoncelli",
year = "2011",
month = "9",
doi = "10.1038/nn.2889",
language = "English (US)",
volume = "14",
pages = "1195--1204",
journal = "Nature Neuroscience",
issn = "1097-6256",
publisher = "Nature Publishing Group",
number = "9",

}

TY - JOUR

T1 - Metamers of the ventral stream

AU - Freeman, Jeremy

AU - Simoncelli, Eero

PY - 2011/9

Y1 - 2011/9

N2 - The human capacity to recognize complex visual patterns emerges in a sequence of brain areas known as the ventral stream, beginning with primary visual cortex (V1). We developed a population model for mid-ventral processing, in which nonlinear combinations of V1 responses are averaged in receptive fields that grow with eccentricity. To test the model, we generated novel forms of visual metamers, stimuli that differ physically but look the same. We developed a behavioral protocol that uses metameric stimuli to estimate the receptive field sizes in which the model features are represented. Because receptive field sizes change along the ventral stream, our behavioral results can identify the visual area corresponding to the representation. Measurements in human observers implicate visual area V2, providing a new functional account of neurons in this area. The model also explains deficits of peripheral vision known as crowding, and provides a quantitative framework for assessing the capabilities and limitations of everyday vision.

AB - The human capacity to recognize complex visual patterns emerges in a sequence of brain areas known as the ventral stream, beginning with primary visual cortex (V1). We developed a population model for mid-ventral processing, in which nonlinear combinations of V1 responses are averaged in receptive fields that grow with eccentricity. To test the model, we generated novel forms of visual metamers, stimuli that differ physically but look the same. We developed a behavioral protocol that uses metameric stimuli to estimate the receptive field sizes in which the model features are represented. Because receptive field sizes change along the ventral stream, our behavioral results can identify the visual area corresponding to the representation. Measurements in human observers implicate visual area V2, providing a new functional account of neurons in this area. The model also explains deficits of peripheral vision known as crowding, and provides a quantitative framework for assessing the capabilities and limitations of everyday vision.

UR - http://www.scopus.com/inward/record.url?scp=80052264770&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052264770&partnerID=8YFLogxK

U2 - 10.1038/nn.2889

DO - 10.1038/nn.2889

M3 - Article

VL - 14

SP - 1195

EP - 1204

JO - Nature Neuroscience

JF - Nature Neuroscience

SN - 1097-6256

IS - 9

ER -