A computational analysis of the relationship between neuronal and behavioral responses to visual motion

Michael N. Shadlen, Kenneth H. Britten, William T. Newsome, J. Anthony Movshon

Research output: Contribution to journalArticle

Abstract

We have documented previously a close relationship between neuronal activity in the middle temporal visual area (MT or V5) and behavioral judgments of motion (Newsome et al., 1989; Salzman et al., 1990; Britten et al., 1992; Britten et al., 1996). We have now used numerical simulations to try to understand how neural signals in area MT support psychophysical decisions. We developed a model that pools neuronal responses drawn from our physiological data set and compares average responses in different pools to produce psychophysical decisions. The structure of the model allows us to assess the relationship between 'neuronal' input signals and simulated psychophysical performance using the same methods we have applied to real experimental data. We sought to reconcile three experimental observations: psychophysical performance (threshold sensitivity to motion stimuli embedded in noise), a trial-by-trial covariation between the neural response and the monkey's choices, and a modest correlation between pairs of MT neurons in their variable responses to identical visual stimuli. Our results can be most accurately simulated if psychophysical decisions are based on pools of at least 100 weakly correlated sensory neurons. The neurons composing the pools must include a broader range of sensitivities than we encountered in our MT recordings, presumably because of the inclusion of neurons whose optimal stimulus is different from the one being discriminated. Central sources of noise degrade the signal-to-noise ratio of the pooled signal, but this degradation is relatively small compared with the noise typically carried by single cortical neurons. This suggests that our monkeys base near-threshold psychophysical judgments on signals carried by populations of weakly interacting neurons; these populations include many neurons that are not tuned optimally for the particular stimuli being discriminated.

Original languageEnglish (US)
Pages (from-to)1486-1510
Number of pages25
JournalJournal of Neuroscience
Volume16
Issue number4
StatePublished - Feb 15 1996

Fingerprint

Neurons
Noise
Haplorhini
Signal-To-Noise Ratio
Sensory Receptor Cells
Population

Keywords

  • area MT
  • motion perception
  • neural modeling
  • sensory coding
  • signal detection
  • visual psychophysics

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

A computational analysis of the relationship between neuronal and behavioral responses to visual motion. / Shadlen, Michael N.; Britten, Kenneth H.; Newsome, William T.; Movshon, J. Anthony.

In: Journal of Neuroscience, Vol. 16, No. 4, 15.02.1996, p. 1486-1510.

Research output: Contribution to journalArticle

Shadlen, Michael N. ; Britten, Kenneth H. ; Newsome, William T. ; Movshon, J. Anthony. / A computational analysis of the relationship between neuronal and behavioral responses to visual motion. In: Journal of Neuroscience. 1996 ; Vol. 16, No. 4. pp. 1486-1510.
@article{ae20266ec499481cb664392f658bddbd,
title = "A computational analysis of the relationship between neuronal and behavioral responses to visual motion",
abstract = "We have documented previously a close relationship between neuronal activity in the middle temporal visual area (MT or V5) and behavioral judgments of motion (Newsome et al., 1989; Salzman et al., 1990; Britten et al., 1992; Britten et al., 1996). We have now used numerical simulations to try to understand how neural signals in area MT support psychophysical decisions. We developed a model that pools neuronal responses drawn from our physiological data set and compares average responses in different pools to produce psychophysical decisions. The structure of the model allows us to assess the relationship between 'neuronal' input signals and simulated psychophysical performance using the same methods we have applied to real experimental data. We sought to reconcile three experimental observations: psychophysical performance (threshold sensitivity to motion stimuli embedded in noise), a trial-by-trial covariation between the neural response and the monkey's choices, and a modest correlation between pairs of MT neurons in their variable responses to identical visual stimuli. Our results can be most accurately simulated if psychophysical decisions are based on pools of at least 100 weakly correlated sensory neurons. The neurons composing the pools must include a broader range of sensitivities than we encountered in our MT recordings, presumably because of the inclusion of neurons whose optimal stimulus is different from the one being discriminated. Central sources of noise degrade the signal-to-noise ratio of the pooled signal, but this degradation is relatively small compared with the noise typically carried by single cortical neurons. This suggests that our monkeys base near-threshold psychophysical judgments on signals carried by populations of weakly interacting neurons; these populations include many neurons that are not tuned optimally for the particular stimuli being discriminated.",
keywords = "area MT, motion perception, neural modeling, sensory coding, signal detection, visual psychophysics",
author = "Shadlen, {Michael N.} and Britten, {Kenneth H.} and Newsome, {William T.} and Movshon, {J. Anthony}",
year = "1996",
month = "2",
day = "15",
language = "English (US)",
volume = "16",
pages = "1486--1510",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "4",

}

TY - JOUR

T1 - A computational analysis of the relationship between neuronal and behavioral responses to visual motion

AU - Shadlen, Michael N.

AU - Britten, Kenneth H.

AU - Newsome, William T.

AU - Movshon, J. Anthony

PY - 1996/2/15

Y1 - 1996/2/15

N2 - We have documented previously a close relationship between neuronal activity in the middle temporal visual area (MT or V5) and behavioral judgments of motion (Newsome et al., 1989; Salzman et al., 1990; Britten et al., 1992; Britten et al., 1996). We have now used numerical simulations to try to understand how neural signals in area MT support psychophysical decisions. We developed a model that pools neuronal responses drawn from our physiological data set and compares average responses in different pools to produce psychophysical decisions. The structure of the model allows us to assess the relationship between 'neuronal' input signals and simulated psychophysical performance using the same methods we have applied to real experimental data. We sought to reconcile three experimental observations: psychophysical performance (threshold sensitivity to motion stimuli embedded in noise), a trial-by-trial covariation between the neural response and the monkey's choices, and a modest correlation between pairs of MT neurons in their variable responses to identical visual stimuli. Our results can be most accurately simulated if psychophysical decisions are based on pools of at least 100 weakly correlated sensory neurons. The neurons composing the pools must include a broader range of sensitivities than we encountered in our MT recordings, presumably because of the inclusion of neurons whose optimal stimulus is different from the one being discriminated. Central sources of noise degrade the signal-to-noise ratio of the pooled signal, but this degradation is relatively small compared with the noise typically carried by single cortical neurons. This suggests that our monkeys base near-threshold psychophysical judgments on signals carried by populations of weakly interacting neurons; these populations include many neurons that are not tuned optimally for the particular stimuli being discriminated.

AB - We have documented previously a close relationship between neuronal activity in the middle temporal visual area (MT or V5) and behavioral judgments of motion (Newsome et al., 1989; Salzman et al., 1990; Britten et al., 1992; Britten et al., 1996). We have now used numerical simulations to try to understand how neural signals in area MT support psychophysical decisions. We developed a model that pools neuronal responses drawn from our physiological data set and compares average responses in different pools to produce psychophysical decisions. The structure of the model allows us to assess the relationship between 'neuronal' input signals and simulated psychophysical performance using the same methods we have applied to real experimental data. We sought to reconcile three experimental observations: psychophysical performance (threshold sensitivity to motion stimuli embedded in noise), a trial-by-trial covariation between the neural response and the monkey's choices, and a modest correlation between pairs of MT neurons in their variable responses to identical visual stimuli. Our results can be most accurately simulated if psychophysical decisions are based on pools of at least 100 weakly correlated sensory neurons. The neurons composing the pools must include a broader range of sensitivities than we encountered in our MT recordings, presumably because of the inclusion of neurons whose optimal stimulus is different from the one being discriminated. Central sources of noise degrade the signal-to-noise ratio of the pooled signal, but this degradation is relatively small compared with the noise typically carried by single cortical neurons. This suggests that our monkeys base near-threshold psychophysical judgments on signals carried by populations of weakly interacting neurons; these populations include many neurons that are not tuned optimally for the particular stimuli being discriminated.

KW - area MT

KW - motion perception

KW - neural modeling

KW - sensory coding

KW - signal detection

KW - visual psychophysics

UR - http://www.scopus.com/inward/record.url?scp=0029928664&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0029928664&partnerID=8YFLogxK

M3 - Article

VL - 16

SP - 1486

EP - 1510

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 4

ER -