Neural correlates of reliability-based cue weighting during multisensory integration

Christopher R. Fetsch, Alexandre Pouget, Gregory C. Deangelis, Dora Angelaki

Research output: Contribution to journalArticle

Abstract

Integration of multiple sensory cues is essential for precise and accurate perception and behavioral performance, yet the reliability of sensory signals can vary across modalities and viewing conditions. Human observers typically employ the optimal strategy of weighting each cue in proportion to its reliability, but the neural basis of this computation remains poorly understood. We trained monkeys to perform a heading discrimination task from visual and vestibular cues, varying cue reliability randomly. The monkeys appropriately placed greater weight on the more reliable cue, and population decoding of neural responses in the dorsal medial superior temporal area closely predicted behavioral cue weighting, including modest deviations from optimality. We found that the mathematical combination of visual and vestibular inputs by single neurons is generally consistent with recent theories of optimal probabilistic computation in neural circuits. These results provide direct evidence for a neural mechanism mediating a simple and widespread form of statistical inference.

Original languageEnglish (US)
Pages (from-to)146-154
Number of pages9
JournalNature Neuroscience
Volume15
Issue number1
DOIs
StatePublished - Jan 1 2012

Fingerprint

Cues
Haplorhini
Neurons
Weights and Measures
Population

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Neural correlates of reliability-based cue weighting during multisensory integration. / Fetsch, Christopher R.; Pouget, Alexandre; Deangelis, Gregory C.; Angelaki, Dora.

In: Nature Neuroscience, Vol. 15, No. 1, 01.01.2012, p. 146-154.

Research output: Contribution to journalArticle

Fetsch, Christopher R. ; Pouget, Alexandre ; Deangelis, Gregory C. ; Angelaki, Dora. / Neural correlates of reliability-based cue weighting during multisensory integration. In: Nature Neuroscience. 2012 ; Vol. 15, No. 1. pp. 146-154.
@article{ce290935b5fe4e7ba1d7976784292f3f,
title = "Neural correlates of reliability-based cue weighting during multisensory integration",
abstract = "Integration of multiple sensory cues is essential for precise and accurate perception and behavioral performance, yet the reliability of sensory signals can vary across modalities and viewing conditions. Human observers typically employ the optimal strategy of weighting each cue in proportion to its reliability, but the neural basis of this computation remains poorly understood. We trained monkeys to perform a heading discrimination task from visual and vestibular cues, varying cue reliability randomly. The monkeys appropriately placed greater weight on the more reliable cue, and population decoding of neural responses in the dorsal medial superior temporal area closely predicted behavioral cue weighting, including modest deviations from optimality. We found that the mathematical combination of visual and vestibular inputs by single neurons is generally consistent with recent theories of optimal probabilistic computation in neural circuits. These results provide direct evidence for a neural mechanism mediating a simple and widespread form of statistical inference.",
author = "Fetsch, {Christopher R.} and Alexandre Pouget and Deangelis, {Gregory C.} and Dora Angelaki",
year = "2012",
month = "1",
day = "1",
doi = "10.1038/nn.2983",
language = "English (US)",
volume = "15",
pages = "146--154",
journal = "Nature Neuroscience",
issn = "1097-6256",
publisher = "Nature Publishing Group",
number = "1",

}

TY - JOUR

T1 - Neural correlates of reliability-based cue weighting during multisensory integration

AU - Fetsch, Christopher R.

AU - Pouget, Alexandre

AU - Deangelis, Gregory C.

AU - Angelaki, Dora

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Integration of multiple sensory cues is essential for precise and accurate perception and behavioral performance, yet the reliability of sensory signals can vary across modalities and viewing conditions. Human observers typically employ the optimal strategy of weighting each cue in proportion to its reliability, but the neural basis of this computation remains poorly understood. We trained monkeys to perform a heading discrimination task from visual and vestibular cues, varying cue reliability randomly. The monkeys appropriately placed greater weight on the more reliable cue, and population decoding of neural responses in the dorsal medial superior temporal area closely predicted behavioral cue weighting, including modest deviations from optimality. We found that the mathematical combination of visual and vestibular inputs by single neurons is generally consistent with recent theories of optimal probabilistic computation in neural circuits. These results provide direct evidence for a neural mechanism mediating a simple and widespread form of statistical inference.

AB - Integration of multiple sensory cues is essential for precise and accurate perception and behavioral performance, yet the reliability of sensory signals can vary across modalities and viewing conditions. Human observers typically employ the optimal strategy of weighting each cue in proportion to its reliability, but the neural basis of this computation remains poorly understood. We trained monkeys to perform a heading discrimination task from visual and vestibular cues, varying cue reliability randomly. The monkeys appropriately placed greater weight on the more reliable cue, and population decoding of neural responses in the dorsal medial superior temporal area closely predicted behavioral cue weighting, including modest deviations from optimality. We found that the mathematical combination of visual and vestibular inputs by single neurons is generally consistent with recent theories of optimal probabilistic computation in neural circuits. These results provide direct evidence for a neural mechanism mediating a simple and widespread form of statistical inference.

UR - http://www.scopus.com/inward/record.url?scp=84655167229&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84655167229&partnerID=8YFLogxK

U2 - 10.1038/nn.2983

DO - 10.1038/nn.2983

M3 - Article

C2 - 22101645

AN - SCOPUS:84655167229

VL - 15

SP - 146

EP - 154

JO - Nature Neuroscience

JF - Nature Neuroscience

SN - 1097-6256

IS - 1

ER -