Dynamic reweighting of visual and vestibular cues during self-motion perception

Christopher R. Fetsch, Amanda H. Turner, Gregory C. DeAngelis, Dora Angelaki

Research output: Contribution to journalArticle

Abstract

The perception of self-motion direction, or heading, relies on integration of multiple sensory cues, especially from the visual and vestibular systems. However, the reliability of sensory information can vary rapidly and unpredictably, and it remains unclear how the brain integrates multiple sensory signals given this dynamic uncertainty. Human psychophysical studies have shown that observers combine cues by weighting them in proportion to their reliability, consistent with statistically optimal integration schemes derived from Bayesian probability theory. Remarkably, because cue reliability is varied randomly across trials, the perceptual weight assigned to each cue must change from trial to trial. Dynamic cue reweighting has not been examined for combinations of visual and vestibular cues, nor has the Bayesian cue integration approach been applied to laboratory animals, an important step toward understanding the neural basis of cue integration. To address these issues, we tested human and monkey subjects in a heading discrimination task involving visual (optic flow) and vestibular (translational motion) cues. The cues were placed in conflict on a subset of trials, and their relative reliability was varied to assess the weights that subjects gave to each cue in their heading judgments.Wefound that monkeys can rapidly reweight visual and vestibular cues according to their reliability, the first such demonstration in a nonhuman species. However, some monkeys and humans tended to over-weight vestibular cues, inconsistent with simple predictions of a Bayesian model. Nonetheless, our findings establish a robust model system for studying the neural mechanisms of dynamic cue reweighting in multisensory perception.

Original languageEnglish (US)
Pages (from-to)15601-15612
Number of pages12
JournalJournal of Neuroscience
Volume29
Issue number49
DOIs
StatePublished - Dec 9 2009

Fingerprint

Motion Perception
Cues
Haplorhini
Weights and Measures
Probability Theory
Optic Flow
Bayes Theorem
Laboratory Animals

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Dynamic reweighting of visual and vestibular cues during self-motion perception. / Fetsch, Christopher R.; Turner, Amanda H.; DeAngelis, Gregory C.; Angelaki, Dora.

In: Journal of Neuroscience, Vol. 29, No. 49, 09.12.2009, p. 15601-15612.

Research output: Contribution to journalArticle

Fetsch, Christopher R. ; Turner, Amanda H. ; DeAngelis, Gregory C. ; Angelaki, Dora. / Dynamic reweighting of visual and vestibular cues during self-motion perception. In: Journal of Neuroscience. 2009 ; Vol. 29, No. 49. pp. 15601-15612.
@article{78b4446288cd4097ad65cf245d77882a,
title = "Dynamic reweighting of visual and vestibular cues during self-motion perception",
abstract = "The perception of self-motion direction, or heading, relies on integration of multiple sensory cues, especially from the visual and vestibular systems. However, the reliability of sensory information can vary rapidly and unpredictably, and it remains unclear how the brain integrates multiple sensory signals given this dynamic uncertainty. Human psychophysical studies have shown that observers combine cues by weighting them in proportion to their reliability, consistent with statistically optimal integration schemes derived from Bayesian probability theory. Remarkably, because cue reliability is varied randomly across trials, the perceptual weight assigned to each cue must change from trial to trial. Dynamic cue reweighting has not been examined for combinations of visual and vestibular cues, nor has the Bayesian cue integration approach been applied to laboratory animals, an important step toward understanding the neural basis of cue integration. To address these issues, we tested human and monkey subjects in a heading discrimination task involving visual (optic flow) and vestibular (translational motion) cues. The cues were placed in conflict on a subset of trials, and their relative reliability was varied to assess the weights that subjects gave to each cue in their heading judgments.Wefound that monkeys can rapidly reweight visual and vestibular cues according to their reliability, the first such demonstration in a nonhuman species. However, some monkeys and humans tended to over-weight vestibular cues, inconsistent with simple predictions of a Bayesian model. Nonetheless, our findings establish a robust model system for studying the neural mechanisms of dynamic cue reweighting in multisensory perception.",
author = "Fetsch, {Christopher R.} and Turner, {Amanda H.} and DeAngelis, {Gregory C.} and Dora Angelaki",
year = "2009",
month = "12",
day = "9",
doi = "10.1523/JNEUROSCI.2574-09.2009",
language = "English (US)",
volume = "29",
pages = "15601--15612",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "49",

}

TY - JOUR

T1 - Dynamic reweighting of visual and vestibular cues during self-motion perception

AU - Fetsch, Christopher R.

AU - Turner, Amanda H.

AU - DeAngelis, Gregory C.

AU - Angelaki, Dora

PY - 2009/12/9

Y1 - 2009/12/9

N2 - The perception of self-motion direction, or heading, relies on integration of multiple sensory cues, especially from the visual and vestibular systems. However, the reliability of sensory information can vary rapidly and unpredictably, and it remains unclear how the brain integrates multiple sensory signals given this dynamic uncertainty. Human psychophysical studies have shown that observers combine cues by weighting them in proportion to their reliability, consistent with statistically optimal integration schemes derived from Bayesian probability theory. Remarkably, because cue reliability is varied randomly across trials, the perceptual weight assigned to each cue must change from trial to trial. Dynamic cue reweighting has not been examined for combinations of visual and vestibular cues, nor has the Bayesian cue integration approach been applied to laboratory animals, an important step toward understanding the neural basis of cue integration. To address these issues, we tested human and monkey subjects in a heading discrimination task involving visual (optic flow) and vestibular (translational motion) cues. The cues were placed in conflict on a subset of trials, and their relative reliability was varied to assess the weights that subjects gave to each cue in their heading judgments.Wefound that monkeys can rapidly reweight visual and vestibular cues according to their reliability, the first such demonstration in a nonhuman species. However, some monkeys and humans tended to over-weight vestibular cues, inconsistent with simple predictions of a Bayesian model. Nonetheless, our findings establish a robust model system for studying the neural mechanisms of dynamic cue reweighting in multisensory perception.

AB - The perception of self-motion direction, or heading, relies on integration of multiple sensory cues, especially from the visual and vestibular systems. However, the reliability of sensory information can vary rapidly and unpredictably, and it remains unclear how the brain integrates multiple sensory signals given this dynamic uncertainty. Human psychophysical studies have shown that observers combine cues by weighting them in proportion to their reliability, consistent with statistically optimal integration schemes derived from Bayesian probability theory. Remarkably, because cue reliability is varied randomly across trials, the perceptual weight assigned to each cue must change from trial to trial. Dynamic cue reweighting has not been examined for combinations of visual and vestibular cues, nor has the Bayesian cue integration approach been applied to laboratory animals, an important step toward understanding the neural basis of cue integration. To address these issues, we tested human and monkey subjects in a heading discrimination task involving visual (optic flow) and vestibular (translational motion) cues. The cues were placed in conflict on a subset of trials, and their relative reliability was varied to assess the weights that subjects gave to each cue in their heading judgments.Wefound that monkeys can rapidly reweight visual and vestibular cues according to their reliability, the first such demonstration in a nonhuman species. However, some monkeys and humans tended to over-weight vestibular cues, inconsistent with simple predictions of a Bayesian model. Nonetheless, our findings establish a robust model system for studying the neural mechanisms of dynamic cue reweighting in multisensory perception.

UR - http://www.scopus.com/inward/record.url?scp=71849088010&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=71849088010&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.2574-09.2009

DO - 10.1523/JNEUROSCI.2574-09.2009

M3 - Article

C2 - 20007484

AN - SCOPUS:71849088010

VL - 29

SP - 15601

EP - 15612

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 49

ER -