Visual-vestibular cue integration for heading perception: Applications of optimal cue integration theory

Christopher R. Fetsch, Gregory C. Deangelis, Dora Angelaki

Research output: Contribution to journalReview article

Abstract

The perception of self-motion is crucial for navigation, spatial orientation and motor control. In particular, estimation of one's direction of translation, or heading, relies heavily on multisensory integration in most natural situations. Visual and nonvisual (e.g., vestibular) information can be used to judge heading, but each modality alone is often insufficient for accurate performance. It is not surprising, then, that visual and vestibular signals converge frequently in the nervous system, and that these signals interact in powerful ways at the level of behavior and perception. Early behavioral studies of visual-vestibular interactions consisted mainly of descriptive accounts of perceptual illusions and qualitative estimation tasks, often with conflicting results. In contrast, cue integration research in other modalities has benefited from the application of rigorous psychophysical techniques, guided by normative models that rest on the foundation of ideal-observer analysis and Bayesian decision theory. Here we review recent experiments that have attempted to harness these so-called optimal cue integration models for the study of self-motion perception. Some of these studies used nonhuman primate subjects, enabling direct comparisons between behavioral performance and simultaneously recorded neuronal activity. The results indicate that humans and monkeys can integrate visual and vestibular heading cues in a manner consistent with optimal integration theory, and that single neurons in the dorsal medial superior temporal area show striking correlates of the behavioral effects. This line of research and other applications of normative cue combination models should continue to shed light on mechanisms of self-motion perception and the neuronal basis of multisensory integration.

Original languageEnglish (US)
Pages (from-to)1721-1729
Number of pages9
JournalEuropean Journal of Neuroscience
Volume31
Issue number10
DOIs
StatePublished - Jan 1 2010

Fingerprint

Motion Perception
Cues
Decision Theory
Bayes Theorem
Research
Primates
Nervous System
Haplorhini
Neurons

Keywords

  • Human
  • Macaque
  • Psychophysics
  • Vestibular
  • Visual

ASJC Scopus subject areas

  • Neuroscience(all)
  • Medicine(all)

Cite this

Visual-vestibular cue integration for heading perception : Applications of optimal cue integration theory. / Fetsch, Christopher R.; Deangelis, Gregory C.; Angelaki, Dora.

In: European Journal of Neuroscience, Vol. 31, No. 10, 01.01.2010, p. 1721-1729.

Research output: Contribution to journalReview article

@article{2d5cabdfe9ee4392b4f7f6395a54002d,
title = "Visual-vestibular cue integration for heading perception: Applications of optimal cue integration theory",
abstract = "The perception of self-motion is crucial for navigation, spatial orientation and motor control. In particular, estimation of one's direction of translation, or heading, relies heavily on multisensory integration in most natural situations. Visual and nonvisual (e.g., vestibular) information can be used to judge heading, but each modality alone is often insufficient for accurate performance. It is not surprising, then, that visual and vestibular signals converge frequently in the nervous system, and that these signals interact in powerful ways at the level of behavior and perception. Early behavioral studies of visual-vestibular interactions consisted mainly of descriptive accounts of perceptual illusions and qualitative estimation tasks, often with conflicting results. In contrast, cue integration research in other modalities has benefited from the application of rigorous psychophysical techniques, guided by normative models that rest on the foundation of ideal-observer analysis and Bayesian decision theory. Here we review recent experiments that have attempted to harness these so-called optimal cue integration models for the study of self-motion perception. Some of these studies used nonhuman primate subjects, enabling direct comparisons between behavioral performance and simultaneously recorded neuronal activity. The results indicate that humans and monkeys can integrate visual and vestibular heading cues in a manner consistent with optimal integration theory, and that single neurons in the dorsal medial superior temporal area show striking correlates of the behavioral effects. This line of research and other applications of normative cue combination models should continue to shed light on mechanisms of self-motion perception and the neuronal basis of multisensory integration.",
keywords = "Human, Macaque, Psychophysics, Vestibular, Visual",
author = "Fetsch, {Christopher R.} and Deangelis, {Gregory C.} and Dora Angelaki",
year = "2010",
month = "1",
day = "1",
doi = "10.1111/j.1460-9568.2010.07207.x",
language = "English (US)",
volume = "31",
pages = "1721--1729",
journal = "European Journal of Neuroscience",
issn = "0953-816X",
publisher = "Wiley-Blackwell",
number = "10",

}

TY - JOUR

T1 - Visual-vestibular cue integration for heading perception

T2 - Applications of optimal cue integration theory

AU - Fetsch, Christopher R.

AU - Deangelis, Gregory C.

AU - Angelaki, Dora

PY - 2010/1/1

Y1 - 2010/1/1

N2 - The perception of self-motion is crucial for navigation, spatial orientation and motor control. In particular, estimation of one's direction of translation, or heading, relies heavily on multisensory integration in most natural situations. Visual and nonvisual (e.g., vestibular) information can be used to judge heading, but each modality alone is often insufficient for accurate performance. It is not surprising, then, that visual and vestibular signals converge frequently in the nervous system, and that these signals interact in powerful ways at the level of behavior and perception. Early behavioral studies of visual-vestibular interactions consisted mainly of descriptive accounts of perceptual illusions and qualitative estimation tasks, often with conflicting results. In contrast, cue integration research in other modalities has benefited from the application of rigorous psychophysical techniques, guided by normative models that rest on the foundation of ideal-observer analysis and Bayesian decision theory. Here we review recent experiments that have attempted to harness these so-called optimal cue integration models for the study of self-motion perception. Some of these studies used nonhuman primate subjects, enabling direct comparisons between behavioral performance and simultaneously recorded neuronal activity. The results indicate that humans and monkeys can integrate visual and vestibular heading cues in a manner consistent with optimal integration theory, and that single neurons in the dorsal medial superior temporal area show striking correlates of the behavioral effects. This line of research and other applications of normative cue combination models should continue to shed light on mechanisms of self-motion perception and the neuronal basis of multisensory integration.

AB - The perception of self-motion is crucial for navigation, spatial orientation and motor control. In particular, estimation of one's direction of translation, or heading, relies heavily on multisensory integration in most natural situations. Visual and nonvisual (e.g., vestibular) information can be used to judge heading, but each modality alone is often insufficient for accurate performance. It is not surprising, then, that visual and vestibular signals converge frequently in the nervous system, and that these signals interact in powerful ways at the level of behavior and perception. Early behavioral studies of visual-vestibular interactions consisted mainly of descriptive accounts of perceptual illusions and qualitative estimation tasks, often with conflicting results. In contrast, cue integration research in other modalities has benefited from the application of rigorous psychophysical techniques, guided by normative models that rest on the foundation of ideal-observer analysis and Bayesian decision theory. Here we review recent experiments that have attempted to harness these so-called optimal cue integration models for the study of self-motion perception. Some of these studies used nonhuman primate subjects, enabling direct comparisons between behavioral performance and simultaneously recorded neuronal activity. The results indicate that humans and monkeys can integrate visual and vestibular heading cues in a manner consistent with optimal integration theory, and that single neurons in the dorsal medial superior temporal area show striking correlates of the behavioral effects. This line of research and other applications of normative cue combination models should continue to shed light on mechanisms of self-motion perception and the neuronal basis of multisensory integration.

KW - Human

KW - Macaque

KW - Psychophysics

KW - Vestibular

KW - Visual

UR - http://www.scopus.com/inward/record.url?scp=77952595023&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77952595023&partnerID=8YFLogxK

U2 - 10.1111/j.1460-9568.2010.07207.x

DO - 10.1111/j.1460-9568.2010.07207.x

M3 - Review article

VL - 31

SP - 1721

EP - 1729

JO - European Journal of Neuroscience

JF - European Journal of Neuroscience

SN - 0953-816X

IS - 10

ER -