A neural representation of depth from motion parallax in macaque visual cortex

Jacob W. Nadler, Dora Angelaki, Gregory C. DeAngelis

Research output: Contribution to journalArticle

Abstract

Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.

Original languageEnglish (US)
Pages (from-to)642-645
Number of pages4
JournalNature
Volume452
Issue number7187
DOIs
StatePublished - Apr 3 2008

Fingerprint

Macaca
Visual Cortex
Cues
Depth Perception
User-Computer Interface
Vision Disparity
Binocular Vision
Neurons
Macaca mulatta
Haplorhini
Retina
Brain

ASJC Scopus subject areas

  • General

Cite this

A neural representation of depth from motion parallax in macaque visual cortex. / Nadler, Jacob W.; Angelaki, Dora; DeAngelis, Gregory C.

In: Nature, Vol. 452, No. 7187, 03.04.2008, p. 642-645.

Research output: Contribution to journalArticle

Nadler, Jacob W. ; Angelaki, Dora ; DeAngelis, Gregory C. / A neural representation of depth from motion parallax in macaque visual cortex. In: Nature. 2008 ; Vol. 452, No. 7187. pp. 642-645.
@article{148dbd40edbd4a31aa372cd8a1695b65,
title = "A neural representation of depth from motion parallax in macaque visual cortex",
abstract = "Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.",
author = "Nadler, {Jacob W.} and Dora Angelaki and DeAngelis, {Gregory C.}",
year = "2008",
month = "4",
day = "3",
doi = "10.1038/nature06814",
language = "English (US)",
volume = "452",
pages = "642--645",
journal = "Nature",
issn = "0028-0836",
publisher = "Nature Publishing Group",
number = "7187",

}

TY - JOUR

T1 - A neural representation of depth from motion parallax in macaque visual cortex

AU - Nadler, Jacob W.

AU - Angelaki, Dora

AU - DeAngelis, Gregory C.

PY - 2008/4/3

Y1 - 2008/4/3

N2 - Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.

AB - Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.

UR - http://www.scopus.com/inward/record.url?scp=41649117076&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=41649117076&partnerID=8YFLogxK

U2 - 10.1038/nature06814

DO - 10.1038/nature06814

M3 - Article

VL - 452

SP - 642

EP - 645

JO - Nature

JF - Nature

SN - 0028-0836

IS - 7187

ER -