Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT

Jacob W. Nadler, Daniel Barbash, Hyung Goo R. Kim, Swati Shimpi, Dora Angelaki, Gregory C. DeAngelis

Research output: Contribution to journalArticle

Abstract

Perception of depth is based on a variety of cues, with binocular disparity and motion parallax generally providing more precise depth information than pictorial cues. Much is known about how neurons in visual cortex represent depth from binocular disparity or motion parallax, but little is known about the joint neural representation of these depth cues. We recently described neurons in the middle temporal (MT) area that signal depth sign (near vs far) from motion parallax; here,weexamine whether andhowthese neurons also signal depth from binocular disparity.Wefind that mostMTneurons in rhesus monkeys (Macaca Mulatta) are selective for depth sign based on both disparity and motion parallax cues. However, the depth-sign preferences (near or far) are not always aligned: 56% of MT neurons have matched depth-sign preferences ("congruent" cells) whereas the remaining 44% of neurons prefer near depth from motion parallax and far depth from disparity, or vice versa ("opposite" cells). For congruent cells, depth-sign selectivity increases when disparity cues are added to motion parallax, but this enhancement does not occur for opposite cells. This suggests that congruent cells might contribute to perceptual integration of depth cues. We also found that neurons are clustered in MT according to their depth tuning based on motion parallax, similar to the known clustering ofMTneurons for binocular disparity. Together, these findings suggest that areaMTis involved in constructing a representation of 3D scene structure that takes advantage of multiple depth cues available to mobile observers.

Original languageEnglish (US)
Pages (from-to)14061-14074
Number of pages14
JournalJournal of Neuroscience
Volume33
Issue number35
DOIs
StatePublished - Aug 30 2013

Fingerprint

Vision Disparity
Macaca
Cues
Joints
Neurons
Macaca mulatta
Depth Perception
Visual Cortex
Cluster Analysis

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT. / Nadler, Jacob W.; Barbash, Daniel; Kim, Hyung Goo R.; Shimpi, Swati; Angelaki, Dora; DeAngelis, Gregory C.

In: Journal of Neuroscience, Vol. 33, No. 35, 30.08.2013, p. 14061-14074.

Research output: Contribution to journalArticle

Nadler, Jacob W. ; Barbash, Daniel ; Kim, Hyung Goo R. ; Shimpi, Swati ; Angelaki, Dora ; DeAngelis, Gregory C. / Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT. In: Journal of Neuroscience. 2013 ; Vol. 33, No. 35. pp. 14061-14074.
@article{fd3932cfe4834e71b8a8dc6fe2e49c41,
title = "Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT",
abstract = "Perception of depth is based on a variety of cues, with binocular disparity and motion parallax generally providing more precise depth information than pictorial cues. Much is known about how neurons in visual cortex represent depth from binocular disparity or motion parallax, but little is known about the joint neural representation of these depth cues. We recently described neurons in the middle temporal (MT) area that signal depth sign (near vs far) from motion parallax; here,weexamine whether andhowthese neurons also signal depth from binocular disparity.Wefind that mostMTneurons in rhesus monkeys (Macaca Mulatta) are selective for depth sign based on both disparity and motion parallax cues. However, the depth-sign preferences (near or far) are not always aligned: 56{\%} of MT neurons have matched depth-sign preferences ({"}congruent{"} cells) whereas the remaining 44{\%} of neurons prefer near depth from motion parallax and far depth from disparity, or vice versa ({"}opposite{"} cells). For congruent cells, depth-sign selectivity increases when disparity cues are added to motion parallax, but this enhancement does not occur for opposite cells. This suggests that congruent cells might contribute to perceptual integration of depth cues. We also found that neurons are clustered in MT according to their depth tuning based on motion parallax, similar to the known clustering ofMTneurons for binocular disparity. Together, these findings suggest that areaMTis involved in constructing a representation of 3D scene structure that takes advantage of multiple depth cues available to mobile observers.",
author = "Nadler, {Jacob W.} and Daniel Barbash and Kim, {Hyung Goo R.} and Swati Shimpi and Dora Angelaki and DeAngelis, {Gregory C.}",
year = "2013",
month = "8",
day = "30",
doi = "10.1523/JNEUROSCI.0251-13.2013",
language = "English (US)",
volume = "33",
pages = "14061--14074",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "35",

}

TY - JOUR

T1 - Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT

AU - Nadler, Jacob W.

AU - Barbash, Daniel

AU - Kim, Hyung Goo R.

AU - Shimpi, Swati

AU - Angelaki, Dora

AU - DeAngelis, Gregory C.

PY - 2013/8/30

Y1 - 2013/8/30

N2 - Perception of depth is based on a variety of cues, with binocular disparity and motion parallax generally providing more precise depth information than pictorial cues. Much is known about how neurons in visual cortex represent depth from binocular disparity or motion parallax, but little is known about the joint neural representation of these depth cues. We recently described neurons in the middle temporal (MT) area that signal depth sign (near vs far) from motion parallax; here,weexamine whether andhowthese neurons also signal depth from binocular disparity.Wefind that mostMTneurons in rhesus monkeys (Macaca Mulatta) are selective for depth sign based on both disparity and motion parallax cues. However, the depth-sign preferences (near or far) are not always aligned: 56% of MT neurons have matched depth-sign preferences ("congruent" cells) whereas the remaining 44% of neurons prefer near depth from motion parallax and far depth from disparity, or vice versa ("opposite" cells). For congruent cells, depth-sign selectivity increases when disparity cues are added to motion parallax, but this enhancement does not occur for opposite cells. This suggests that congruent cells might contribute to perceptual integration of depth cues. We also found that neurons are clustered in MT according to their depth tuning based on motion parallax, similar to the known clustering ofMTneurons for binocular disparity. Together, these findings suggest that areaMTis involved in constructing a representation of 3D scene structure that takes advantage of multiple depth cues available to mobile observers.

AB - Perception of depth is based on a variety of cues, with binocular disparity and motion parallax generally providing more precise depth information than pictorial cues. Much is known about how neurons in visual cortex represent depth from binocular disparity or motion parallax, but little is known about the joint neural representation of these depth cues. We recently described neurons in the middle temporal (MT) area that signal depth sign (near vs far) from motion parallax; here,weexamine whether andhowthese neurons also signal depth from binocular disparity.Wefind that mostMTneurons in rhesus monkeys (Macaca Mulatta) are selective for depth sign based on both disparity and motion parallax cues. However, the depth-sign preferences (near or far) are not always aligned: 56% of MT neurons have matched depth-sign preferences ("congruent" cells) whereas the remaining 44% of neurons prefer near depth from motion parallax and far depth from disparity, or vice versa ("opposite" cells). For congruent cells, depth-sign selectivity increases when disparity cues are added to motion parallax, but this enhancement does not occur for opposite cells. This suggests that congruent cells might contribute to perceptual integration of depth cues. We also found that neurons are clustered in MT according to their depth tuning based on motion parallax, similar to the known clustering ofMTneurons for binocular disparity. Together, these findings suggest that areaMTis involved in constructing a representation of 3D scene structure that takes advantage of multiple depth cues available to mobile observers.

UR - http://www.scopus.com/inward/record.url?scp=84883024457&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84883024457&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.0251-13.2013

DO - 10.1523/JNEUROSCI.0251-13.2013

M3 - Article

VL - 33

SP - 14061

EP - 14074

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 35

ER -