The role of visuohaptic experience in visually perceived depth

Yun Xian Ho, Sascha Serwe, Julia Trommershäuser, Laurence T. Maloney, Michael S. Landy

Research output: Contribution to journalArticle

Abstract

Berkeley suggested that "touch educates vision," that is, haptic input may be used to calibrate visual cues to improve visual estimation of properties of the world. Here, we test whether haptic input may be used to "miseducate" vision, causing observers to rely more heavily on misleading visual cues. Human subjects compared the depth of two cylindrical bumps illuminated by light sources located at different positions relative to the surface. As in previous work using judgments of surface roughness, we find that observers judge bumps to have greater depth when the light source is located eccentric to the surface normal (i.e., when shadows are more salient). Following several sessions of visual judgments of depth, subjects then underwent visuohaptic training in which haptic feedback was artificially correlated with the "pseudocue" of shadow size and artificially decorrelated with disparity and texture. Although there were large individual differences, almost all observers demonstrated integration of haptic cues during visuohaptic training. For some observers, subsequent visual judgments of bump depth were unaffected by the training. However, for 5 of 12 observers, training significantly increased the weight given to pseudocues, causing subsequent visual estimates of shape to be less veridical. We conclude that haptic information can be used to reweight visual cues, putting more weight on misleading pseudocues, even when more trustworthy visual cues are available in the scene.

Original languageEnglish (US)
Pages (from-to)2789-2801
Number of pages13
JournalJournal of Neurophysiology
Volume101
Issue number6
DOIs
StatePublished - Jun 2009

Fingerprint

Cues
Light
Weights and Measures
Touch
Individuality

ASJC Scopus subject areas

  • Physiology
  • Neuroscience(all)

Cite this

The role of visuohaptic experience in visually perceived depth. / Ho, Yun Xian; Serwe, Sascha; Trommershäuser, Julia; Maloney, Laurence T.; Landy, Michael S.

In: Journal of Neurophysiology, Vol. 101, No. 6, 06.2009, p. 2789-2801.

Research output: Contribution to journalArticle

Ho, Yun Xian ; Serwe, Sascha ; Trommershäuser, Julia ; Maloney, Laurence T. ; Landy, Michael S. / The role of visuohaptic experience in visually perceived depth. In: Journal of Neurophysiology. 2009 ; Vol. 101, No. 6. pp. 2789-2801.
@article{59c455bf589b4c90860710ef8aacc89d,
title = "The role of visuohaptic experience in visually perceived depth",
abstract = "Berkeley suggested that {"}touch educates vision,{"} that is, haptic input may be used to calibrate visual cues to improve visual estimation of properties of the world. Here, we test whether haptic input may be used to {"}miseducate{"} vision, causing observers to rely more heavily on misleading visual cues. Human subjects compared the depth of two cylindrical bumps illuminated by light sources located at different positions relative to the surface. As in previous work using judgments of surface roughness, we find that observers judge bumps to have greater depth when the light source is located eccentric to the surface normal (i.e., when shadows are more salient). Following several sessions of visual judgments of depth, subjects then underwent visuohaptic training in which haptic feedback was artificially correlated with the {"}pseudocue{"} of shadow size and artificially decorrelated with disparity and texture. Although there were large individual differences, almost all observers demonstrated integration of haptic cues during visuohaptic training. For some observers, subsequent visual judgments of bump depth were unaffected by the training. However, for 5 of 12 observers, training significantly increased the weight given to pseudocues, causing subsequent visual estimates of shape to be less veridical. We conclude that haptic information can be used to reweight visual cues, putting more weight on misleading pseudocues, even when more trustworthy visual cues are available in the scene.",
author = "Ho, {Yun Xian} and Sascha Serwe and Julia Trommersh{\"a}user and Maloney, {Laurence T.} and Landy, {Michael S.}",
year = "2009",
month = "6",
doi = "10.1152/jn.91129.2008",
language = "English (US)",
volume = "101",
pages = "2789--2801",
journal = "Journal of Neurophysiology",
issn = "0022-3077",
publisher = "American Physiological Society",
number = "6",

}

TY - JOUR

T1 - The role of visuohaptic experience in visually perceived depth

AU - Ho, Yun Xian

AU - Serwe, Sascha

AU - Trommershäuser, Julia

AU - Maloney, Laurence T.

AU - Landy, Michael S.

PY - 2009/6

Y1 - 2009/6

N2 - Berkeley suggested that "touch educates vision," that is, haptic input may be used to calibrate visual cues to improve visual estimation of properties of the world. Here, we test whether haptic input may be used to "miseducate" vision, causing observers to rely more heavily on misleading visual cues. Human subjects compared the depth of two cylindrical bumps illuminated by light sources located at different positions relative to the surface. As in previous work using judgments of surface roughness, we find that observers judge bumps to have greater depth when the light source is located eccentric to the surface normal (i.e., when shadows are more salient). Following several sessions of visual judgments of depth, subjects then underwent visuohaptic training in which haptic feedback was artificially correlated with the "pseudocue" of shadow size and artificially decorrelated with disparity and texture. Although there were large individual differences, almost all observers demonstrated integration of haptic cues during visuohaptic training. For some observers, subsequent visual judgments of bump depth were unaffected by the training. However, for 5 of 12 observers, training significantly increased the weight given to pseudocues, causing subsequent visual estimates of shape to be less veridical. We conclude that haptic information can be used to reweight visual cues, putting more weight on misleading pseudocues, even when more trustworthy visual cues are available in the scene.

AB - Berkeley suggested that "touch educates vision," that is, haptic input may be used to calibrate visual cues to improve visual estimation of properties of the world. Here, we test whether haptic input may be used to "miseducate" vision, causing observers to rely more heavily on misleading visual cues. Human subjects compared the depth of two cylindrical bumps illuminated by light sources located at different positions relative to the surface. As in previous work using judgments of surface roughness, we find that observers judge bumps to have greater depth when the light source is located eccentric to the surface normal (i.e., when shadows are more salient). Following several sessions of visual judgments of depth, subjects then underwent visuohaptic training in which haptic feedback was artificially correlated with the "pseudocue" of shadow size and artificially decorrelated with disparity and texture. Although there were large individual differences, almost all observers demonstrated integration of haptic cues during visuohaptic training. For some observers, subsequent visual judgments of bump depth were unaffected by the training. However, for 5 of 12 observers, training significantly increased the weight given to pseudocues, causing subsequent visual estimates of shape to be less veridical. We conclude that haptic information can be used to reweight visual cues, putting more weight on misleading pseudocues, even when more trustworthy visual cues are available in the scene.

UR - http://www.scopus.com/inward/record.url?scp=66349115963&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=66349115963&partnerID=8YFLogxK

U2 - 10.1152/jn.91129.2008

DO - 10.1152/jn.91129.2008

M3 - Article

VL - 101

SP - 2789

EP - 2801

JO - Journal of Neurophysiology

JF - Journal of Neurophysiology

SN - 0022-3077

IS - 6

ER -