Surface color perception as an inverse problem in biological vision

Laurence T. Maloney, Huseyin Boyaci, Katja Doerschner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The spectral power distribution (SPD) of the light reflected from a matte surface patch in a three-dimensional complex scene depends not only on the surface reflectance of the patch but also on the SPD of the light incident on the patch. When there are multiple light sources in the scene that differ in location, SPD, and spatial extent, the SPD of the incident light depends on the location and the orientation of the patch. Recently, we have examined how well observers can recover surface color in rendered, binocularly-viewed scenes with more than one light source. To recover intrinsic surface color, observers must solve an inverse problem, effectively estimating the light sources present in the scene and the SPD of the light from each that reaches the surface patch. We will formulate the forward and inverse problems for surface color perception in three-dimensional scenes and present experimental evidence that human observers can solve such problems. We will also discuss how human observers estimate the spatial distribution of light sources and their chromaticities from the scene itself and how they might represent it.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsC.A. Bouman, E.L. Miller
Pages15-26
Number of pages12
Volume5674
DOIs
StatePublished - 2005
EventProceedings of SPIE-IS and T Electronic Imaging - Computational Imaging III - San Jose, CA, United States
Duration: Jan 17 2005Jan 18 2005

Other

OtherProceedings of SPIE-IS and T Electronic Imaging - Computational Imaging III
CountryUnited States
CitySan Jose, CA
Period1/17/051/18/05

Fingerprint

color vision
Inverse problems
Color
Light sources
light sources
color
Spatial distribution
spatial distribution
estimating
reflectance
estimates

Keywords

  • Inter-reflection
  • Spherical harmonics
  • Surface color perception
  • Surface lightness perception

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Maloney, L. T., Boyaci, H., & Doerschner, K. (2005). Surface color perception as an inverse problem in biological vision. In C. A. Bouman, & E. L. Miller (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 5674, pp. 15-26). [21] https://doi.org/10.1117/12.598463

Surface color perception as an inverse problem in biological vision. / Maloney, Laurence T.; Boyaci, Huseyin; Doerschner, Katja.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / C.A. Bouman; E.L. Miller. Vol. 5674 2005. p. 15-26 21.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Maloney, LT, Boyaci, H & Doerschner, K 2005, Surface color perception as an inverse problem in biological vision. in CA Bouman & EL Miller (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 5674, 21, pp. 15-26, Proceedings of SPIE-IS and T Electronic Imaging - Computational Imaging III, San Jose, CA, United States, 1/17/05. https://doi.org/10.1117/12.598463
Maloney LT, Boyaci H, Doerschner K. Surface color perception as an inverse problem in biological vision. In Bouman CA, Miller EL, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 5674. 2005. p. 15-26. 21 https://doi.org/10.1117/12.598463
Maloney, Laurence T. ; Boyaci, Huseyin ; Doerschner, Katja. / Surface color perception as an inverse problem in biological vision. Proceedings of SPIE - The International Society for Optical Engineering. editor / C.A. Bouman ; E.L. Miller. Vol. 5674 2005. pp. 15-26
@inproceedings{1953e4b6c3a34ffeacba5ab9cccf193e,
title = "Surface color perception as an inverse problem in biological vision",
abstract = "The spectral power distribution (SPD) of the light reflected from a matte surface patch in a three-dimensional complex scene depends not only on the surface reflectance of the patch but also on the SPD of the light incident on the patch. When there are multiple light sources in the scene that differ in location, SPD, and spatial extent, the SPD of the incident light depends on the location and the orientation of the patch. Recently, we have examined how well observers can recover surface color in rendered, binocularly-viewed scenes with more than one light source. To recover intrinsic surface color, observers must solve an inverse problem, effectively estimating the light sources present in the scene and the SPD of the light from each that reaches the surface patch. We will formulate the forward and inverse problems for surface color perception in three-dimensional scenes and present experimental evidence that human observers can solve such problems. We will also discuss how human observers estimate the spatial distribution of light sources and their chromaticities from the scene itself and how they might represent it.",
keywords = "Inter-reflection, Spherical harmonics, Surface color perception, Surface lightness perception",
author = "Maloney, {Laurence T.} and Huseyin Boyaci and Katja Doerschner",
year = "2005",
doi = "10.1117/12.598463",
language = "English (US)",
volume = "5674",
pages = "15--26",
editor = "C.A. Bouman and E.L. Miller",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Surface color perception as an inverse problem in biological vision

AU - Maloney, Laurence T.

AU - Boyaci, Huseyin

AU - Doerschner, Katja

PY - 2005

Y1 - 2005

N2 - The spectral power distribution (SPD) of the light reflected from a matte surface patch in a three-dimensional complex scene depends not only on the surface reflectance of the patch but also on the SPD of the light incident on the patch. When there are multiple light sources in the scene that differ in location, SPD, and spatial extent, the SPD of the incident light depends on the location and the orientation of the patch. Recently, we have examined how well observers can recover surface color in rendered, binocularly-viewed scenes with more than one light source. To recover intrinsic surface color, observers must solve an inverse problem, effectively estimating the light sources present in the scene and the SPD of the light from each that reaches the surface patch. We will formulate the forward and inverse problems for surface color perception in three-dimensional scenes and present experimental evidence that human observers can solve such problems. We will also discuss how human observers estimate the spatial distribution of light sources and their chromaticities from the scene itself and how they might represent it.

AB - The spectral power distribution (SPD) of the light reflected from a matte surface patch in a three-dimensional complex scene depends not only on the surface reflectance of the patch but also on the SPD of the light incident on the patch. When there are multiple light sources in the scene that differ in location, SPD, and spatial extent, the SPD of the incident light depends on the location and the orientation of the patch. Recently, we have examined how well observers can recover surface color in rendered, binocularly-viewed scenes with more than one light source. To recover intrinsic surface color, observers must solve an inverse problem, effectively estimating the light sources present in the scene and the SPD of the light from each that reaches the surface patch. We will formulate the forward and inverse problems for surface color perception in three-dimensional scenes and present experimental evidence that human observers can solve such problems. We will also discuss how human observers estimate the spatial distribution of light sources and their chromaticities from the scene itself and how they might represent it.

KW - Inter-reflection

KW - Spherical harmonics

KW - Surface color perception

KW - Surface lightness perception

UR - http://www.scopus.com/inward/record.url?scp=21944435558&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=21944435558&partnerID=8YFLogxK

U2 - 10.1117/12.598463

DO - 10.1117/12.598463

M3 - Conference contribution

VL - 5674

SP - 15

EP - 26

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - Bouman, C.A.

A2 - Miller, E.L.

ER -