Perceptual quality assessment of color images using adaptive signal representation

Umesh Rajashekar, Zhou Wang, Eero P. Simoncelli

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Perceptual image distortion measures can play a fundamental role in evaluating and optimizing imaging systems and image processing algorithms. Many existing measures are formulated to represent "just noticeable differences" (JNDs), as measured in psychophysical experiments on human subjects. But some image distortions, such as those arising from small changes in the intensity of the ambient illumination, are far more tolerable to human observers than those that disrupt the spatial structure of intensities and colors. Here, we introduce a framework in which we quantify these perceptual distortions in terms of "just intolerable differences" (JIDs). As in (Wang & Simoncelli, Proc. ICIP 2005), we first construct a set of spatio-chromatic basis functions to approximate (as a first-order Taylor series) a set of "non-structural" distortions that result from changes in lighting/imaging/viewing conditions. These basis functions are defined on local image patches, and are adaptive, in that they are computed as functions of the undistorted reference image. This set is then augmented with a complete basis arising from a linear approximation of the CIELAB color space. Each basis function is weighted by a scale factor to convert it into units corresponding to JIDs. Each patch of the error image is represented using this weighted overcomplete basis, and the overall distortion metric is computed by summing the squared coefficients over all such (overlapping) patches. We implement an example of this metric, incorporating invariance to small changes in the viewing and lighting conditions, and demonstrate that the resulting distortion values are more consistent with human perception than those produced by CIELAB or S-CIELAB.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Human Vision and Electronic Imaging XV
DOIs
StatePublished - Mar 22 2010
EventHuman Vision and Electronic Imaging XV - San Jose, CA, United States
Duration: Jan 18 2010Jan 21 2010

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7527
ISSN (Print)0277-786X

Other

OtherHuman Vision and Electronic Imaging XV
CountryUnited States
CitySan Jose, CA
Period1/18/101/21/10

    Fingerprint

Keywords

  • Adaptive signal decomposition
  • CIELAB
  • Color image quality assessment
  • S-CIELAB

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Rajashekar, U., Wang, Z., & Simoncelli, E. P. (2010). Perceptual quality assessment of color images using adaptive signal representation. In Proceedings of SPIE-IS and T Electronic Imaging - Human Vision and Electronic Imaging XV [75271L] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7527). https://doi.org/10.1117/12.845312