Matching and retrieval based on the vocabulary and grammar of color patterns

Aleksandra Mojsilović, Jelena Kovacevic, Jianying Hu, Robert J. Safranek, Kicha Ganapathy

Research output: Contribution to journalArticle

Abstract

We propose a perceptually based system for pattern retrieval and matching. There is a need for such an 'intelligent' retrieval system in applications such as digital museums and libraries, design, architecture, and digital stock photography. The central idea of the work is that similarity judgment has to be modeled along perceptual dimensions. Hence, we detect basic visual categories that people use in judgment of similarity, and design a computational model that accepts patterns as input, and depending on the query, produces a set of choices that follow human behavior in pattern matching. There are two major research aspects to our work. The first one addresses the issue of how humans perceive and measure similarity within the domain of color patterns. To understand and describe this mechanism we performed a subjective experiment. The experiment yielded five perceptual criteria used in comparison between color patterns (vocabulary), as well as a set of rules governing the use of these criteria in similarity judgment (grammar). The second research aspect is the actual implementation of the perceptual criteria and rules in an image retrieval system. Following the processing typical for human vision, we design a system to: 1) extract perceptual features from the vocabulary and 2) perform the comparison between the patterns according to the grammar rules. The modeling of human perception of color patterns is new - starting with a new color codebook design, compact color representation, and texture description through multiple scale edge distribution along different directions. Moreover, we propose new color and texture distance functions that correlate with human performance. The performance of the system is illustrated with numerous examples from image databases from different application domains.

Original languageEnglish (US)
Pages (from-to)38-54
Number of pages17
JournalIEEE Transactions on Image Processing
Volume9
Issue number1
DOIs
StatePublished - Jan 1 2000

Fingerprint

Vocabulary
Color
Color Perception
Digital Libraries
Textures
Museums
Photography
Research
Pattern matching
Image retrieval
Databases
Experiments
Processing

ASJC Scopus subject areas

  • Software
  • Medicine(all)
  • Computer Graphics and Computer-Aided Design

Cite this

Matching and retrieval based on the vocabulary and grammar of color patterns. / Mojsilović, Aleksandra; Kovacevic, Jelena; Hu, Jianying; Safranek, Robert J.; Ganapathy, Kicha.

In: IEEE Transactions on Image Processing, Vol. 9, No. 1, 01.01.2000, p. 38-54.

Research output: Contribution to journalArticle

Mojsilović, Aleksandra ; Kovacevic, Jelena ; Hu, Jianying ; Safranek, Robert J. ; Ganapathy, Kicha. / Matching and retrieval based on the vocabulary and grammar of color patterns. In: IEEE Transactions on Image Processing. 2000 ; Vol. 9, No. 1. pp. 38-54.
@article{d0e41bc24a924a5f98a148a6ed356443,
title = "Matching and retrieval based on the vocabulary and grammar of color patterns",
abstract = "We propose a perceptually based system for pattern retrieval and matching. There is a need for such an 'intelligent' retrieval system in applications such as digital museums and libraries, design, architecture, and digital stock photography. The central idea of the work is that similarity judgment has to be modeled along perceptual dimensions. Hence, we detect basic visual categories that people use in judgment of similarity, and design a computational model that accepts patterns as input, and depending on the query, produces a set of choices that follow human behavior in pattern matching. There are two major research aspects to our work. The first one addresses the issue of how humans perceive and measure similarity within the domain of color patterns. To understand and describe this mechanism we performed a subjective experiment. The experiment yielded five perceptual criteria used in comparison between color patterns (vocabulary), as well as a set of rules governing the use of these criteria in similarity judgment (grammar). The second research aspect is the actual implementation of the perceptual criteria and rules in an image retrieval system. Following the processing typical for human vision, we design a system to: 1) extract perceptual features from the vocabulary and 2) perform the comparison between the patterns according to the grammar rules. The modeling of human perception of color patterns is new - starting with a new color codebook design, compact color representation, and texture description through multiple scale edge distribution along different directions. Moreover, we propose new color and texture distance functions that correlate with human performance. The performance of the system is illustrated with numerous examples from image databases from different application domains.",
author = "Aleksandra Mojsilović and Jelena Kovacevic and Jianying Hu and Safranek, {Robert J.} and Kicha Ganapathy",
year = "2000",
month = "1",
day = "1",
doi = "10.1109/83.817597",
language = "English (US)",
volume = "9",
pages = "38--54",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Matching and retrieval based on the vocabulary and grammar of color patterns

AU - Mojsilović, Aleksandra

AU - Kovacevic, Jelena

AU - Hu, Jianying

AU - Safranek, Robert J.

AU - Ganapathy, Kicha

PY - 2000/1/1

Y1 - 2000/1/1

N2 - We propose a perceptually based system for pattern retrieval and matching. There is a need for such an 'intelligent' retrieval system in applications such as digital museums and libraries, design, architecture, and digital stock photography. The central idea of the work is that similarity judgment has to be modeled along perceptual dimensions. Hence, we detect basic visual categories that people use in judgment of similarity, and design a computational model that accepts patterns as input, and depending on the query, produces a set of choices that follow human behavior in pattern matching. There are two major research aspects to our work. The first one addresses the issue of how humans perceive and measure similarity within the domain of color patterns. To understand and describe this mechanism we performed a subjective experiment. The experiment yielded five perceptual criteria used in comparison between color patterns (vocabulary), as well as a set of rules governing the use of these criteria in similarity judgment (grammar). The second research aspect is the actual implementation of the perceptual criteria and rules in an image retrieval system. Following the processing typical for human vision, we design a system to: 1) extract perceptual features from the vocabulary and 2) perform the comparison between the patterns according to the grammar rules. The modeling of human perception of color patterns is new - starting with a new color codebook design, compact color representation, and texture description through multiple scale edge distribution along different directions. Moreover, we propose new color and texture distance functions that correlate with human performance. The performance of the system is illustrated with numerous examples from image databases from different application domains.

AB - We propose a perceptually based system for pattern retrieval and matching. There is a need for such an 'intelligent' retrieval system in applications such as digital museums and libraries, design, architecture, and digital stock photography. The central idea of the work is that similarity judgment has to be modeled along perceptual dimensions. Hence, we detect basic visual categories that people use in judgment of similarity, and design a computational model that accepts patterns as input, and depending on the query, produces a set of choices that follow human behavior in pattern matching. There are two major research aspects to our work. The first one addresses the issue of how humans perceive and measure similarity within the domain of color patterns. To understand and describe this mechanism we performed a subjective experiment. The experiment yielded five perceptual criteria used in comparison between color patterns (vocabulary), as well as a set of rules governing the use of these criteria in similarity judgment (grammar). The second research aspect is the actual implementation of the perceptual criteria and rules in an image retrieval system. Following the processing typical for human vision, we design a system to: 1) extract perceptual features from the vocabulary and 2) perform the comparison between the patterns according to the grammar rules. The modeling of human perception of color patterns is new - starting with a new color codebook design, compact color representation, and texture description through multiple scale edge distribution along different directions. Moreover, we propose new color and texture distance functions that correlate with human performance. The performance of the system is illustrated with numerous examples from image databases from different application domains.

UR - http://www.scopus.com/inward/record.url?scp=0033895099&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033895099&partnerID=8YFLogxK

U2 - 10.1109/83.817597

DO - 10.1109/83.817597

M3 - Article

VL - 9

SP - 38

EP - 54

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 1

ER -