Visual decisions in the presence of measurement and stimulus correlations

Manisha Bhardwaj, Samuel Carroll, Wei Ji Ma, Krešimir Josić

Research output: Contribution to journalArticle

Abstract

Humans and other animals base their decisions on noisy sensory input. Much work has been devoted to understanding the computations that underlie such decisions. The problem has been studied in a variety of tasks and with stimuli of differing complexity. However, how the statistical structure of stimuli, along with perceptual measurement noise, affects perceptual judgments is not well understood. Here we examine how correlations between the components of a stimulus-stimulus correlations-together with correlations in sensory noise, affect decision making. As an example, we consider the task of detecting the presence of a single or multiple targets among distractors. We assume that both the distractors and the observer's measurements of the stimuli are correlated. The computations of an optimal observer in this task are nontrivial yet can be analyzed and understood intuitively. We find that when distractors are strongly correlated, measurement correlations can have a strong impact on performance. When distractor correlations are weak, measurement correlations have little impact unless the number of stimuli is large. Correlations in neural responses to structured stimuli can therefore have a strong impact on perceptual judgments.

Original languageEnglish (US)
Pages (from-to)2318-2353
Number of pages36
JournalNeural Computation
Volume27
Issue number11
DOIs
StatePublished - Nov 1 2015

Fingerprint

Noise
Decision Making
Stimulus
Distractor

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Arts and Humanities (miscellaneous)

Cite this

Visual decisions in the presence of measurement and stimulus correlations. / Bhardwaj, Manisha; Carroll, Samuel; Ma, Wei Ji; Josić, Krešimir.

In: Neural Computation, Vol. 27, No. 11, 01.11.2015, p. 2318-2353.

Research output: Contribution to journalArticle

Bhardwaj, Manisha ; Carroll, Samuel ; Ma, Wei Ji ; Josić, Krešimir. / Visual decisions in the presence of measurement and stimulus correlations. In: Neural Computation. 2015 ; Vol. 27, No. 11. pp. 2318-2353.
@article{93fee6405b18455e834cd334884bccb7,
title = "Visual decisions in the presence of measurement and stimulus correlations",
abstract = "Humans and other animals base their decisions on noisy sensory input. Much work has been devoted to understanding the computations that underlie such decisions. The problem has been studied in a variety of tasks and with stimuli of differing complexity. However, how the statistical structure of stimuli, along with perceptual measurement noise, affects perceptual judgments is not well understood. Here we examine how correlations between the components of a stimulus-stimulus correlations-together with correlations in sensory noise, affect decision making. As an example, we consider the task of detecting the presence of a single or multiple targets among distractors. We assume that both the distractors and the observer's measurements of the stimuli are correlated. The computations of an optimal observer in this task are nontrivial yet can be analyzed and understood intuitively. We find that when distractors are strongly correlated, measurement correlations can have a strong impact on performance. When distractor correlations are weak, measurement correlations have little impact unless the number of stimuli is large. Correlations in neural responses to structured stimuli can therefore have a strong impact on perceptual judgments.",
author = "Manisha Bhardwaj and Samuel Carroll and Ma, {Wei Ji} and Krešimir Josić",
year = "2015",
month = "11",
day = "1",
doi = "10.1162/NECO_a_00778",
language = "English (US)",
volume = "27",
pages = "2318--2353",
journal = "Neural Computation",
issn = "0899-7667",
publisher = "MIT Press Journals",
number = "11",

}

TY - JOUR

T1 - Visual decisions in the presence of measurement and stimulus correlations

AU - Bhardwaj, Manisha

AU - Carroll, Samuel

AU - Ma, Wei Ji

AU - Josić, Krešimir

PY - 2015/11/1

Y1 - 2015/11/1

N2 - Humans and other animals base their decisions on noisy sensory input. Much work has been devoted to understanding the computations that underlie such decisions. The problem has been studied in a variety of tasks and with stimuli of differing complexity. However, how the statistical structure of stimuli, along with perceptual measurement noise, affects perceptual judgments is not well understood. Here we examine how correlations between the components of a stimulus-stimulus correlations-together with correlations in sensory noise, affect decision making. As an example, we consider the task of detecting the presence of a single or multiple targets among distractors. We assume that both the distractors and the observer's measurements of the stimuli are correlated. The computations of an optimal observer in this task are nontrivial yet can be analyzed and understood intuitively. We find that when distractors are strongly correlated, measurement correlations can have a strong impact on performance. When distractor correlations are weak, measurement correlations have little impact unless the number of stimuli is large. Correlations in neural responses to structured stimuli can therefore have a strong impact on perceptual judgments.

AB - Humans and other animals base their decisions on noisy sensory input. Much work has been devoted to understanding the computations that underlie such decisions. The problem has been studied in a variety of tasks and with stimuli of differing complexity. However, how the statistical structure of stimuli, along with perceptual measurement noise, affects perceptual judgments is not well understood. Here we examine how correlations between the components of a stimulus-stimulus correlations-together with correlations in sensory noise, affect decision making. As an example, we consider the task of detecting the presence of a single or multiple targets among distractors. We assume that both the distractors and the observer's measurements of the stimuli are correlated. The computations of an optimal observer in this task are nontrivial yet can be analyzed and understood intuitively. We find that when distractors are strongly correlated, measurement correlations can have a strong impact on performance. When distractor correlations are weak, measurement correlations have little impact unless the number of stimuli is large. Correlations in neural responses to structured stimuli can therefore have a strong impact on perceptual judgments.

UR - http://www.scopus.com/inward/record.url?scp=84945256401&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84945256401&partnerID=8YFLogxK

U2 - 10.1162/NECO_a_00778

DO - 10.1162/NECO_a_00778

M3 - Article

VL - 27

SP - 2318

EP - 2353

JO - Neural Computation

JF - Neural Computation

SN - 0899-7667

IS - 11

ER -