Optimal multisensory decision-making in a reaction-time task

Jan Drugowitsch, Gregory C. Deangelis, Eliana M. Klier, Dora Angelaki, Alexandre Pouget

Research output: Contribution to journalArticle

Abstract

Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.

Original languageEnglish (US)
Article numbere03005
JournaleLife
Volume2014
Issue number3
DOIs
StatePublished - Jun 14 2014

Fingerprint

Reaction Time
Decision Making
Decision making
Animals
Cues

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Immunology and Microbiology(all)
  • Medicine(all)
  • Neuroscience(all)

Cite this

Drugowitsch, J., Deangelis, G. C., Klier, E. M., Angelaki, D., & Pouget, A. (2014). Optimal multisensory decision-making in a reaction-time task. eLife, 2014(3), [e03005]. https://doi.org/10.7554/eLife.03005.001

Optimal multisensory decision-making in a reaction-time task. / Drugowitsch, Jan; Deangelis, Gregory C.; Klier, Eliana M.; Angelaki, Dora; Pouget, Alexandre.

In: eLife, Vol. 2014, No. 3, e03005, 14.06.2014.

Research output: Contribution to journalArticle

Drugowitsch, J, Deangelis, GC, Klier, EM, Angelaki, D & Pouget, A 2014, 'Optimal multisensory decision-making in a reaction-time task', eLife, vol. 2014, no. 3, e03005. https://doi.org/10.7554/eLife.03005.001
Drugowitsch J, Deangelis GC, Klier EM, Angelaki D, Pouget A. Optimal multisensory decision-making in a reaction-time task. eLife. 2014 Jun 14;2014(3). e03005. https://doi.org/10.7554/eLife.03005.001
Drugowitsch, Jan ; Deangelis, Gregory C. ; Klier, Eliana M. ; Angelaki, Dora ; Pouget, Alexandre. / Optimal multisensory decision-making in a reaction-time task. In: eLife. 2014 ; Vol. 2014, No. 3.
@article{e18e9fdbe95d423d8bdda19cc8cbef55,
title = "Optimal multisensory decision-making in a reaction-time task",
abstract = "Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.",
author = "Jan Drugowitsch and Deangelis, {Gregory C.} and Klier, {Eliana M.} and Dora Angelaki and Alexandre Pouget",
year = "2014",
month = "6",
day = "14",
doi = "10.7554/eLife.03005.001",
language = "English (US)",
volume = "2014",
journal = "eLife",
issn = "2050-084X",
publisher = "eLife Sciences Publications",
number = "3",

}

TY - JOUR

T1 - Optimal multisensory decision-making in a reaction-time task

AU - Drugowitsch, Jan

AU - Deangelis, Gregory C.

AU - Klier, Eliana M.

AU - Angelaki, Dora

AU - Pouget, Alexandre

PY - 2014/6/14

Y1 - 2014/6/14

N2 - Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.

AB - Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.

UR - http://www.scopus.com/inward/record.url?scp=84905046212&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905046212&partnerID=8YFLogxK

U2 - 10.7554/eLife.03005.001

DO - 10.7554/eLife.03005.001

M3 - Article

VL - 2014

JO - eLife

JF - eLife

SN - 2050-084X

IS - 3

M1 - e03005

ER -