Navigating through abstract decision spaces

Evaluating the role of state generalization in a dynamic decision-making task

A. Ross Otto, Todd Gureckis, Arthur B. Markman, Bradley C. Love

Research output: Contribution to journalArticle

Abstract

Research on dynamic decision-making tasks, in which the payoffs associated with each choice vary with participants' recent choice history, shows that humans have difficulty making long-term optimal choices in the presence of attractive immediate rewards. However, a number of recent studies have shown that simple cues providing information about the underlying state of the task environment may facilitate optimal responding. In this study, we examined the mechanism by which this state knowledge influences choice behavior. We examined the possibility that participants use state information in conjunction with changing payoffs to extrapolate payoffs in future states. We found support for this hypothesis in an experiment in which generalizations based on this state information worked to the benefit or detriment of task performance, depending on the task's payoff structure.

Original languageEnglish (US)
Pages (from-to)957-963
Number of pages7
JournalPsychonomic Bulletin and Review
Volume16
Issue number5
DOIs
StatePublished - Oct 2009

Fingerprint

Choice Behavior
Task Performance and Analysis
Reward
Cues
Decision Making
History
Research
Generalization (Psychology)

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology

Cite this

Navigating through abstract decision spaces : Evaluating the role of state generalization in a dynamic decision-making task. / Otto, A. Ross; Gureckis, Todd; Markman, Arthur B.; Love, Bradley C.

In: Psychonomic Bulletin and Review, Vol. 16, No. 5, 10.2009, p. 957-963.

Research output: Contribution to journalArticle

Otto, A. Ross ; Gureckis, Todd ; Markman, Arthur B. ; Love, Bradley C. / Navigating through abstract decision spaces : Evaluating the role of state generalization in a dynamic decision-making task. In: Psychonomic Bulletin and Review. 2009 ; Vol. 16, No. 5. pp. 957-963.
@article{85d2230ac99d4cd9abe50423d28b86ea,
title = "Navigating through abstract decision spaces: Evaluating the role of state generalization in a dynamic decision-making task",
abstract = "Research on dynamic decision-making tasks, in which the payoffs associated with each choice vary with participants' recent choice history, shows that humans have difficulty making long-term optimal choices in the presence of attractive immediate rewards. However, a number of recent studies have shown that simple cues providing information about the underlying state of the task environment may facilitate optimal responding. In this study, we examined the mechanism by which this state knowledge influences choice behavior. We examined the possibility that participants use state information in conjunction with changing payoffs to extrapolate payoffs in future states. We found support for this hypothesis in an experiment in which generalizations based on this state information worked to the benefit or detriment of task performance, depending on the task's payoff structure.",
author = "Otto, {A. Ross} and Todd Gureckis and Markman, {Arthur B.} and Love, {Bradley C.}",
year = "2009",
month = "10",
doi = "10.3758/PBR.16.5.957",
language = "English (US)",
volume = "16",
pages = "957--963",
journal = "Psychonomic Bulletin and Review",
issn = "1069-9384",
publisher = "Springer New York",
number = "5",

}

TY - JOUR

T1 - Navigating through abstract decision spaces

T2 - Evaluating the role of state generalization in a dynamic decision-making task

AU - Otto, A. Ross

AU - Gureckis, Todd

AU - Markman, Arthur B.

AU - Love, Bradley C.

PY - 2009/10

Y1 - 2009/10

N2 - Research on dynamic decision-making tasks, in which the payoffs associated with each choice vary with participants' recent choice history, shows that humans have difficulty making long-term optimal choices in the presence of attractive immediate rewards. However, a number of recent studies have shown that simple cues providing information about the underlying state of the task environment may facilitate optimal responding. In this study, we examined the mechanism by which this state knowledge influences choice behavior. We examined the possibility that participants use state information in conjunction with changing payoffs to extrapolate payoffs in future states. We found support for this hypothesis in an experiment in which generalizations based on this state information worked to the benefit or detriment of task performance, depending on the task's payoff structure.

AB - Research on dynamic decision-making tasks, in which the payoffs associated with each choice vary with participants' recent choice history, shows that humans have difficulty making long-term optimal choices in the presence of attractive immediate rewards. However, a number of recent studies have shown that simple cues providing information about the underlying state of the task environment may facilitate optimal responding. In this study, we examined the mechanism by which this state knowledge influences choice behavior. We examined the possibility that participants use state information in conjunction with changing payoffs to extrapolate payoffs in future states. We found support for this hypothesis in an experiment in which generalizations based on this state information worked to the benefit or detriment of task performance, depending on the task's payoff structure.

UR - http://www.scopus.com/inward/record.url?scp=74849131215&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=74849131215&partnerID=8YFLogxK

U2 - 10.3758/PBR.16.5.957

DO - 10.3758/PBR.16.5.957

M3 - Article

VL - 16

SP - 957

EP - 963

JO - Psychonomic Bulletin and Review

JF - Psychonomic Bulletin and Review

SN - 1069-9384

IS - 5

ER -