An fMRI study of reward-related probability learning

M. R. Delgado, M. M. Miller, S. Inati, E. A. Phelps

Research output: Contribution to journalArticle

Abstract

The human striatum has been implicated in processing reward-related information. More recently, activity in the striatum, particularly the caudate nucleus, has been observed when a contingency between behavior and reward exists, suggesting a role for the caudate in reinforcement-based learning. Using a gambling paradigm, in which affective feedback (reward and punishment) followed simple, random guesses on a trial by trial basis, we sought to investigate the role of the caudate nucleus as reward-related learning progressed. Participants were instructed to make a guess regarding the value of a presented card (if the value of the card was higher or lower than 5). They were told that five different cues would be presented prior to making a guess, and that each cue indicated the probability that the card would be high or low. The goal was to learn the contingencies and maximize the reward attained. Accuracy, as measured by participant's choices, improved throughout the experiment for cues that strongly predicted reward, while no change was observed for unpredictable cues. Event-related fMRI revealed that activity in the caudate nucleus was more robust during the early phases of learning, irrespective of contingencies, suggesting involvement of this region during the initial stages of trial and error learning. Further, the reward feedback signal in the caudate nucleus for well-learned cues decreased as learning progressed, suggesting an evolving adaptation of reward feedback expectancy as a behavior-outcome contingency becomes more predictable.

Original languageEnglish (US)
Pages (from-to)862-873
Number of pages12
JournalNeuroImage
Volume24
Issue number3
DOIs
StatePublished - Feb 1 2005

Fingerprint

Probability Learning
Reward
Magnetic Resonance Imaging
Caudate Nucleus
Cues
Learning
Gambling
Punishment

Keywords

  • Basal Ganglia
  • Caudate
  • Emotion
  • Feedback
  • Incentive
  • Punishment
  • Reward
  • Striatum
  • Valence

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Neurology

Cite this

An fMRI study of reward-related probability learning. / Delgado, M. R.; Miller, M. M.; Inati, S.; Phelps, E. A.

In: NeuroImage, Vol. 24, No. 3, 01.02.2005, p. 862-873.

Research output: Contribution to journalArticle

Delgado, M. R. ; Miller, M. M. ; Inati, S. ; Phelps, E. A. / An fMRI study of reward-related probability learning. In: NeuroImage. 2005 ; Vol. 24, No. 3. pp. 862-873.
@article{2c6512ebd6f94508982b408c5daa5311,
title = "An fMRI study of reward-related probability learning",
abstract = "The human striatum has been implicated in processing reward-related information. More recently, activity in the striatum, particularly the caudate nucleus, has been observed when a contingency between behavior and reward exists, suggesting a role for the caudate in reinforcement-based learning. Using a gambling paradigm, in which affective feedback (reward and punishment) followed simple, random guesses on a trial by trial basis, we sought to investigate the role of the caudate nucleus as reward-related learning progressed. Participants were instructed to make a guess regarding the value of a presented card (if the value of the card was higher or lower than 5). They were told that five different cues would be presented prior to making a guess, and that each cue indicated the probability that the card would be high or low. The goal was to learn the contingencies and maximize the reward attained. Accuracy, as measured by participant's choices, improved throughout the experiment for cues that strongly predicted reward, while no change was observed for unpredictable cues. Event-related fMRI revealed that activity in the caudate nucleus was more robust during the early phases of learning, irrespective of contingencies, suggesting involvement of this region during the initial stages of trial and error learning. Further, the reward feedback signal in the caudate nucleus for well-learned cues decreased as learning progressed, suggesting an evolving adaptation of reward feedback expectancy as a behavior-outcome contingency becomes more predictable.",
keywords = "Basal Ganglia, Caudate, Emotion, Feedback, Incentive, Punishment, Reward, Striatum, Valence",
author = "Delgado, {M. R.} and Miller, {M. M.} and S. Inati and Phelps, {E. A.}",
year = "2005",
month = "2",
day = "1",
doi = "10.1016/j.neuroimage.2004.10.002",
language = "English (US)",
volume = "24",
pages = "862--873",
journal = "NeuroImage",
issn = "1053-8119",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - An fMRI study of reward-related probability learning

AU - Delgado, M. R.

AU - Miller, M. M.

AU - Inati, S.

AU - Phelps, E. A.

PY - 2005/2/1

Y1 - 2005/2/1

N2 - The human striatum has been implicated in processing reward-related information. More recently, activity in the striatum, particularly the caudate nucleus, has been observed when a contingency between behavior and reward exists, suggesting a role for the caudate in reinforcement-based learning. Using a gambling paradigm, in which affective feedback (reward and punishment) followed simple, random guesses on a trial by trial basis, we sought to investigate the role of the caudate nucleus as reward-related learning progressed. Participants were instructed to make a guess regarding the value of a presented card (if the value of the card was higher or lower than 5). They were told that five different cues would be presented prior to making a guess, and that each cue indicated the probability that the card would be high or low. The goal was to learn the contingencies and maximize the reward attained. Accuracy, as measured by participant's choices, improved throughout the experiment for cues that strongly predicted reward, while no change was observed for unpredictable cues. Event-related fMRI revealed that activity in the caudate nucleus was more robust during the early phases of learning, irrespective of contingencies, suggesting involvement of this region during the initial stages of trial and error learning. Further, the reward feedback signal in the caudate nucleus for well-learned cues decreased as learning progressed, suggesting an evolving adaptation of reward feedback expectancy as a behavior-outcome contingency becomes more predictable.

AB - The human striatum has been implicated in processing reward-related information. More recently, activity in the striatum, particularly the caudate nucleus, has been observed when a contingency between behavior and reward exists, suggesting a role for the caudate in reinforcement-based learning. Using a gambling paradigm, in which affective feedback (reward and punishment) followed simple, random guesses on a trial by trial basis, we sought to investigate the role of the caudate nucleus as reward-related learning progressed. Participants were instructed to make a guess regarding the value of a presented card (if the value of the card was higher or lower than 5). They were told that five different cues would be presented prior to making a guess, and that each cue indicated the probability that the card would be high or low. The goal was to learn the contingencies and maximize the reward attained. Accuracy, as measured by participant's choices, improved throughout the experiment for cues that strongly predicted reward, while no change was observed for unpredictable cues. Event-related fMRI revealed that activity in the caudate nucleus was more robust during the early phases of learning, irrespective of contingencies, suggesting involvement of this region during the initial stages of trial and error learning. Further, the reward feedback signal in the caudate nucleus for well-learned cues decreased as learning progressed, suggesting an evolving adaptation of reward feedback expectancy as a behavior-outcome contingency becomes more predictable.

KW - Basal Ganglia

KW - Caudate

KW - Emotion

KW - Feedback

KW - Incentive

KW - Punishment

KW - Reward

KW - Striatum

KW - Valence

UR - http://www.scopus.com/inward/record.url?scp=11844296013&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=11844296013&partnerID=8YFLogxK

U2 - 10.1016/j.neuroimage.2004.10.002

DO - 10.1016/j.neuroimage.2004.10.002

M3 - Article

VL - 24

SP - 862

EP - 873

JO - NeuroImage

JF - NeuroImage

SN - 1053-8119

IS - 3

ER -