How instructed knowledge modulates the neural systems of reward learning

Jian Li, Mauricio R. Delgado, Elizabeth A. Phelps

Research output: Contribution to journalArticle

Abstract

Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.

Original languageEnglish (US)
Pages (from-to)55-60
Number of pages6
JournalProceedings of the National Academy of Sciences of the United States of America
Volume108
Issue number1
DOIs
StatePublished - Jan 4 2011

Fingerprint

Reward
Learning
Prefrontal Cortex
Oxygen
Nucleus Accumbens
Cues
Decision Making
Theoretical Models
Communication
Economics
Brain
Research
Reinforcement (Psychology)

Keywords

  • Computational modeling
  • Functional MRI
  • Instruction
  • Prediction error
  • Striatum

ASJC Scopus subject areas

  • General

Cite this

How instructed knowledge modulates the neural systems of reward learning. / Li, Jian; Delgado, Mauricio R.; Phelps, Elizabeth A.

In: Proceedings of the National Academy of Sciences of the United States of America, Vol. 108, No. 1, 04.01.2011, p. 55-60.

Research output: Contribution to journalArticle

@article{830a9819c5e844689e4bc622275d4f4d,
title = "How instructed knowledge modulates the neural systems of reward learning",
abstract = "Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.",
keywords = "Computational modeling, Functional MRI, Instruction, Prediction error, Striatum",
author = "Jian Li and Delgado, {Mauricio R.} and Phelps, {Elizabeth A.}",
year = "2011",
month = "1",
day = "4",
doi = "10.1073/pnas.1014938108",
language = "English (US)",
volume = "108",
pages = "55--60",
journal = "Proceedings of the National Academy of Sciences of the United States of America",
issn = "0027-8424",
number = "1",

}

TY - JOUR

T1 - How instructed knowledge modulates the neural systems of reward learning

AU - Li, Jian

AU - Delgado, Mauricio R.

AU - Phelps, Elizabeth A.

PY - 2011/1/4

Y1 - 2011/1/4

N2 - Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.

AB - Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.

KW - Computational modeling

KW - Functional MRI

KW - Instruction

KW - Prediction error

KW - Striatum

UR - http://www.scopus.com/inward/record.url?scp=78651103643&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78651103643&partnerID=8YFLogxK

U2 - 10.1073/pnas.1014938108

DO - 10.1073/pnas.1014938108

M3 - Article

C2 - 21173266

AN - SCOPUS:78651103643

VL - 108

SP - 55

EP - 60

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

SN - 0027-8424

IS - 1

ER -