Episodic memory encoding interferes with reward learning and decreases striatal prediction errors

G. Elliott Wimmer, Erin Kendall Braun, Nathaniel D. Daw, Daphna Shohamy

Research output: Contribution to journalArticle

Abstract

Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental rewardbased learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning asmuchmoney as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.

Original languageEnglish (US)
Pages (from-to)14901-14912
Number of pages12
JournalJournal of Neuroscience
Volume34
Issue number45
DOIs
StatePublished - Nov 5 2014

Fingerprint

Corpus Striatum
Episodic Memory
Reward
Learning
Hippocampus
Decision Making
Magnetic Resonance Imaging

Keywords

  • Decision making
  • Hippocampus
  • Learning
  • Memory
  • Reward
  • Striatum

ASJC Scopus subject areas

  • Neuroscience(all)
  • Medicine(all)

Cite this

Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. / Elliott Wimmer, G.; Braun, Erin Kendall; Daw, Nathaniel D.; Shohamy, Daphna.

In: Journal of Neuroscience, Vol. 34, No. 45, 05.11.2014, p. 14901-14912.

Research output: Contribution to journalArticle

Elliott Wimmer, G. ; Braun, Erin Kendall ; Daw, Nathaniel D. ; Shohamy, Daphna. / Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. In: Journal of Neuroscience. 2014 ; Vol. 34, No. 45. pp. 14901-14912.
@article{4e23c415876b48e1a3ee2b929e77d98a,
title = "Episodic memory encoding interferes with reward learning and decreases striatal prediction errors",
abstract = "Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental rewardbased learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning asmuchmoney as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.",
keywords = "Decision making, Hippocampus, Learning, Memory, Reward, Striatum",
author = "{Elliott Wimmer}, G. and Braun, {Erin Kendall} and Daw, {Nathaniel D.} and Daphna Shohamy",
year = "2014",
month = "11",
day = "5",
doi = "10.1523/JNEUROSCI.0204-14.2014",
language = "English (US)",
volume = "34",
pages = "14901--14912",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "45",

}

TY - JOUR

T1 - Episodic memory encoding interferes with reward learning and decreases striatal prediction errors

AU - Elliott Wimmer, G.

AU - Braun, Erin Kendall

AU - Daw, Nathaniel D.

AU - Shohamy, Daphna

PY - 2014/11/5

Y1 - 2014/11/5

N2 - Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental rewardbased learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning asmuchmoney as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.

AB - Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental rewardbased learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning asmuchmoney as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.

KW - Decision making

KW - Hippocampus

KW - Learning

KW - Memory

KW - Reward

KW - Striatum

UR - http://www.scopus.com/inward/record.url?scp=84908518146&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908518146&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.0204-14.2014

DO - 10.1523/JNEUROSCI.0204-14.2014

M3 - Article

C2 - 25378157

AN - SCOPUS:84908518146

VL - 34

SP - 14901

EP - 14912

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 45

ER -