Multiple Systems for Value Learning

Nathaniel D. Daw, John P. O'Doherty

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Although choice is often unitary on theoretical accounts, there is much empirical evidence that decisions are produced by multiple, cooperating or competing neural and psychological mechanisms. We review the evidence that decisions in humans and other animals are influenced by three systems for value learning: Pavlovian, habitual, and goal-directed. These systems are behaviorally dissociable, are mediated by at least partly differentiable brain systems, and embody distinct computational principles. We discuss how the interactions between these systems for behavioral control can produce errors, inefficiencies, and disorders involving compulsion, and how these systems relate to other dual- or multiple-system models in neuroeconomics.

Original languageEnglish (US)
Title of host publicationNeuroeconomics: Decision Making and the Brain: Second Edition
PublisherElsevier Inc.
Pages393-410
Number of pages18
ISBN (Print)9780124160088
DOIs
StatePublished - Sep 2013

Fingerprint

Learning
Psychology
Brain

Keywords

  • Goal-directed
  • Habitual
  • Model-based learning
  • Model-free learning
  • Pavlovian
  • Reinforcement learning

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Daw, N. D., & O'Doherty, J. P. (2013). Multiple Systems for Value Learning. In Neuroeconomics: Decision Making and the Brain: Second Edition (pp. 393-410). Elsevier Inc.. https://doi.org/10.1016/B978-0-12-416008-8.00021-8

Multiple Systems for Value Learning. / Daw, Nathaniel D.; O'Doherty, John P.

Neuroeconomics: Decision Making and the Brain: Second Edition. Elsevier Inc., 2013. p. 393-410.

Research output: Chapter in Book/Report/Conference proceedingChapter

Daw, ND & O'Doherty, JP 2013, Multiple Systems for Value Learning. in Neuroeconomics: Decision Making and the Brain: Second Edition. Elsevier Inc., pp. 393-410. https://doi.org/10.1016/B978-0-12-416008-8.00021-8
Daw ND, O'Doherty JP. Multiple Systems for Value Learning. In Neuroeconomics: Decision Making and the Brain: Second Edition. Elsevier Inc. 2013. p. 393-410 https://doi.org/10.1016/B978-0-12-416008-8.00021-8
Daw, Nathaniel D. ; O'Doherty, John P. / Multiple Systems for Value Learning. Neuroeconomics: Decision Making and the Brain: Second Edition. Elsevier Inc., 2013. pp. 393-410
@inbook{cb6caccd050d4abbb1a50600bccbba71,
title = "Multiple Systems for Value Learning",
abstract = "Although choice is often unitary on theoretical accounts, there is much empirical evidence that decisions are produced by multiple, cooperating or competing neural and psychological mechanisms. We review the evidence that decisions in humans and other animals are influenced by three systems for value learning: Pavlovian, habitual, and goal-directed. These systems are behaviorally dissociable, are mediated by at least partly differentiable brain systems, and embody distinct computational principles. We discuss how the interactions between these systems for behavioral control can produce errors, inefficiencies, and disorders involving compulsion, and how these systems relate to other dual- or multiple-system models in neuroeconomics.",
keywords = "Goal-directed, Habitual, Model-based learning, Model-free learning, Pavlovian, Reinforcement learning",
author = "Daw, {Nathaniel D.} and O'Doherty, {John P.}",
year = "2013",
month = "9",
doi = "10.1016/B978-0-12-416008-8.00021-8",
language = "English (US)",
isbn = "9780124160088",
pages = "393--410",
booktitle = "Neuroeconomics: Decision Making and the Brain: Second Edition",
publisher = "Elsevier Inc.",

}

TY - CHAP

T1 - Multiple Systems for Value Learning

AU - Daw, Nathaniel D.

AU - O'Doherty, John P.

PY - 2013/9

Y1 - 2013/9

N2 - Although choice is often unitary on theoretical accounts, there is much empirical evidence that decisions are produced by multiple, cooperating or competing neural and psychological mechanisms. We review the evidence that decisions in humans and other animals are influenced by three systems for value learning: Pavlovian, habitual, and goal-directed. These systems are behaviorally dissociable, are mediated by at least partly differentiable brain systems, and embody distinct computational principles. We discuss how the interactions between these systems for behavioral control can produce errors, inefficiencies, and disorders involving compulsion, and how these systems relate to other dual- or multiple-system models in neuroeconomics.

AB - Although choice is often unitary on theoretical accounts, there is much empirical evidence that decisions are produced by multiple, cooperating or competing neural and psychological mechanisms. We review the evidence that decisions in humans and other animals are influenced by three systems for value learning: Pavlovian, habitual, and goal-directed. These systems are behaviorally dissociable, are mediated by at least partly differentiable brain systems, and embody distinct computational principles. We discuss how the interactions between these systems for behavioral control can produce errors, inefficiencies, and disorders involving compulsion, and how these systems relate to other dual- or multiple-system models in neuroeconomics.

KW - Goal-directed

KW - Habitual

KW - Model-based learning

KW - Model-free learning

KW - Pavlovian

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=84885024210&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84885024210&partnerID=8YFLogxK

U2 - 10.1016/B978-0-12-416008-8.00021-8

DO - 10.1016/B978-0-12-416008-8.00021-8

M3 - Chapter

SN - 9780124160088

SP - 393

EP - 410

BT - Neuroeconomics: Decision Making and the Brain: Second Edition

PB - Elsevier Inc.

ER -