Model-based choices involve prospective neural activity

Bradley B. Doll, Katherine D. Duncan, Dylan A. Simon, Daphna Shohamy, Nathaniel D. Daw

Research output: Contribution to journalArticle

Abstract

Decisions may arise via 'model-free' repetition of previously reinforced actions or by 'model-based' evaluation, which is widely thought to follow from prospective anticipation of action consequences using a learned map or model. While choices and neural correlates of decision variables sometimes reflect knowledge of their consequences, it remains unclear whether this actually arises from prospective evaluation. Using functional magnetic resonance imaging and a sequential reward-learning task in which paths contained decodable object categories, we found that humans' model-based choices were associated with neural signatures of future paths observed at decision time, suggesting a prospective mechanism for choice. Prospection also covaried with the degree of model-based influences on neural correlates of decision variables and was inversely related to prediction error signals thought to underlie model-free learning. These results dissociate separate mechanisms underlying model-based and model-free evaluation and support the hypothesis that model-based influences on choices and neural decision variables result from prospection.

Original languageEnglish (US)
Pages (from-to)767-772
Number of pages6
JournalNature Neuroscience
Volume18
Issue number5
DOIs
StatePublished - Apr 28 2015

Fingerprint

Learning
Reward
Magnetic Resonance Imaging

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Doll, B. B., Duncan, K. D., Simon, D. A., Shohamy, D., & Daw, N. D. (2015). Model-based choices involve prospective neural activity. Nature Neuroscience, 18(5), 767-772. https://doi.org/10.1038/nn.3981

Model-based choices involve prospective neural activity. / Doll, Bradley B.; Duncan, Katherine D.; Simon, Dylan A.; Shohamy, Daphna; Daw, Nathaniel D.

In: Nature Neuroscience, Vol. 18, No. 5, 28.04.2015, p. 767-772.

Research output: Contribution to journalArticle

Doll, BB, Duncan, KD, Simon, DA, Shohamy, D & Daw, ND 2015, 'Model-based choices involve prospective neural activity', Nature Neuroscience, vol. 18, no. 5, pp. 767-772. https://doi.org/10.1038/nn.3981
Doll BB, Duncan KD, Simon DA, Shohamy D, Daw ND. Model-based choices involve prospective neural activity. Nature Neuroscience. 2015 Apr 28;18(5):767-772. https://doi.org/10.1038/nn.3981
Doll, Bradley B. ; Duncan, Katherine D. ; Simon, Dylan A. ; Shohamy, Daphna ; Daw, Nathaniel D. / Model-based choices involve prospective neural activity. In: Nature Neuroscience. 2015 ; Vol. 18, No. 5. pp. 767-772.
@article{a6468d4eb7d9478b83b59a68ee98c6a6,
title = "Model-based choices involve prospective neural activity",
abstract = "Decisions may arise via 'model-free' repetition of previously reinforced actions or by 'model-based' evaluation, which is widely thought to follow from prospective anticipation of action consequences using a learned map or model. While choices and neural correlates of decision variables sometimes reflect knowledge of their consequences, it remains unclear whether this actually arises from prospective evaluation. Using functional magnetic resonance imaging and a sequential reward-learning task in which paths contained decodable object categories, we found that humans' model-based choices were associated with neural signatures of future paths observed at decision time, suggesting a prospective mechanism for choice. Prospection also covaried with the degree of model-based influences on neural correlates of decision variables and was inversely related to prediction error signals thought to underlie model-free learning. These results dissociate separate mechanisms underlying model-based and model-free evaluation and support the hypothesis that model-based influences on choices and neural decision variables result from prospection.",
author = "Doll, {Bradley B.} and Duncan, {Katherine D.} and Simon, {Dylan A.} and Daphna Shohamy and Daw, {Nathaniel D.}",
year = "2015",
month = "4",
day = "28",
doi = "10.1038/nn.3981",
language = "English (US)",
volume = "18",
pages = "767--772",
journal = "Nature Neuroscience",
issn = "1097-6256",
publisher = "Nature Publishing Group",
number = "5",

}

TY - JOUR

T1 - Model-based choices involve prospective neural activity

AU - Doll, Bradley B.

AU - Duncan, Katherine D.

AU - Simon, Dylan A.

AU - Shohamy, Daphna

AU - Daw, Nathaniel D.

PY - 2015/4/28

Y1 - 2015/4/28

N2 - Decisions may arise via 'model-free' repetition of previously reinforced actions or by 'model-based' evaluation, which is widely thought to follow from prospective anticipation of action consequences using a learned map or model. While choices and neural correlates of decision variables sometimes reflect knowledge of their consequences, it remains unclear whether this actually arises from prospective evaluation. Using functional magnetic resonance imaging and a sequential reward-learning task in which paths contained decodable object categories, we found that humans' model-based choices were associated with neural signatures of future paths observed at decision time, suggesting a prospective mechanism for choice. Prospection also covaried with the degree of model-based influences on neural correlates of decision variables and was inversely related to prediction error signals thought to underlie model-free learning. These results dissociate separate mechanisms underlying model-based and model-free evaluation and support the hypothesis that model-based influences on choices and neural decision variables result from prospection.

AB - Decisions may arise via 'model-free' repetition of previously reinforced actions or by 'model-based' evaluation, which is widely thought to follow from prospective anticipation of action consequences using a learned map or model. While choices and neural correlates of decision variables sometimes reflect knowledge of their consequences, it remains unclear whether this actually arises from prospective evaluation. Using functional magnetic resonance imaging and a sequential reward-learning task in which paths contained decodable object categories, we found that humans' model-based choices were associated with neural signatures of future paths observed at decision time, suggesting a prospective mechanism for choice. Prospection also covaried with the degree of model-based influences on neural correlates of decision variables and was inversely related to prediction error signals thought to underlie model-free learning. These results dissociate separate mechanisms underlying model-based and model-free evaluation and support the hypothesis that model-based influences on choices and neural decision variables result from prospection.

UR - http://www.scopus.com/inward/record.url?scp=84928701322&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84928701322&partnerID=8YFLogxK

U2 - 10.1038/nn.3981

DO - 10.1038/nn.3981

M3 - Article

VL - 18

SP - 767

EP - 772

JO - Nature Neuroscience

JF - Nature Neuroscience

SN - 1097-6256

IS - 5

ER -