Working-memory capacity protects model-based learning from stress

A. Ross Otto, Candace M. Raio, Alice Chiang, Elizabeth Phelps, Nathaniel D. Daw

Research output: Contribution to journalArticle

Abstract

Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic- pituitaryadrenal (HPA) axis stress response - believed to have detrimental effects on prefrontal cortex function - should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WMcapacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.

Original languageEnglish (US)
Pages (from-to)20941-20946
Number of pages6
JournalProceedings of the National Academy of Sciences of the United States of America
Volume110
Issue number52
DOIs
StatePublished - Dec 24 2013

Fingerprint

Short-Term Memory
Learning
Executive Function
Decision Making
Choice Behavior
Prefrontal Cortex
Reward
Hydrocortisone

ASJC Scopus subject areas

  • General

Cite this

Working-memory capacity protects model-based learning from stress. / Otto, A. Ross; Raio, Candace M.; Chiang, Alice; Phelps, Elizabeth; Daw, Nathaniel D.

In: Proceedings of the National Academy of Sciences of the United States of America, Vol. 110, No. 52, 24.12.2013, p. 20941-20946.

Research output: Contribution to journalArticle

Otto, A. Ross ; Raio, Candace M. ; Chiang, Alice ; Phelps, Elizabeth ; Daw, Nathaniel D. / Working-memory capacity protects model-based learning from stress. In: Proceedings of the National Academy of Sciences of the United States of America. 2013 ; Vol. 110, No. 52. pp. 20941-20946.
@article{5358896c13b645d583e568a75893c51d,
title = "Working-memory capacity protects model-based learning from stress",
abstract = "Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic- pituitaryadrenal (HPA) axis stress response - believed to have detrimental effects on prefrontal cortex function - should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WMcapacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.",
author = "Otto, {A. Ross} and Raio, {Candace M.} and Alice Chiang and Elizabeth Phelps and Daw, {Nathaniel D.}",
year = "2013",
month = "12",
day = "24",
doi = "10.1073/pnas.1312011110",
language = "English (US)",
volume = "110",
pages = "20941--20946",
journal = "Proceedings of the National Academy of Sciences of the United States of America",
issn = "0027-8424",
number = "52",

}

TY - JOUR

T1 - Working-memory capacity protects model-based learning from stress

AU - Otto, A. Ross

AU - Raio, Candace M.

AU - Chiang, Alice

AU - Phelps, Elizabeth

AU - Daw, Nathaniel D.

PY - 2013/12/24

Y1 - 2013/12/24

N2 - Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic- pituitaryadrenal (HPA) axis stress response - believed to have detrimental effects on prefrontal cortex function - should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WMcapacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.

AB - Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic- pituitaryadrenal (HPA) axis stress response - believed to have detrimental effects on prefrontal cortex function - should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WMcapacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.

UR - http://www.scopus.com/inward/record.url?scp=84891354506&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84891354506&partnerID=8YFLogxK

U2 - 10.1073/pnas.1312011110

DO - 10.1073/pnas.1312011110

M3 - Article

AN - SCOPUS:84891354506

VL - 110

SP - 20941

EP - 20946

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

SN - 0027-8424

IS - 52

ER -