Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases

Christine M. Constantinople, Alex T. Piet, Peter Bibawi, Athena Akrami, Charles Kopec, Carlos D. Brody

Research output: Contribution to journalArticle

Abstract

Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial 'win-stay/lose-shift' biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats' increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC's role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.

Original languageEnglish (US)
JournaleLife
Volume8
DOIs
StatePublished - Nov 6 2019

Fingerprint

Prefrontal Cortex
Reward
Rats
Optogenetics
Learning
Psychological Adaptation
Decision Making
Decision making
History
Substrates
Inhibition (Psychology)

Keywords

  • decision-making
  • learning
  • neuroscience
  • orbitofrontal cortex
  • rat
  • reinforcement learning
  • sequential bias

ASJC Scopus subject areas

  • Neuroscience(all)
  • Immunology and Microbiology(all)
  • Biochemistry, Genetics and Molecular Biology(all)

Cite this

Constantinople, C. M., Piet, A. T., Bibawi, P., Akrami, A., Kopec, C., & Brody, C. D. (2019). Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases. eLife, 8. https://doi.org/10.7554/eLife.49744

Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases. / Constantinople, Christine M.; Piet, Alex T.; Bibawi, Peter; Akrami, Athena; Kopec, Charles; Brody, Carlos D.

In: eLife, Vol. 8, 06.11.2019.

Research output: Contribution to journalArticle

Constantinople, CM, Piet, AT, Bibawi, P, Akrami, A, Kopec, C & Brody, CD 2019, 'Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases', eLife, vol. 8. https://doi.org/10.7554/eLife.49744
Constantinople, Christine M. ; Piet, Alex T. ; Bibawi, Peter ; Akrami, Athena ; Kopec, Charles ; Brody, Carlos D. / Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases. In: eLife. 2019 ; Vol. 8.
@article{f85ebdd0c7ec4ba58299c2799392020c,
title = "Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases",
abstract = "Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial 'win-stay/lose-shift' biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats' increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC's role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.",
keywords = "decision-making, learning, neuroscience, orbitofrontal cortex, rat, reinforcement learning, sequential bias",
author = "Constantinople, {Christine M.} and Piet, {Alex T.} and Peter Bibawi and Athena Akrami and Charles Kopec and Brody, {Carlos D.}",
year = "2019",
month = "11",
day = "6",
doi = "10.7554/eLife.49744",
language = "English (US)",
volume = "8",
journal = "eLife",
issn = "2050-084X",
publisher = "eLife Sciences Publications",

}

TY - JOUR

T1 - Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases

AU - Constantinople, Christine M.

AU - Piet, Alex T.

AU - Bibawi, Peter

AU - Akrami, Athena

AU - Kopec, Charles

AU - Brody, Carlos D.

PY - 2019/11/6

Y1 - 2019/11/6

N2 - Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial 'win-stay/lose-shift' biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats' increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC's role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.

AB - Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial 'win-stay/lose-shift' biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats' increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC's role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.

KW - decision-making

KW - learning

KW - neuroscience

KW - orbitofrontal cortex

KW - rat

KW - reinforcement learning

KW - sequential bias

UR - http://www.scopus.com/inward/record.url?scp=85074560075&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074560075&partnerID=8YFLogxK

U2 - 10.7554/eLife.49744

DO - 10.7554/eLife.49744

M3 - Article

C2 - 31692447

AN - SCOPUS:85074560075

VL - 8

JO - eLife

JF - eLife

SN - 2050-084X

ER -