Multiplicity of control in the basal ganglia: Computational roles of striatal subregions

Aaron M. Bornstein, Nathaniel D. Daw

Research output: Contribution to journalArticle

Abstract

The basal ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement learning (RL) models. - which have driven much recent experimental work on this region. - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical 'loops' of synaptic projections, connecting a wide range of cortical and subcortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provide extensive insight into unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well with theories of a 'model-based' RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.

Original languageEnglish (US)
Pages (from-to)374-380
Number of pages7
JournalCurrent Opinion in Neurobiology
Volume21
Issue number3
DOIs
StatePublished - Jun 2011

Fingerprint

Corpus Striatum
Basal Ganglia
Learning
Brain
Reinforcement (Psychology)
Ventral Striatum
Nexus

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Multiplicity of control in the basal ganglia : Computational roles of striatal subregions. / Bornstein, Aaron M.; Daw, Nathaniel D.

In: Current Opinion in Neurobiology, Vol. 21, No. 3, 06.2011, p. 374-380.

Research output: Contribution to journalArticle

Bornstein, Aaron M. ; Daw, Nathaniel D. / Multiplicity of control in the basal ganglia : Computational roles of striatal subregions. In: Current Opinion in Neurobiology. 2011 ; Vol. 21, No. 3. pp. 374-380.
@article{364bc2b83ffe4d88adb0a986e3c703a9,
title = "Multiplicity of control in the basal ganglia: Computational roles of striatal subregions",
abstract = "The basal ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement learning (RL) models. - which have driven much recent experimental work on this region. - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical 'loops' of synaptic projections, connecting a wide range of cortical and subcortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provide extensive insight into unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well with theories of a 'model-based' RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.",
author = "Bornstein, {Aaron M.} and Daw, {Nathaniel D.}",
year = "2011",
month = "6",
doi = "10.1016/j.conb.2011.02.009",
language = "English (US)",
volume = "21",
pages = "374--380",
journal = "Current Opinion in Neurobiology",
issn = "0959-4388",
publisher = "Elsevier Limited",
number = "3",

}

TY - JOUR

T1 - Multiplicity of control in the basal ganglia

T2 - Computational roles of striatal subregions

AU - Bornstein, Aaron M.

AU - Daw, Nathaniel D.

PY - 2011/6

Y1 - 2011/6

N2 - The basal ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement learning (RL) models. - which have driven much recent experimental work on this region. - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical 'loops' of synaptic projections, connecting a wide range of cortical and subcortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provide extensive insight into unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well with theories of a 'model-based' RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.

AB - The basal ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement learning (RL) models. - which have driven much recent experimental work on this region. - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical 'loops' of synaptic projections, connecting a wide range of cortical and subcortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provide extensive insight into unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well with theories of a 'model-based' RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.

UR - http://www.scopus.com/inward/record.url?scp=79960203266&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960203266&partnerID=8YFLogxK

U2 - 10.1016/j.conb.2011.02.009

DO - 10.1016/j.conb.2011.02.009

M3 - Article

VL - 21

SP - 374

EP - 380

JO - Current Opinion in Neurobiology

JF - Current Opinion in Neurobiology

SN - 0959-4388

IS - 3

ER -