Action and outcome encoding in the primate caudate nucleus

Brian Lau, Paul Glimcher

Research output: Contribution to journalArticle

Abstract

The basal ganglia appear to have a central role in reinforcement learning. Previous experiments, focusing on activity preceding movement execution, support the idea that dorsal striatal neurons bias action selection according to the expected values of actions. However, many phasically active striatal neurons respond at a time too late to initiate or select movements. Given the data suggesting a role for the basal ganglia in reinforcement learning, postmovement activity may therefore reflect evaluative processing important for learning the values of actions. To better understand these postmovement neurons, we determined whether individual striatal neurons encode information about saccade direction, whether a reward had been received, or both. We recorded from phasically active neurons in the caudate nucleus while monkeys performed a probabilistically rewarded delayed saccade task. Many neurons exhibited peak responses after saccade execution (77 of 149) that were often tuned for the direction of the preceding saccade (61 of 77). Of those neurons responding during the reward epoch, one subset showed direction tuning for the immediately preceding saccade (43 of 60), whereas another subset responded differentially on rewarded versus unrewarded trials (35 of 60). We found that there was relatively little overlap of these properties in individual neurons. The encoding of action and outcome was performed by largely separate populations of caudate neurons that were active after movement execution. Thus, striatal neurons active primarily after a movement appear to be segregated into two distinct groups that provide complimentary information about the outcomes of actions.

Original languageEnglish (US)
Pages (from-to)14502-14514
Number of pages13
JournalJournal of Neuroscience
Volume27
Issue number52
DOIs
StatePublished - Dec 26 2007

Fingerprint

Caudate Nucleus
Primates
Neurons
Saccades
Corpus Striatum
Learning
Basal Ganglia
Reward
Selection Bias
Haplorhini

Keywords

  • Basal ganglia
  • Caudate
  • Monkey
  • Oculomotor
  • Reinforcement learning
  • Reward

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Action and outcome encoding in the primate caudate nucleus. / Lau, Brian; Glimcher, Paul.

In: Journal of Neuroscience, Vol. 27, No. 52, 26.12.2007, p. 14502-14514.

Research output: Contribution to journalArticle

@article{97c247a5631c4dee9c1acbbb4554dcfb,
title = "Action and outcome encoding in the primate caudate nucleus",
abstract = "The basal ganglia appear to have a central role in reinforcement learning. Previous experiments, focusing on activity preceding movement execution, support the idea that dorsal striatal neurons bias action selection according to the expected values of actions. However, many phasically active striatal neurons respond at a time too late to initiate or select movements. Given the data suggesting a role for the basal ganglia in reinforcement learning, postmovement activity may therefore reflect evaluative processing important for learning the values of actions. To better understand these postmovement neurons, we determined whether individual striatal neurons encode information about saccade direction, whether a reward had been received, or both. We recorded from phasically active neurons in the caudate nucleus while monkeys performed a probabilistically rewarded delayed saccade task. Many neurons exhibited peak responses after saccade execution (77 of 149) that were often tuned for the direction of the preceding saccade (61 of 77). Of those neurons responding during the reward epoch, one subset showed direction tuning for the immediately preceding saccade (43 of 60), whereas another subset responded differentially on rewarded versus unrewarded trials (35 of 60). We found that there was relatively little overlap of these properties in individual neurons. The encoding of action and outcome was performed by largely separate populations of caudate neurons that were active after movement execution. Thus, striatal neurons active primarily after a movement appear to be segregated into two distinct groups that provide complimentary information about the outcomes of actions.",
keywords = "Basal ganglia, Caudate, Monkey, Oculomotor, Reinforcement learning, Reward",
author = "Brian Lau and Paul Glimcher",
year = "2007",
month = "12",
day = "26",
doi = "10.1523/JNEUROSCI.3060-07.2007",
language = "English (US)",
volume = "27",
pages = "14502--14514",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "52",

}

TY - JOUR

T1 - Action and outcome encoding in the primate caudate nucleus

AU - Lau, Brian

AU - Glimcher, Paul

PY - 2007/12/26

Y1 - 2007/12/26

N2 - The basal ganglia appear to have a central role in reinforcement learning. Previous experiments, focusing on activity preceding movement execution, support the idea that dorsal striatal neurons bias action selection according to the expected values of actions. However, many phasically active striatal neurons respond at a time too late to initiate or select movements. Given the data suggesting a role for the basal ganglia in reinforcement learning, postmovement activity may therefore reflect evaluative processing important for learning the values of actions. To better understand these postmovement neurons, we determined whether individual striatal neurons encode information about saccade direction, whether a reward had been received, or both. We recorded from phasically active neurons in the caudate nucleus while monkeys performed a probabilistically rewarded delayed saccade task. Many neurons exhibited peak responses after saccade execution (77 of 149) that were often tuned for the direction of the preceding saccade (61 of 77). Of those neurons responding during the reward epoch, one subset showed direction tuning for the immediately preceding saccade (43 of 60), whereas another subset responded differentially on rewarded versus unrewarded trials (35 of 60). We found that there was relatively little overlap of these properties in individual neurons. The encoding of action and outcome was performed by largely separate populations of caudate neurons that were active after movement execution. Thus, striatal neurons active primarily after a movement appear to be segregated into two distinct groups that provide complimentary information about the outcomes of actions.

AB - The basal ganglia appear to have a central role in reinforcement learning. Previous experiments, focusing on activity preceding movement execution, support the idea that dorsal striatal neurons bias action selection according to the expected values of actions. However, many phasically active striatal neurons respond at a time too late to initiate or select movements. Given the data suggesting a role for the basal ganglia in reinforcement learning, postmovement activity may therefore reflect evaluative processing important for learning the values of actions. To better understand these postmovement neurons, we determined whether individual striatal neurons encode information about saccade direction, whether a reward had been received, or both. We recorded from phasically active neurons in the caudate nucleus while monkeys performed a probabilistically rewarded delayed saccade task. Many neurons exhibited peak responses after saccade execution (77 of 149) that were often tuned for the direction of the preceding saccade (61 of 77). Of those neurons responding during the reward epoch, one subset showed direction tuning for the immediately preceding saccade (43 of 60), whereas another subset responded differentially on rewarded versus unrewarded trials (35 of 60). We found that there was relatively little overlap of these properties in individual neurons. The encoding of action and outcome was performed by largely separate populations of caudate neurons that were active after movement execution. Thus, striatal neurons active primarily after a movement appear to be segregated into two distinct groups that provide complimentary information about the outcomes of actions.

KW - Basal ganglia

KW - Caudate

KW - Monkey

KW - Oculomotor

KW - Reinforcement learning

KW - Reward

UR - http://www.scopus.com/inward/record.url?scp=37549010339&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37549010339&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.3060-07.2007

DO - 10.1523/JNEUROSCI.3060-07.2007

M3 - Article

VL - 27

SP - 14502

EP - 14514

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 52

ER -