Internal representation of task rules by recurrent dynamics

The importance of the diversity of neural responses

Mattia Rigotti, Daniel Ben Dayan Rubin, Xiao-Jing Wang, Stefano Fusi

Research output: Contribution to journalArticle

Abstract

Neural activity of behaving animals, especially in the prefrontal cortex, is highly heterogeneous, with selective responses to diverse aspects of the executed task. We propose a general model of recurrent neural networks that perform complex rule-based tasks, and we show that the diversity of neuronal responses plays a fundamental role when the behavioral responses are context-dependent. Specifically, we found that when the inner mental states encoding the task rules are represented by stable patterns of neural activity (attractors of the neural dynamics), the neurons must be selective for combinations of sensory stimuli and inner mental states. Such mixed selectivity is easily obtained by neurons that connect with random synaptic strengths both to the recurrent network and to neurons encoding sensory inputs.The number of randomly connected neurons needed to solve a task is on average only three times as large as the number of neurons needed in a network designed ad hoc. Moreover, the number of needed neurons grows only linearly with the number of task-relevant events and mental states, provided that each neuron responds to a large proportion of events (dense/distributed coding). A biologically realistic implementation of the model captures several aspects of the activity recorded from monkeys performing context-dependent tasks. Our findings explain the importance of the diversity of neural responses and provide us with simple and general principles for designing attractor neural networks that perform complex computation.

Original languageEnglish (US)
JournalFrontiers in Computational Neuroscience
Volume4
DOIs
StatePublished - 2010

Fingerprint

Neurons
Neural Networks (Computer)
Sensory Receptor Cells
Prefrontal Cortex
Haplorhini

Keywords

  • Attractor neural network
  • Mixed selectivity
  • Persistent activity
  • Prefrontal cortex
  • Randomly connected neurons
  • Rule-based behavior

ASJC Scopus subject areas

  • Neuroscience (miscellaneous)
  • Cellular and Molecular Neuroscience

Cite this

Internal representation of task rules by recurrent dynamics : The importance of the diversity of neural responses. / Rigotti, Mattia; Rubin, Daniel Ben Dayan; Wang, Xiao-Jing; Fusi, Stefano.

In: Frontiers in Computational Neuroscience, Vol. 4, 2010.

Research output: Contribution to journalArticle

@article{05cf04a0ee9f488e889594f7cdd0d8a7,
title = "Internal representation of task rules by recurrent dynamics: The importance of the diversity of neural responses",
abstract = "Neural activity of behaving animals, especially in the prefrontal cortex, is highly heterogeneous, with selective responses to diverse aspects of the executed task. We propose a general model of recurrent neural networks that perform complex rule-based tasks, and we show that the diversity of neuronal responses plays a fundamental role when the behavioral responses are context-dependent. Specifically, we found that when the inner mental states encoding the task rules are represented by stable patterns of neural activity (attractors of the neural dynamics), the neurons must be selective for combinations of sensory stimuli and inner mental states. Such mixed selectivity is easily obtained by neurons that connect with random synaptic strengths both to the recurrent network and to neurons encoding sensory inputs.The number of randomly connected neurons needed to solve a task is on average only three times as large as the number of neurons needed in a network designed ad hoc. Moreover, the number of needed neurons grows only linearly with the number of task-relevant events and mental states, provided that each neuron responds to a large proportion of events (dense/distributed coding). A biologically realistic implementation of the model captures several aspects of the activity recorded from monkeys performing context-dependent tasks. Our findings explain the importance of the diversity of neural responses and provide us with simple and general principles for designing attractor neural networks that perform complex computation.",
keywords = "Attractor neural network, Mixed selectivity, Persistent activity, Prefrontal cortex, Randomly connected neurons, Rule-based behavior",
author = "Mattia Rigotti and Rubin, {Daniel Ben Dayan} and Xiao-Jing Wang and Stefano Fusi",
year = "2010",
doi = "10.3389/fncom.2010.00024",
language = "English (US)",
volume = "4",
journal = "Frontiers in Computational Neuroscience",
issn = "1662-5188",
publisher = "Frontiers Research Foundation",

}

TY - JOUR

T1 - Internal representation of task rules by recurrent dynamics

T2 - The importance of the diversity of neural responses

AU - Rigotti, Mattia

AU - Rubin, Daniel Ben Dayan

AU - Wang, Xiao-Jing

AU - Fusi, Stefano

PY - 2010

Y1 - 2010

N2 - Neural activity of behaving animals, especially in the prefrontal cortex, is highly heterogeneous, with selective responses to diverse aspects of the executed task. We propose a general model of recurrent neural networks that perform complex rule-based tasks, and we show that the diversity of neuronal responses plays a fundamental role when the behavioral responses are context-dependent. Specifically, we found that when the inner mental states encoding the task rules are represented by stable patterns of neural activity (attractors of the neural dynamics), the neurons must be selective for combinations of sensory stimuli and inner mental states. Such mixed selectivity is easily obtained by neurons that connect with random synaptic strengths both to the recurrent network and to neurons encoding sensory inputs.The number of randomly connected neurons needed to solve a task is on average only three times as large as the number of neurons needed in a network designed ad hoc. Moreover, the number of needed neurons grows only linearly with the number of task-relevant events and mental states, provided that each neuron responds to a large proportion of events (dense/distributed coding). A biologically realistic implementation of the model captures several aspects of the activity recorded from monkeys performing context-dependent tasks. Our findings explain the importance of the diversity of neural responses and provide us with simple and general principles for designing attractor neural networks that perform complex computation.

AB - Neural activity of behaving animals, especially in the prefrontal cortex, is highly heterogeneous, with selective responses to diverse aspects of the executed task. We propose a general model of recurrent neural networks that perform complex rule-based tasks, and we show that the diversity of neuronal responses plays a fundamental role when the behavioral responses are context-dependent. Specifically, we found that when the inner mental states encoding the task rules are represented by stable patterns of neural activity (attractors of the neural dynamics), the neurons must be selective for combinations of sensory stimuli and inner mental states. Such mixed selectivity is easily obtained by neurons that connect with random synaptic strengths both to the recurrent network and to neurons encoding sensory inputs.The number of randomly connected neurons needed to solve a task is on average only three times as large as the number of neurons needed in a network designed ad hoc. Moreover, the number of needed neurons grows only linearly with the number of task-relevant events and mental states, provided that each neuron responds to a large proportion of events (dense/distributed coding). A biologically realistic implementation of the model captures several aspects of the activity recorded from monkeys performing context-dependent tasks. Our findings explain the importance of the diversity of neural responses and provide us with simple and general principles for designing attractor neural networks that perform complex computation.

KW - Attractor neural network

KW - Mixed selectivity

KW - Persistent activity

KW - Prefrontal cortex

KW - Randomly connected neurons

KW - Rule-based behavior

UR - http://www.scopus.com/inward/record.url?scp=84863881230&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863881230&partnerID=8YFLogxK

U2 - 10.3389/fncom.2010.00024

DO - 10.3389/fncom.2010.00024

M3 - Article

VL - 4

JO - Frontiers in Computational Neuroscience

JF - Frontiers in Computational Neuroscience

SN - 1662-5188

ER -