Dynamic Analysis of Learning in Behavioral Experiments

Anne C. Smith, Loren M. Frank, Sylvia Wirth, Marianna Yanike, Dan Hu, Yasuo Kubota, Ann M. Graybiel, Wendy Suzuki, Emery N. Brown

Research output: Contribution to journalArticle

Abstract

Understanding how an animal's ability to learn relates to neural activity or is altered by lesions, different attentional states, pharmacological interventions, or genetic manipulations are central questions in neuroscience. Although learning is a dynamic process, current analyses do not use dynamic estimation methods, require many trials across many animals to establish the occurrence of learning, and provide no consensus as how best to identify when learning has occurred. We develop a state-space model paradigm to characterize learning as the probability of a correct response as a function of trial number (learning curve). We compute the learning curve and its confidence intervals using a state-space smoothing algorithm and define the learning trial as the first trial on which there is reasonable certainty (>0.95) that a subject performs better than chance for the balance of the experiment. For a range of simulated learning experiments, the smoothing algorithm estimated learning curves with smaller mean integrated squared error and identified the learning trials with greater reliability than commonly used methods. The smoothing algorithm tracked easily the rapid learning of a monkey during a single session of an association learning experiment and identified learning 2 to 4 d earlier than accepted criteria for a rat in a 47 d procedural learning experiment. Our state-space paradigm estimates learning curves for single animals, gives a precise definition of learning, and suggests a coherent statistical framework for the design and analysis of learning experiments that could reduce the number of animals and trials per animal that these studies require.

Original languageEnglish (US)
Pages (from-to)447-461
Number of pages15
JournalJournal of Neuroscience
Volume24
Issue number2
DOIs
StatePublished - Jan 14 2004

Fingerprint

Learning
Learning Curve
Probability Learning
Association Learning
Space Simulation
Aptitude
Genetic Engineering
Neurosciences
Haplorhini
Consensus
Pharmacology
Confidence Intervals

Keywords

  • Association task
  • Behavior
  • Change-point test
  • EM algorithm
  • Hidden Markov model
  • Learning
  • State-space model

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Smith, A. C., Frank, L. M., Wirth, S., Yanike, M., Hu, D., Kubota, Y., ... Brown, E. N. (2004). Dynamic Analysis of Learning in Behavioral Experiments. Journal of Neuroscience, 24(2), 447-461. https://doi.org/10.1523/JNEUROSCI.2908-03.2004

Dynamic Analysis of Learning in Behavioral Experiments. / Smith, Anne C.; Frank, Loren M.; Wirth, Sylvia; Yanike, Marianna; Hu, Dan; Kubota, Yasuo; Graybiel, Ann M.; Suzuki, Wendy; Brown, Emery N.

In: Journal of Neuroscience, Vol. 24, No. 2, 14.01.2004, p. 447-461.

Research output: Contribution to journalArticle

Smith, AC, Frank, LM, Wirth, S, Yanike, M, Hu, D, Kubota, Y, Graybiel, AM, Suzuki, W & Brown, EN 2004, 'Dynamic Analysis of Learning in Behavioral Experiments', Journal of Neuroscience, vol. 24, no. 2, pp. 447-461. https://doi.org/10.1523/JNEUROSCI.2908-03.2004
Smith AC, Frank LM, Wirth S, Yanike M, Hu D, Kubota Y et al. Dynamic Analysis of Learning in Behavioral Experiments. Journal of Neuroscience. 2004 Jan 14;24(2):447-461. https://doi.org/10.1523/JNEUROSCI.2908-03.2004
Smith, Anne C. ; Frank, Loren M. ; Wirth, Sylvia ; Yanike, Marianna ; Hu, Dan ; Kubota, Yasuo ; Graybiel, Ann M. ; Suzuki, Wendy ; Brown, Emery N. / Dynamic Analysis of Learning in Behavioral Experiments. In: Journal of Neuroscience. 2004 ; Vol. 24, No. 2. pp. 447-461.
@article{40ca7bcab7e1497588cef9e7f13e9d33,
title = "Dynamic Analysis of Learning in Behavioral Experiments",
abstract = "Understanding how an animal's ability to learn relates to neural activity or is altered by lesions, different attentional states, pharmacological interventions, or genetic manipulations are central questions in neuroscience. Although learning is a dynamic process, current analyses do not use dynamic estimation methods, require many trials across many animals to establish the occurrence of learning, and provide no consensus as how best to identify when learning has occurred. We develop a state-space model paradigm to characterize learning as the probability of a correct response as a function of trial number (learning curve). We compute the learning curve and its confidence intervals using a state-space smoothing algorithm and define the learning trial as the first trial on which there is reasonable certainty (>0.95) that a subject performs better than chance for the balance of the experiment. For a range of simulated learning experiments, the smoothing algorithm estimated learning curves with smaller mean integrated squared error and identified the learning trials with greater reliability than commonly used methods. The smoothing algorithm tracked easily the rapid learning of a monkey during a single session of an association learning experiment and identified learning 2 to 4 d earlier than accepted criteria for a rat in a 47 d procedural learning experiment. Our state-space paradigm estimates learning curves for single animals, gives a precise definition of learning, and suggests a coherent statistical framework for the design and analysis of learning experiments that could reduce the number of animals and trials per animal that these studies require.",
keywords = "Association task, Behavior, Change-point test, EM algorithm, Hidden Markov model, Learning, State-space model",
author = "Smith, {Anne C.} and Frank, {Loren M.} and Sylvia Wirth and Marianna Yanike and Dan Hu and Yasuo Kubota and Graybiel, {Ann M.} and Wendy Suzuki and Brown, {Emery N.}",
year = "2004",
month = "1",
day = "14",
doi = "10.1523/JNEUROSCI.2908-03.2004",
language = "English (US)",
volume = "24",
pages = "447--461",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "2",

}

TY - JOUR

T1 - Dynamic Analysis of Learning in Behavioral Experiments

AU - Smith, Anne C.

AU - Frank, Loren M.

AU - Wirth, Sylvia

AU - Yanike, Marianna

AU - Hu, Dan

AU - Kubota, Yasuo

AU - Graybiel, Ann M.

AU - Suzuki, Wendy

AU - Brown, Emery N.

PY - 2004/1/14

Y1 - 2004/1/14

N2 - Understanding how an animal's ability to learn relates to neural activity or is altered by lesions, different attentional states, pharmacological interventions, or genetic manipulations are central questions in neuroscience. Although learning is a dynamic process, current analyses do not use dynamic estimation methods, require many trials across many animals to establish the occurrence of learning, and provide no consensus as how best to identify when learning has occurred. We develop a state-space model paradigm to characterize learning as the probability of a correct response as a function of trial number (learning curve). We compute the learning curve and its confidence intervals using a state-space smoothing algorithm and define the learning trial as the first trial on which there is reasonable certainty (>0.95) that a subject performs better than chance for the balance of the experiment. For a range of simulated learning experiments, the smoothing algorithm estimated learning curves with smaller mean integrated squared error and identified the learning trials with greater reliability than commonly used methods. The smoothing algorithm tracked easily the rapid learning of a monkey during a single session of an association learning experiment and identified learning 2 to 4 d earlier than accepted criteria for a rat in a 47 d procedural learning experiment. Our state-space paradigm estimates learning curves for single animals, gives a precise definition of learning, and suggests a coherent statistical framework for the design and analysis of learning experiments that could reduce the number of animals and trials per animal that these studies require.

AB - Understanding how an animal's ability to learn relates to neural activity or is altered by lesions, different attentional states, pharmacological interventions, or genetic manipulations are central questions in neuroscience. Although learning is a dynamic process, current analyses do not use dynamic estimation methods, require many trials across many animals to establish the occurrence of learning, and provide no consensus as how best to identify when learning has occurred. We develop a state-space model paradigm to characterize learning as the probability of a correct response as a function of trial number (learning curve). We compute the learning curve and its confidence intervals using a state-space smoothing algorithm and define the learning trial as the first trial on which there is reasonable certainty (>0.95) that a subject performs better than chance for the balance of the experiment. For a range of simulated learning experiments, the smoothing algorithm estimated learning curves with smaller mean integrated squared error and identified the learning trials with greater reliability than commonly used methods. The smoothing algorithm tracked easily the rapid learning of a monkey during a single session of an association learning experiment and identified learning 2 to 4 d earlier than accepted criteria for a rat in a 47 d procedural learning experiment. Our state-space paradigm estimates learning curves for single animals, gives a precise definition of learning, and suggests a coherent statistical framework for the design and analysis of learning experiments that could reduce the number of animals and trials per animal that these studies require.

KW - Association task

KW - Behavior

KW - Change-point test

KW - EM algorithm

KW - Hidden Markov model

KW - Learning

KW - State-space model

UR - http://www.scopus.com/inward/record.url?scp=1642458166&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=1642458166&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.2908-03.2004

DO - 10.1523/JNEUROSCI.2908-03.2004

M3 - Article

C2 - 14724243

AN - SCOPUS:1642458166

VL - 24

SP - 447

EP - 461

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 2

ER -