Characterizing learning by simultaneous analysis of continuous and binary measures of performance

M. J. Prerau, A. C. Smith, Uri T. Eden, Y. Kubota, M. Yanike, Wendy Suzuki, A. M. Graybiel, E. N. Brown

Research output: Contribution to journalArticle

Abstract

Continuous observations, such as reaction and run times, and binary observations, such as correct/incorrect responses, are recorded routinely in behavioral learning experiments. Although both types of performance measures are often recorded simultaneously, the two have not been used in combination to evaluate learning. We present a state-space model of learning in which the observation process has simultaneously recorded continuous and binary measures of performance. We use these performance measures simultaneously to estimate the model parameters and the unobserved cognitive state process by maximum likelihood using an approximate expectation maximization (EM) algorithm. We introduce the concept of a reaction-time curve and reformulate our previous definitions of the learning curve, the ideal observer curve, the learning trial and between-trial comparisons of performance in terms of the new model. We illustrate the properties of the new model in an analysis of a simulated learning experiment. In the simulated data analysis, simultaneous use of the two measures of performance provided more credible and accurate estimates of the learning than either measure analyzed separately. We also analyze two actual learning experiments in which the performance of rats and of monkeys was tracked across trials by simultaneously recorded reaction and run times and the correct and incorrect responses. In the analysis of the actual experiments, our algorithm gave a straightforward, efficient way to characterize learning by combining continuous and binary measures of performance. This analysis paradigm has implications for characterizing learning and for the more general problem of combining different data types to characterize the properties of a neural system.

Original languageEnglish (US)
Pages (from-to)3060-3072
Number of pages13
JournalJournal of Neurophysiology
Volume102
Issue number5
DOIs
StatePublished - Nov 2009

Fingerprint

Learning
Learning Curve
Space Simulation
Reaction Time
Haplorhini
Observation

ASJC Scopus subject areas

  • Physiology
  • Neuroscience(all)

Cite this

Characterizing learning by simultaneous analysis of continuous and binary measures of performance. / Prerau, M. J.; Smith, A. C.; Eden, Uri T.; Kubota, Y.; Yanike, M.; Suzuki, Wendy; Graybiel, A. M.; Brown, E. N.

In: Journal of Neurophysiology, Vol. 102, No. 5, 11.2009, p. 3060-3072.

Research output: Contribution to journalArticle

Prerau, MJ, Smith, AC, Eden, UT, Kubota, Y, Yanike, M, Suzuki, W, Graybiel, AM & Brown, EN 2009, 'Characterizing learning by simultaneous analysis of continuous and binary measures of performance', Journal of Neurophysiology, vol. 102, no. 5, pp. 3060-3072. https://doi.org/10.1152/jn.91251.2008
Prerau, M. J. ; Smith, A. C. ; Eden, Uri T. ; Kubota, Y. ; Yanike, M. ; Suzuki, Wendy ; Graybiel, A. M. ; Brown, E. N. / Characterizing learning by simultaneous analysis of continuous and binary measures of performance. In: Journal of Neurophysiology. 2009 ; Vol. 102, No. 5. pp. 3060-3072.
@article{125aecb8f40643f09d13f7c5c6cfdd8c,
title = "Characterizing learning by simultaneous analysis of continuous and binary measures of performance",
abstract = "Continuous observations, such as reaction and run times, and binary observations, such as correct/incorrect responses, are recorded routinely in behavioral learning experiments. Although both types of performance measures are often recorded simultaneously, the two have not been used in combination to evaluate learning. We present a state-space model of learning in which the observation process has simultaneously recorded continuous and binary measures of performance. We use these performance measures simultaneously to estimate the model parameters and the unobserved cognitive state process by maximum likelihood using an approximate expectation maximization (EM) algorithm. We introduce the concept of a reaction-time curve and reformulate our previous definitions of the learning curve, the ideal observer curve, the learning trial and between-trial comparisons of performance in terms of the new model. We illustrate the properties of the new model in an analysis of a simulated learning experiment. In the simulated data analysis, simultaneous use of the two measures of performance provided more credible and accurate estimates of the learning than either measure analyzed separately. We also analyze two actual learning experiments in which the performance of rats and of monkeys was tracked across trials by simultaneously recorded reaction and run times and the correct and incorrect responses. In the analysis of the actual experiments, our algorithm gave a straightforward, efficient way to characterize learning by combining continuous and binary measures of performance. This analysis paradigm has implications for characterizing learning and for the more general problem of combining different data types to characterize the properties of a neural system.",
author = "Prerau, {M. J.} and Smith, {A. C.} and Eden, {Uri T.} and Y. Kubota and M. Yanike and Wendy Suzuki and Graybiel, {A. M.} and Brown, {E. N.}",
year = "2009",
month = "11",
doi = "10.1152/jn.91251.2008",
language = "English (US)",
volume = "102",
pages = "3060--3072",
journal = "Journal of Neurophysiology",
issn = "0022-3077",
publisher = "American Physiological Society",
number = "5",

}

TY - JOUR

T1 - Characterizing learning by simultaneous analysis of continuous and binary measures of performance

AU - Prerau, M. J.

AU - Smith, A. C.

AU - Eden, Uri T.

AU - Kubota, Y.

AU - Yanike, M.

AU - Suzuki, Wendy

AU - Graybiel, A. M.

AU - Brown, E. N.

PY - 2009/11

Y1 - 2009/11

N2 - Continuous observations, such as reaction and run times, and binary observations, such as correct/incorrect responses, are recorded routinely in behavioral learning experiments. Although both types of performance measures are often recorded simultaneously, the two have not been used in combination to evaluate learning. We present a state-space model of learning in which the observation process has simultaneously recorded continuous and binary measures of performance. We use these performance measures simultaneously to estimate the model parameters and the unobserved cognitive state process by maximum likelihood using an approximate expectation maximization (EM) algorithm. We introduce the concept of a reaction-time curve and reformulate our previous definitions of the learning curve, the ideal observer curve, the learning trial and between-trial comparisons of performance in terms of the new model. We illustrate the properties of the new model in an analysis of a simulated learning experiment. In the simulated data analysis, simultaneous use of the two measures of performance provided more credible and accurate estimates of the learning than either measure analyzed separately. We also analyze two actual learning experiments in which the performance of rats and of monkeys was tracked across trials by simultaneously recorded reaction and run times and the correct and incorrect responses. In the analysis of the actual experiments, our algorithm gave a straightforward, efficient way to characterize learning by combining continuous and binary measures of performance. This analysis paradigm has implications for characterizing learning and for the more general problem of combining different data types to characterize the properties of a neural system.

AB - Continuous observations, such as reaction and run times, and binary observations, such as correct/incorrect responses, are recorded routinely in behavioral learning experiments. Although both types of performance measures are often recorded simultaneously, the two have not been used in combination to evaluate learning. We present a state-space model of learning in which the observation process has simultaneously recorded continuous and binary measures of performance. We use these performance measures simultaneously to estimate the model parameters and the unobserved cognitive state process by maximum likelihood using an approximate expectation maximization (EM) algorithm. We introduce the concept of a reaction-time curve and reformulate our previous definitions of the learning curve, the ideal observer curve, the learning trial and between-trial comparisons of performance in terms of the new model. We illustrate the properties of the new model in an analysis of a simulated learning experiment. In the simulated data analysis, simultaneous use of the two measures of performance provided more credible and accurate estimates of the learning than either measure analyzed separately. We also analyze two actual learning experiments in which the performance of rats and of monkeys was tracked across trials by simultaneously recorded reaction and run times and the correct and incorrect responses. In the analysis of the actual experiments, our algorithm gave a straightforward, efficient way to characterize learning by combining continuous and binary measures of performance. This analysis paradigm has implications for characterizing learning and for the more general problem of combining different data types to characterize the properties of a neural system.

UR - http://www.scopus.com/inward/record.url?scp=70449433587&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70449433587&partnerID=8YFLogxK

U2 - 10.1152/jn.91251.2008

DO - 10.1152/jn.91251.2008

M3 - Article

VL - 102

SP - 3060

EP - 3072

JO - Journal of Neurophysiology

JF - Journal of Neurophysiology

SN - 0022-3077

IS - 5

ER -