Bayesian theories of conditioning in a changing world

Aaron C. Courville, Nathaniel D. Daw, David S. Touretzky

Research output: Contribution to journalArticle

Abstract

The recent flowering of Bayesian approaches invites the re-examination of classic issues in behavior, even in areas as venerable as Pavlovian conditioning. A statistical account can offer a new, principled interpretation of behavior, and previous experiments and theories can inform many unexplored aspects of the Bayesian enterprise. Here we consider one such issue: the finding that surprising events provoke animals to learn faster. We suggest that, in a statistical account of conditioning, surprise signals change and therefore uncertainty and the need for new learning. We discuss inference in a world that changes and show how experimental results involving surprise can be interpreted from this perspective, and also how, thus understood, these phenomena help constrain statistical theories of animal and human learning.

Original languageEnglish (US)
Pages (from-to)294-300
Number of pages7
JournalTrends in Cognitive Sciences
Volume10
Issue number7
DOIs
StatePublished - Jul 2006

Fingerprint

Learning
Bayes Theorem
Uncertainty
Conditioning (Psychology)

ASJC Scopus subject areas

  • Cognitive Neuroscience

Cite this

Bayesian theories of conditioning in a changing world. / Courville, Aaron C.; Daw, Nathaniel D.; Touretzky, David S.

In: Trends in Cognitive Sciences, Vol. 10, No. 7, 07.2006, p. 294-300.

Research output: Contribution to journalArticle

Courville, Aaron C. ; Daw, Nathaniel D. ; Touretzky, David S. / Bayesian theories of conditioning in a changing world. In: Trends in Cognitive Sciences. 2006 ; Vol. 10, No. 7. pp. 294-300.
@article{6aade88132424b8292cc750700950b26,
title = "Bayesian theories of conditioning in a changing world",
abstract = "The recent flowering of Bayesian approaches invites the re-examination of classic issues in behavior, even in areas as venerable as Pavlovian conditioning. A statistical account can offer a new, principled interpretation of behavior, and previous experiments and theories can inform many unexplored aspects of the Bayesian enterprise. Here we consider one such issue: the finding that surprising events provoke animals to learn faster. We suggest that, in a statistical account of conditioning, surprise signals change and therefore uncertainty and the need for new learning. We discuss inference in a world that changes and show how experimental results involving surprise can be interpreted from this perspective, and also how, thus understood, these phenomena help constrain statistical theories of animal and human learning.",
author = "Courville, {Aaron C.} and Daw, {Nathaniel D.} and Touretzky, {David S.}",
year = "2006",
month = "7",
doi = "10.1016/j.tics.2006.05.004",
language = "English (US)",
volume = "10",
pages = "294--300",
journal = "Trends in Cognitive Sciences",
issn = "1364-6613",
publisher = "Elsevier Limited",
number = "7",

}

TY - JOUR

T1 - Bayesian theories of conditioning in a changing world

AU - Courville, Aaron C.

AU - Daw, Nathaniel D.

AU - Touretzky, David S.

PY - 2006/7

Y1 - 2006/7

N2 - The recent flowering of Bayesian approaches invites the re-examination of classic issues in behavior, even in areas as venerable as Pavlovian conditioning. A statistical account can offer a new, principled interpretation of behavior, and previous experiments and theories can inform many unexplored aspects of the Bayesian enterprise. Here we consider one such issue: the finding that surprising events provoke animals to learn faster. We suggest that, in a statistical account of conditioning, surprise signals change and therefore uncertainty and the need for new learning. We discuss inference in a world that changes and show how experimental results involving surprise can be interpreted from this perspective, and also how, thus understood, these phenomena help constrain statistical theories of animal and human learning.

AB - The recent flowering of Bayesian approaches invites the re-examination of classic issues in behavior, even in areas as venerable as Pavlovian conditioning. A statistical account can offer a new, principled interpretation of behavior, and previous experiments and theories can inform many unexplored aspects of the Bayesian enterprise. Here we consider one such issue: the finding that surprising events provoke animals to learn faster. We suggest that, in a statistical account of conditioning, surprise signals change and therefore uncertainty and the need for new learning. We discuss inference in a world that changes and show how experimental results involving surprise can be interpreted from this perspective, and also how, thus understood, these phenomena help constrain statistical theories of animal and human learning.

UR - http://www.scopus.com/inward/record.url?scp=33746365099&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33746365099&partnerID=8YFLogxK

U2 - 10.1016/j.tics.2006.05.004

DO - 10.1016/j.tics.2006.05.004

M3 - Article

VL - 10

SP - 294

EP - 300

JO - Trends in Cognitive Sciences

JF - Trends in Cognitive Sciences

SN - 1364-6613

IS - 7

ER -