Semi-rational models of conditioning

The case of trial order

Nathaniel D. Daw, Aaron C. Courville, Peter Dayan

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

This chapter considers the question of how learning adapts to changing environments, with particular reference to animal studies of operant and classical conditioning. It discusses a variety of probabilistic models, with different assumptions concerning the environment; and contrasts this type of model with a model by Kruschke (2006) which carries out local, approximate, Bayesian inference. It further suggests that it may be too early to incorporate mechanistic limitations into models of conditioning - enriching the understanding of the environment, and working with a 'pure' Bayesian rational analysis for that environment, may provide an alternative, and perhaps theoretically more elegant, way forward.

Original languageEnglish (US)
Title of host publicationThe Probabilistic Mind: Prospects for Bayesian cognitive science
PublisherOxford University Press
ISBN (Print)9780191695971, 9780199216093
DOIs
StatePublished - Mar 22 2012

Fingerprint

Operant Conditioning
Classical Conditioning
Bayes Theorem
Statistical Models
Learning
Conditioning (Psychology)

Keywords

  • Animal studies
  • Bayesian inference
  • Conditioning
  • Environment
  • Kruschke
  • Learning

ASJC Scopus subject areas

  • Psychology(all)

Cite this

Daw, N. D., Courville, A. C., & Dayan, P. (2012). Semi-rational models of conditioning: The case of trial order. In The Probabilistic Mind: Prospects for Bayesian cognitive science Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199216093.003.0019

Semi-rational models of conditioning : The case of trial order. / Daw, Nathaniel D.; Courville, Aaron C.; Dayan, Peter.

The Probabilistic Mind: Prospects for Bayesian cognitive science. Oxford University Press, 2012.

Research output: Chapter in Book/Report/Conference proceedingChapter

Daw, ND, Courville, AC & Dayan, P 2012, Semi-rational models of conditioning: The case of trial order. in The Probabilistic Mind: Prospects for Bayesian cognitive science. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199216093.003.0019
Daw ND, Courville AC, Dayan P. Semi-rational models of conditioning: The case of trial order. In The Probabilistic Mind: Prospects for Bayesian cognitive science. Oxford University Press. 2012 https://doi.org/10.1093/acprof:oso/9780199216093.003.0019
Daw, Nathaniel D. ; Courville, Aaron C. ; Dayan, Peter. / Semi-rational models of conditioning : The case of trial order. The Probabilistic Mind: Prospects for Bayesian cognitive science. Oxford University Press, 2012.
@inbook{ac2b4ff1ba6e46f1b2992f3b7353186a,
title = "Semi-rational models of conditioning: The case of trial order",
abstract = "This chapter considers the question of how learning adapts to changing environments, with particular reference to animal studies of operant and classical conditioning. It discusses a variety of probabilistic models, with different assumptions concerning the environment; and contrasts this type of model with a model by Kruschke (2006) which carries out local, approximate, Bayesian inference. It further suggests that it may be too early to incorporate mechanistic limitations into models of conditioning - enriching the understanding of the environment, and working with a 'pure' Bayesian rational analysis for that environment, may provide an alternative, and perhaps theoretically more elegant, way forward.",
keywords = "Animal studies, Bayesian inference, Conditioning, Environment, Kruschke, Learning",
author = "Daw, {Nathaniel D.} and Courville, {Aaron C.} and Peter Dayan",
year = "2012",
month = "3",
day = "22",
doi = "10.1093/acprof:oso/9780199216093.003.0019",
language = "English (US)",
isbn = "9780191695971",
booktitle = "The Probabilistic Mind: Prospects for Bayesian cognitive science",
publisher = "Oxford University Press",

}

TY - CHAP

T1 - Semi-rational models of conditioning

T2 - The case of trial order

AU - Daw, Nathaniel D.

AU - Courville, Aaron C.

AU - Dayan, Peter

PY - 2012/3/22

Y1 - 2012/3/22

N2 - This chapter considers the question of how learning adapts to changing environments, with particular reference to animal studies of operant and classical conditioning. It discusses a variety of probabilistic models, with different assumptions concerning the environment; and contrasts this type of model with a model by Kruschke (2006) which carries out local, approximate, Bayesian inference. It further suggests that it may be too early to incorporate mechanistic limitations into models of conditioning - enriching the understanding of the environment, and working with a 'pure' Bayesian rational analysis for that environment, may provide an alternative, and perhaps theoretically more elegant, way forward.

AB - This chapter considers the question of how learning adapts to changing environments, with particular reference to animal studies of operant and classical conditioning. It discusses a variety of probabilistic models, with different assumptions concerning the environment; and contrasts this type of model with a model by Kruschke (2006) which carries out local, approximate, Bayesian inference. It further suggests that it may be too early to incorporate mechanistic limitations into models of conditioning - enriching the understanding of the environment, and working with a 'pure' Bayesian rational analysis for that environment, may provide an alternative, and perhaps theoretically more elegant, way forward.

KW - Animal studies

KW - Bayesian inference

KW - Conditioning

KW - Environment

KW - Kruschke

KW - Learning

UR - http://www.scopus.com/inward/record.url?scp=84922761372&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84922761372&partnerID=8YFLogxK

U2 - 10.1093/acprof:oso/9780199216093.003.0019

DO - 10.1093/acprof:oso/9780199216093.003.0019

M3 - Chapter

SN - 9780191695971

SN - 9780199216093

BT - The Probabilistic Mind: Prospects for Bayesian cognitive science

PB - Oxford University Press

ER -