Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement

Rudolf N. Cardinal, Nathaniel Daw, Trevor W. Robbins, Barry J. Everitt

Research output: Contribution to journalArticle

Abstract

The adjusting-delay task introduced by Mazur (Quantitative analyses of behavior: V. The effect of delay and of intervening events on reinforcement value, 1987, pp. 55-73) has been widely used to study choice of delayed reinforcers. This paradigm involves repeated choice between one reinforcer delivered after a fixed delay and another, typically larger, reinforcer delivered after a variable delay; the variable delay is adjusted depending on the subject's choice until an equilibrium point is reached at which the subject is indifferent between the two alternatives. Rats were trained on a version of this task and their behaviour was examined to determine the nature of their sensitivity to the adjusting delay; these analyses included the use of a cross-correlational technique. No clear evidence of sensitivity to the adjusting delay was found. A number of decision rules, some sensitive to the adjusting delay and some not, were simulated and it was observed that some effects usually supposed to be a consequence of delay sensitivity could be generated by delay-independent processes, such as a consistent, unchanging relative preference between the alternatives. Consequently, the use of explicit analysis of delay sensitivity is advocated in future research on delayed reinforcement.

Original languageEnglish (US)
Pages (from-to)617-634
Number of pages18
JournalNeural Networks
Volume15
Issue number4-6
DOIs
StatePublished - Jun 2002

Fingerprint

Reinforcement
Rats
Reinforcement (Psychology)

Keywords

  • Adjusting-delay task
  • Cross-correlation
  • Delay of reinforcement
  • Impulsivity
  • Lever pressing
  • Rats

ASJC Scopus subject areas

  • Artificial Intelligence
  • Neuroscience(all)

Cite this

Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement. / Cardinal, Rudolf N.; Daw, Nathaniel; Robbins, Trevor W.; Everitt, Barry J.

In: Neural Networks, Vol. 15, No. 4-6, 06.2002, p. 617-634.

Research output: Contribution to journalArticle

Cardinal, Rudolf N. ; Daw, Nathaniel ; Robbins, Trevor W. ; Everitt, Barry J. / Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement. In: Neural Networks. 2002 ; Vol. 15, No. 4-6. pp. 617-634.
@article{6a438cbd08b24600bf0df09a81ded5b6,
title = "Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement",
abstract = "The adjusting-delay task introduced by Mazur (Quantitative analyses of behavior: V. The effect of delay and of intervening events on reinforcement value, 1987, pp. 55-73) has been widely used to study choice of delayed reinforcers. This paradigm involves repeated choice between one reinforcer delivered after a fixed delay and another, typically larger, reinforcer delivered after a variable delay; the variable delay is adjusted depending on the subject's choice until an equilibrium point is reached at which the subject is indifferent between the two alternatives. Rats were trained on a version of this task and their behaviour was examined to determine the nature of their sensitivity to the adjusting delay; these analyses included the use of a cross-correlational technique. No clear evidence of sensitivity to the adjusting delay was found. A number of decision rules, some sensitive to the adjusting delay and some not, were simulated and it was observed that some effects usually supposed to be a consequence of delay sensitivity could be generated by delay-independent processes, such as a consistent, unchanging relative preference between the alternatives. Consequently, the use of explicit analysis of delay sensitivity is advocated in future research on delayed reinforcement.",
keywords = "Adjusting-delay task, Cross-correlation, Delay of reinforcement, Impulsivity, Lever pressing, Rats",
author = "Cardinal, {Rudolf N.} and Nathaniel Daw and Robbins, {Trevor W.} and Everitt, {Barry J.}",
year = "2002",
month = "6",
doi = "10.1016/S0893-6080(02)00053-9",
language = "English (US)",
volume = "15",
pages = "617--634",
journal = "Neural Networks",
issn = "0893-6080",
publisher = "Elsevier Limited",
number = "4-6",

}

TY - JOUR

T1 - Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement

AU - Cardinal, Rudolf N.

AU - Daw, Nathaniel

AU - Robbins, Trevor W.

AU - Everitt, Barry J.

PY - 2002/6

Y1 - 2002/6

N2 - The adjusting-delay task introduced by Mazur (Quantitative analyses of behavior: V. The effect of delay and of intervening events on reinforcement value, 1987, pp. 55-73) has been widely used to study choice of delayed reinforcers. This paradigm involves repeated choice between one reinforcer delivered after a fixed delay and another, typically larger, reinforcer delivered after a variable delay; the variable delay is adjusted depending on the subject's choice until an equilibrium point is reached at which the subject is indifferent between the two alternatives. Rats were trained on a version of this task and their behaviour was examined to determine the nature of their sensitivity to the adjusting delay; these analyses included the use of a cross-correlational technique. No clear evidence of sensitivity to the adjusting delay was found. A number of decision rules, some sensitive to the adjusting delay and some not, were simulated and it was observed that some effects usually supposed to be a consequence of delay sensitivity could be generated by delay-independent processes, such as a consistent, unchanging relative preference between the alternatives. Consequently, the use of explicit analysis of delay sensitivity is advocated in future research on delayed reinforcement.

AB - The adjusting-delay task introduced by Mazur (Quantitative analyses of behavior: V. The effect of delay and of intervening events on reinforcement value, 1987, pp. 55-73) has been widely used to study choice of delayed reinforcers. This paradigm involves repeated choice between one reinforcer delivered after a fixed delay and another, typically larger, reinforcer delivered after a variable delay; the variable delay is adjusted depending on the subject's choice until an equilibrium point is reached at which the subject is indifferent between the two alternatives. Rats were trained on a version of this task and their behaviour was examined to determine the nature of their sensitivity to the adjusting delay; these analyses included the use of a cross-correlational technique. No clear evidence of sensitivity to the adjusting delay was found. A number of decision rules, some sensitive to the adjusting delay and some not, were simulated and it was observed that some effects usually supposed to be a consequence of delay sensitivity could be generated by delay-independent processes, such as a consistent, unchanging relative preference between the alternatives. Consequently, the use of explicit analysis of delay sensitivity is advocated in future research on delayed reinforcement.

KW - Adjusting-delay task

KW - Cross-correlation

KW - Delay of reinforcement

KW - Impulsivity

KW - Lever pressing

KW - Rats

UR - http://www.scopus.com/inward/record.url?scp=0036592009&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036592009&partnerID=8YFLogxK

U2 - 10.1016/S0893-6080(02)00053-9

DO - 10.1016/S0893-6080(02)00053-9

M3 - Article

VL - 15

SP - 617

EP - 634

JO - Neural Networks

JF - Neural Networks

SN - 0893-6080

IS - 4-6

ER -