Integrating Item Accuracy and Reaction Time to Improve the Measurement of Inhibitory Control Abilities in Early Childhood

Brooke E. Magnus, Michael T. Willoughby, Clancy Blair, Laura J. Kuhn

Research output: Contribution to journalArticle

Abstract

Efforts to improve children’s executive function are often hampered by the lack of measures that are optimized for use during the transition from preschool to elementary school. Whereas preschool-based measures often emphasize response accuracy, elementary school-based measures emphasize reaction time (RT)—especially for measures inhibitory control (IC) tasks that typically have a speeded component. The primary objective of this study was to test in a preschool-aged sample whether the joint use of item-level accuracy and RT data resulted in improved scoring for three IC tasks relative to scores derived from accuracy data alone. Generally, the joint use of item-level accuracy and RT data resulted in modest improvements in the measurement precision of IC abilities. Moreover, the joint use of item-level accuracy and RT helped eliminate floor and ceiling effects that occurred when accuracy data were considered alone. Results are discussed with respect to the importance of scoring IC tasks in ways that are maximally informative for program evaluation and longitudinal modeling.

Original languageEnglish (US)
JournalAssessment
DOIs
StateAccepted/In press - Nov 1 2017

Fingerprint

Aptitude
Reaction Time
Joints
Executive Function
Program Evaluation

Keywords

  • executive function
  • inhibitory control
  • psychometrics
  • reaction time
  • task scoring

ASJC Scopus subject areas

  • Clinical Psychology
  • Applied Psychology

Cite this

Integrating Item Accuracy and Reaction Time to Improve the Measurement of Inhibitory Control Abilities in Early Childhood. / Magnus, Brooke E.; Willoughby, Michael T.; Blair, Clancy; Kuhn, Laura J.

In: Assessment, 01.11.2017.

Research output: Contribution to journalArticle

@article{eb180cd5348145aaa97ce7af85e59fe7,
title = "Integrating Item Accuracy and Reaction Time to Improve the Measurement of Inhibitory Control Abilities in Early Childhood",
abstract = "Efforts to improve children’s executive function are often hampered by the lack of measures that are optimized for use during the transition from preschool to elementary school. Whereas preschool-based measures often emphasize response accuracy, elementary school-based measures emphasize reaction time (RT)—especially for measures inhibitory control (IC) tasks that typically have a speeded component. The primary objective of this study was to test in a preschool-aged sample whether the joint use of item-level accuracy and RT data resulted in improved scoring for three IC tasks relative to scores derived from accuracy data alone. Generally, the joint use of item-level accuracy and RT data resulted in modest improvements in the measurement precision of IC abilities. Moreover, the joint use of item-level accuracy and RT helped eliminate floor and ceiling effects that occurred when accuracy data were considered alone. Results are discussed with respect to the importance of scoring IC tasks in ways that are maximally informative for program evaluation and longitudinal modeling.",
keywords = "executive function, inhibitory control, psychometrics, reaction time, task scoring",
author = "Magnus, {Brooke E.} and Willoughby, {Michael T.} and Clancy Blair and Kuhn, {Laura J.}",
year = "2017",
month = "11",
day = "1",
doi = "10.1177/1073191117740953",
language = "English (US)",
journal = "Assessment",
issn = "1073-1911",
publisher = "SAGE Publications Inc.",

}

TY - JOUR

T1 - Integrating Item Accuracy and Reaction Time to Improve the Measurement of Inhibitory Control Abilities in Early Childhood

AU - Magnus, Brooke E.

AU - Willoughby, Michael T.

AU - Blair, Clancy

AU - Kuhn, Laura J.

PY - 2017/11/1

Y1 - 2017/11/1

N2 - Efforts to improve children’s executive function are often hampered by the lack of measures that are optimized for use during the transition from preschool to elementary school. Whereas preschool-based measures often emphasize response accuracy, elementary school-based measures emphasize reaction time (RT)—especially for measures inhibitory control (IC) tasks that typically have a speeded component. The primary objective of this study was to test in a preschool-aged sample whether the joint use of item-level accuracy and RT data resulted in improved scoring for three IC tasks relative to scores derived from accuracy data alone. Generally, the joint use of item-level accuracy and RT data resulted in modest improvements in the measurement precision of IC abilities. Moreover, the joint use of item-level accuracy and RT helped eliminate floor and ceiling effects that occurred when accuracy data were considered alone. Results are discussed with respect to the importance of scoring IC tasks in ways that are maximally informative for program evaluation and longitudinal modeling.

AB - Efforts to improve children’s executive function are often hampered by the lack of measures that are optimized for use during the transition from preschool to elementary school. Whereas preschool-based measures often emphasize response accuracy, elementary school-based measures emphasize reaction time (RT)—especially for measures inhibitory control (IC) tasks that typically have a speeded component. The primary objective of this study was to test in a preschool-aged sample whether the joint use of item-level accuracy and RT data resulted in improved scoring for three IC tasks relative to scores derived from accuracy data alone. Generally, the joint use of item-level accuracy and RT data resulted in modest improvements in the measurement precision of IC abilities. Moreover, the joint use of item-level accuracy and RT helped eliminate floor and ceiling effects that occurred when accuracy data were considered alone. Results are discussed with respect to the importance of scoring IC tasks in ways that are maximally informative for program evaluation and longitudinal modeling.

KW - executive function

KW - inhibitory control

KW - psychometrics

KW - reaction time

KW - task scoring

UR - http://www.scopus.com/inward/record.url?scp=85041626698&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041626698&partnerID=8YFLogxK

U2 - 10.1177/1073191117740953

DO - 10.1177/1073191117740953

M3 - Article

JO - Assessment

JF - Assessment

SN - 1073-1911

ER -