The effect of item pool restriction on the precision of ability measurement for a Rasch-based CAT

comparisons to traditional fixed length examinations.

P. N. Halkitis

Research output: Contribution to journalArticle

Abstract

This paper describes a method for examining the precision of a computerized adaptive test with a limited item pool. Standard errors of measurement ascertained in the testing of simulees with a CAT using a restricted pool were compared to the results obtained in a live paper-and-pencil achievement testing of 4494 nursing students on four versions of an examination of calculations of drug administration. CAT measures of precision were considered when the simulated examine pools were uniform and normal. Precision indices were also considered in terms of the number of CAT items required to reach the precision of the traditional tests. Results suggest that regardless of the size of the item pool, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited but fails to achieve equiprecision along the entire ability continuum.

Original languageEnglish (US)
Pages (from-to)97-122
Number of pages26
JournalJournal of outcome measurement
Volume2
Issue number2
StatePublished - 1998

Fingerprint

Aptitude
Nursing Students
Pharmaceutical Preparations

Cite this

@article{d816008dc3b346f89d74eb5ddeff7f3a,
title = "The effect of item pool restriction on the precision of ability measurement for a Rasch-based CAT: comparisons to traditional fixed length examinations.",
abstract = "This paper describes a method for examining the precision of a computerized adaptive test with a limited item pool. Standard errors of measurement ascertained in the testing of simulees with a CAT using a restricted pool were compared to the results obtained in a live paper-and-pencil achievement testing of 4494 nursing students on four versions of an examination of calculations of drug administration. CAT measures of precision were considered when the simulated examine pools were uniform and normal. Precision indices were also considered in terms of the number of CAT items required to reach the precision of the traditional tests. Results suggest that regardless of the size of the item pool, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited but fails to achieve equiprecision along the entire ability continuum.",
author = "Halkitis, {P. N.}",
year = "1998",
language = "English (US)",
volume = "2",
pages = "97--122",
journal = "Journal of outcome measurement",
issn = "1090-655X",
publisher = "Rehabilitation Foundation",
number = "2",

}

TY - JOUR

T1 - The effect of item pool restriction on the precision of ability measurement for a Rasch-based CAT

T2 - comparisons to traditional fixed length examinations.

AU - Halkitis, P. N.

PY - 1998

Y1 - 1998

N2 - This paper describes a method for examining the precision of a computerized adaptive test with a limited item pool. Standard errors of measurement ascertained in the testing of simulees with a CAT using a restricted pool were compared to the results obtained in a live paper-and-pencil achievement testing of 4494 nursing students on four versions of an examination of calculations of drug administration. CAT measures of precision were considered when the simulated examine pools were uniform and normal. Precision indices were also considered in terms of the number of CAT items required to reach the precision of the traditional tests. Results suggest that regardless of the size of the item pool, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited but fails to achieve equiprecision along the entire ability continuum.

AB - This paper describes a method for examining the precision of a computerized adaptive test with a limited item pool. Standard errors of measurement ascertained in the testing of simulees with a CAT using a restricted pool were compared to the results obtained in a live paper-and-pencil achievement testing of 4494 nursing students on four versions of an examination of calculations of drug administration. CAT measures of precision were considered when the simulated examine pools were uniform and normal. Precision indices were also considered in terms of the number of CAT items required to reach the precision of the traditional tests. Results suggest that regardless of the size of the item pool, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited but fails to achieve equiprecision along the entire ability continuum.

UR - http://www.scopus.com/inward/record.url?scp=0031616469&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031616469&partnerID=8YFLogxK

M3 - Article

VL - 2

SP - 97

EP - 122

JO - Journal of outcome measurement

JF - Journal of outcome measurement

SN - 1090-655X

IS - 2

ER -