An Information Matrix Test for the Collapsing of Categories Under the Partial Credit Model

Daphna Harel, Russell J. Steele

Research output: Contribution to journalArticle

Abstract

Collapsing categories is a commonly used data reduction technique; however, to date there do not exist principled methods to determine whether collapsing categories is appropriate in practice. With ordinal responses under the partial credit model, when collapsing categories, the true model for the collapsed data is no longer a partial credit model, and therefore refitting a partial credit model may result in model misspecification. This article details the implementation and performance of an information matrix test (IMT) to assess the implications of collapsing categories for a given data set under the partial credit model and compares its performance to the application of a nominal response model (NRM) and the S − X2 goodness-of-fit statistic. The IMT and NRM-based test are able to correctly determine the true number of categories for an item, given reasonable power through this goodness-of-fit test. We conclude by applying the test to a well-studied data set from the literature.

Original languageEnglish (US)
JournalJournal of Educational and Behavioral Statistics
DOIs
StateAccepted/In press - Jan 1 2018

Fingerprint

credit
performance
statistics

Keywords

  • collapsing categories
  • information matrix test
  • item response theory
  • partial credit model

ASJC Scopus subject areas

  • Education
  • Social Sciences (miscellaneous)

Cite this

@article{26ddcaa2e8014582bf96412f33718462,
title = "An Information Matrix Test for the Collapsing of Categories Under the Partial Credit Model",
abstract = "Collapsing categories is a commonly used data reduction technique; however, to date there do not exist principled methods to determine whether collapsing categories is appropriate in practice. With ordinal responses under the partial credit model, when collapsing categories, the true model for the collapsed data is no longer a partial credit model, and therefore refitting a partial credit model may result in model misspecification. This article details the implementation and performance of an information matrix test (IMT) to assess the implications of collapsing categories for a given data set under the partial credit model and compares its performance to the application of a nominal response model (NRM) and the S − X2 goodness-of-fit statistic. The IMT and NRM-based test are able to correctly determine the true number of categories for an item, given reasonable power through this goodness-of-fit test. We conclude by applying the test to a well-studied data set from the literature.",
keywords = "collapsing categories, information matrix test, item response theory, partial credit model",
author = "Daphna Harel and Steele, {Russell J.}",
year = "2018",
month = "1",
day = "1",
doi = "10.3102/1076998618787478",
language = "English (US)",
journal = "Journal of Educational and Behavioral Statistics",
issn = "1076-9986",
publisher = "SAGE Publications Inc.",

}

TY - JOUR

T1 - An Information Matrix Test for the Collapsing of Categories Under the Partial Credit Model

AU - Harel, Daphna

AU - Steele, Russell J.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Collapsing categories is a commonly used data reduction technique; however, to date there do not exist principled methods to determine whether collapsing categories is appropriate in practice. With ordinal responses under the partial credit model, when collapsing categories, the true model for the collapsed data is no longer a partial credit model, and therefore refitting a partial credit model may result in model misspecification. This article details the implementation and performance of an information matrix test (IMT) to assess the implications of collapsing categories for a given data set under the partial credit model and compares its performance to the application of a nominal response model (NRM) and the S − X2 goodness-of-fit statistic. The IMT and NRM-based test are able to correctly determine the true number of categories for an item, given reasonable power through this goodness-of-fit test. We conclude by applying the test to a well-studied data set from the literature.

AB - Collapsing categories is a commonly used data reduction technique; however, to date there do not exist principled methods to determine whether collapsing categories is appropriate in practice. With ordinal responses under the partial credit model, when collapsing categories, the true model for the collapsed data is no longer a partial credit model, and therefore refitting a partial credit model may result in model misspecification. This article details the implementation and performance of an information matrix test (IMT) to assess the implications of collapsing categories for a given data set under the partial credit model and compares its performance to the application of a nominal response model (NRM) and the S − X2 goodness-of-fit statistic. The IMT and NRM-based test are able to correctly determine the true number of categories for an item, given reasonable power through this goodness-of-fit test. We conclude by applying the test to a well-studied data set from the literature.

KW - collapsing categories

KW - information matrix test

KW - item response theory

KW - partial credit model

UR - http://www.scopus.com/inward/record.url?scp=85050091737&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050091737&partnerID=8YFLogxK

U2 - 10.3102/1076998618787478

DO - 10.3102/1076998618787478

M3 - Article

JO - Journal of Educational and Behavioral Statistics

JF - Journal of Educational and Behavioral Statistics

SN - 1076-9986

ER -