Three modeling applications to promote automatic item generation for examinations in dentistry

Hollis Lai, Mark J. Gierl, B. Ellen Byrne, Andrew Spielman, David M. Waldschmidt

Research output: Contribution to journalArticle

Abstract

Test items created for dentistry examinations are often individually written by content experts. This approach to item development is expensive because it requires the time and effort of many content experts but yields relatively few items. The aim of this study was to describe and illustrate how items can be generated using a systematic approach. Automatic item generation (AIG) is an alternative method that allows a small number of content experts to produce large numbers of items by integrating their domain expertise with computer technology. This article describes and illustrates how three modeling approaches to item content-item cloning, cognitive modeling, and image-anchored modeling-can be used to generate large numbers of multiplechoice test items for examinations in dentistry. Test items can be generated by combining the expertise of two content specialists with technology supported by AIG. A total of 5,467 new items were created during this study. From substitution of item content, to modeling appropriate responses based upon a cognitive model of correct responses, to generating items linked to specific graphical findings, AIG has the potential for meeting increasing demands for test items. Further, the methods described in this study can be generalized and applied to many other item types. Future research applications for AIG in dental education are discussed.

Original languageEnglish (US)
Pages (from-to)339-347
Number of pages9
JournalJournal of Dental Education
Volume80
Issue number3
StatePublished - Mar 1 2016

Fingerprint

dentistry
Dentistry
Technology
Dental Education
examination
Organism Cloning
expert
expertise
meeting demand
substitution
education

Keywords

  • Assessment
  • Dental education
  • Item generation
  • Item writing
  • Test development

ASJC Scopus subject areas

  • Dentistry(all)
  • Education

Cite this

Three modeling applications to promote automatic item generation for examinations in dentistry. / Lai, Hollis; Gierl, Mark J.; Ellen Byrne, B.; Spielman, Andrew; Waldschmidt, David M.

In: Journal of Dental Education, Vol. 80, No. 3, 01.03.2016, p. 339-347.

Research output: Contribution to journalArticle

Lai, H, Gierl, MJ, Ellen Byrne, B, Spielman, A & Waldschmidt, DM 2016, 'Three modeling applications to promote automatic item generation for examinations in dentistry', Journal of Dental Education, vol. 80, no. 3, pp. 339-347.
Lai, Hollis ; Gierl, Mark J. ; Ellen Byrne, B. ; Spielman, Andrew ; Waldschmidt, David M. / Three modeling applications to promote automatic item generation for examinations in dentistry. In: Journal of Dental Education. 2016 ; Vol. 80, No. 3. pp. 339-347.
@article{b999c9da658d45d09f04a9252ca99a19,
title = "Three modeling applications to promote automatic item generation for examinations in dentistry",
abstract = "Test items created for dentistry examinations are often individually written by content experts. This approach to item development is expensive because it requires the time and effort of many content experts but yields relatively few items. The aim of this study was to describe and illustrate how items can be generated using a systematic approach. Automatic item generation (AIG) is an alternative method that allows a small number of content experts to produce large numbers of items by integrating their domain expertise with computer technology. This article describes and illustrates how three modeling approaches to item content-item cloning, cognitive modeling, and image-anchored modeling-can be used to generate large numbers of multiplechoice test items for examinations in dentistry. Test items can be generated by combining the expertise of two content specialists with technology supported by AIG. A total of 5,467 new items were created during this study. From substitution of item content, to modeling appropriate responses based upon a cognitive model of correct responses, to generating items linked to specific graphical findings, AIG has the potential for meeting increasing demands for test items. Further, the methods described in this study can be generalized and applied to many other item types. Future research applications for AIG in dental education are discussed.",
keywords = "Assessment, Dental education, Item generation, Item writing, Test development",
author = "Hollis Lai and Gierl, {Mark J.} and {Ellen Byrne}, B. and Andrew Spielman and Waldschmidt, {David M.}",
year = "2016",
month = "3",
day = "1",
language = "English (US)",
volume = "80",
pages = "339--347",
journal = "Journal of Dental Education",
issn = "0022-0337",
publisher = "American Dental Education Association",
number = "3",

}

TY - JOUR

T1 - Three modeling applications to promote automatic item generation for examinations in dentistry

AU - Lai, Hollis

AU - Gierl, Mark J.

AU - Ellen Byrne, B.

AU - Spielman, Andrew

AU - Waldschmidt, David M.

PY - 2016/3/1

Y1 - 2016/3/1

N2 - Test items created for dentistry examinations are often individually written by content experts. This approach to item development is expensive because it requires the time and effort of many content experts but yields relatively few items. The aim of this study was to describe and illustrate how items can be generated using a systematic approach. Automatic item generation (AIG) is an alternative method that allows a small number of content experts to produce large numbers of items by integrating their domain expertise with computer technology. This article describes and illustrates how three modeling approaches to item content-item cloning, cognitive modeling, and image-anchored modeling-can be used to generate large numbers of multiplechoice test items for examinations in dentistry. Test items can be generated by combining the expertise of two content specialists with technology supported by AIG. A total of 5,467 new items were created during this study. From substitution of item content, to modeling appropriate responses based upon a cognitive model of correct responses, to generating items linked to specific graphical findings, AIG has the potential for meeting increasing demands for test items. Further, the methods described in this study can be generalized and applied to many other item types. Future research applications for AIG in dental education are discussed.

AB - Test items created for dentistry examinations are often individually written by content experts. This approach to item development is expensive because it requires the time and effort of many content experts but yields relatively few items. The aim of this study was to describe and illustrate how items can be generated using a systematic approach. Automatic item generation (AIG) is an alternative method that allows a small number of content experts to produce large numbers of items by integrating their domain expertise with computer technology. This article describes and illustrates how three modeling approaches to item content-item cloning, cognitive modeling, and image-anchored modeling-can be used to generate large numbers of multiplechoice test items for examinations in dentistry. Test items can be generated by combining the expertise of two content specialists with technology supported by AIG. A total of 5,467 new items were created during this study. From substitution of item content, to modeling appropriate responses based upon a cognitive model of correct responses, to generating items linked to specific graphical findings, AIG has the potential for meeting increasing demands for test items. Further, the methods described in this study can be generalized and applied to many other item types. Future research applications for AIG in dental education are discussed.

KW - Assessment

KW - Dental education

KW - Item generation

KW - Item writing

KW - Test development

UR - http://www.scopus.com/inward/record.url?scp=84962312566&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962312566&partnerID=8YFLogxK

M3 - Article

VL - 80

SP - 339

EP - 347

JO - Journal of Dental Education

JF - Journal of Dental Education

SN - 0022-0337

IS - 3

ER -