Assessing Diagnostic Tests: How to Correct for the Combined Effects of Interpretation and Reference Standard

Ahmet Omurtag, Andre Fenton

Research output: Contribution to journalArticle

Abstract

We describe a general solution to the problem of determining diagnostic accuracy without the use of a perfect reference standard and in the presence of interpreter variability. The accuracy of a diagnostic test is typically determined by comparing its outcomes with those of an established reference standard. But the accuracy of the standard itself and those of the interpreters strongly influence such assessments. We use our solution to examine the effects of the properties of the standard, the reliability of the interpreters, and the prevalence of abnormality on the measured sensitivity and specificity. Our results provide a method of systematically adjusting the measured sensitivity and specificity in order to estimate their true values. The results are validated by simulations and their detailed application to specific cases are described.

Original languageEnglish (US)
Article numbere52221
JournalPLoS One
Volume7
Issue number12
DOIs
StatePublished - Dec 29 2012

Fingerprint

reference standards
Routine Diagnostic Tests
diagnostic techniques
Sensitivity and Specificity
methodology

ASJC Scopus subject areas

  • Agricultural and Biological Sciences(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Medicine(all)

Cite this

Assessing Diagnostic Tests : How to Correct for the Combined Effects of Interpretation and Reference Standard. / Omurtag, Ahmet; Fenton, Andre.

In: PLoS One, Vol. 7, No. 12, e52221, 29.12.2012.

Research output: Contribution to journalArticle

@article{7d023d9ebd4d49418fba122579fcacde,
title = "Assessing Diagnostic Tests: How to Correct for the Combined Effects of Interpretation and Reference Standard",
abstract = "We describe a general solution to the problem of determining diagnostic accuracy without the use of a perfect reference standard and in the presence of interpreter variability. The accuracy of a diagnostic test is typically determined by comparing its outcomes with those of an established reference standard. But the accuracy of the standard itself and those of the interpreters strongly influence such assessments. We use our solution to examine the effects of the properties of the standard, the reliability of the interpreters, and the prevalence of abnormality on the measured sensitivity and specificity. Our results provide a method of systematically adjusting the measured sensitivity and specificity in order to estimate their true values. The results are validated by simulations and their detailed application to specific cases are described.",
author = "Ahmet Omurtag and Andre Fenton",
year = "2012",
month = "12",
day = "29",
doi = "10.1371/journal.pone.0052221",
language = "English (US)",
volume = "7",
journal = "PLoS One",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "12",

}

TY - JOUR

T1 - Assessing Diagnostic Tests

T2 - How to Correct for the Combined Effects of Interpretation and Reference Standard

AU - Omurtag, Ahmet

AU - Fenton, Andre

PY - 2012/12/29

Y1 - 2012/12/29

N2 - We describe a general solution to the problem of determining diagnostic accuracy without the use of a perfect reference standard and in the presence of interpreter variability. The accuracy of a diagnostic test is typically determined by comparing its outcomes with those of an established reference standard. But the accuracy of the standard itself and those of the interpreters strongly influence such assessments. We use our solution to examine the effects of the properties of the standard, the reliability of the interpreters, and the prevalence of abnormality on the measured sensitivity and specificity. Our results provide a method of systematically adjusting the measured sensitivity and specificity in order to estimate their true values. The results are validated by simulations and their detailed application to specific cases are described.

AB - We describe a general solution to the problem of determining diagnostic accuracy without the use of a perfect reference standard and in the presence of interpreter variability. The accuracy of a diagnostic test is typically determined by comparing its outcomes with those of an established reference standard. But the accuracy of the standard itself and those of the interpreters strongly influence such assessments. We use our solution to examine the effects of the properties of the standard, the reliability of the interpreters, and the prevalence of abnormality on the measured sensitivity and specificity. Our results provide a method of systematically adjusting the measured sensitivity and specificity in order to estimate their true values. The results are validated by simulations and their detailed application to specific cases are described.

UR - http://www.scopus.com/inward/record.url?scp=84871542957&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871542957&partnerID=8YFLogxK

U2 - 10.1371/journal.pone.0052221

DO - 10.1371/journal.pone.0052221

M3 - Article

C2 - 23300619

AN - SCOPUS:84871542957

VL - 7

JO - PLoS One

JF - PLoS One

SN - 1932-6203

IS - 12

M1 - e52221

ER -