Imperfect gold standards for kidney injury biomarker evaluation

Sushrut S. Waikar, Rebecca Betensky, Sarah C. Emerson, Joseph V. Bonventre

Research output: Contribution to journalArticle

Abstract

Clinicians have used serumcreatinine in diagnostic testing for acute kidney injury for decades, despite its imperfect sensitivity and specificity. Novel tubular injury biomarkers may revolutionize the diagnosis of acute kidney injury; however, even if a novel tubular injury biomarker is 100% sensitive and 100% specific, itmay appear inaccurate when using serum creatinine as the gold standard. Acute kidney injury, as defined by serum creatinine, may not reflect tubular injury, and the absence of changes in serum creatinine does not assure the absence of tubular injury. In general, the apparent diagnostic performance of a biomarker depends not only on its ability to detect injury, but also on disease prevalence and the sensitivity and specificity of the imperfect gold standard. Assuming that, at a certain cutoff value, serum creatinine is 80% sensitive and 90% specific and disease prevalence is 10%, a new perfect biomarker with a true 100% sensitivity may seem to have only 47% sensitivity compared with serum creatinine as the gold standard. Minimizing misclassification by using more strict criteria to diagnose acute kidney injury will reduce the error when evaluating the performance of a biomarker under investigation. Apparent diagnostic errors using a new biomarkermay be a reflection of errors in the imperfect gold standard itself, rather than poor performance of the biomarker. The results of this study suggest that small changes in serum creatinine alone should not be used to define acute kidney injury in biomarker or interventional studies.

Original languageEnglish (US)
Pages (from-to)13-21
Number of pages9
JournalJournal of the American Society of Nephrology
Volume23
Issue number1
DOIs
StatePublished - Jan 1 2012

Fingerprint

Biomarkers
Creatinine
Acute Kidney Injury
Kidney
Wounds and Injuries
Serum
Sensitivity and Specificity
Diagnostic Errors

ASJC Scopus subject areas

  • Nephrology

Cite this

Imperfect gold standards for kidney injury biomarker evaluation. / Waikar, Sushrut S.; Betensky, Rebecca; Emerson, Sarah C.; Bonventre, Joseph V.

In: Journal of the American Society of Nephrology, Vol. 23, No. 1, 01.01.2012, p. 13-21.

Research output: Contribution to journalArticle

Waikar, Sushrut S. ; Betensky, Rebecca ; Emerson, Sarah C. ; Bonventre, Joseph V. / Imperfect gold standards for kidney injury biomarker evaluation. In: Journal of the American Society of Nephrology. 2012 ; Vol. 23, No. 1. pp. 13-21.
@article{3f95ceb392df4a7d83d73e79a3ed57a9,
title = "Imperfect gold standards for kidney injury biomarker evaluation",
abstract = "Clinicians have used serumcreatinine in diagnostic testing for acute kidney injury for decades, despite its imperfect sensitivity and specificity. Novel tubular injury biomarkers may revolutionize the diagnosis of acute kidney injury; however, even if a novel tubular injury biomarker is 100{\%} sensitive and 100{\%} specific, itmay appear inaccurate when using serum creatinine as the gold standard. Acute kidney injury, as defined by serum creatinine, may not reflect tubular injury, and the absence of changes in serum creatinine does not assure the absence of tubular injury. In general, the apparent diagnostic performance of a biomarker depends not only on its ability to detect injury, but also on disease prevalence and the sensitivity and specificity of the imperfect gold standard. Assuming that, at a certain cutoff value, serum creatinine is 80{\%} sensitive and 90{\%} specific and disease prevalence is 10{\%}, a new perfect biomarker with a true 100{\%} sensitivity may seem to have only 47{\%} sensitivity compared with serum creatinine as the gold standard. Minimizing misclassification by using more strict criteria to diagnose acute kidney injury will reduce the error when evaluating the performance of a biomarker under investigation. Apparent diagnostic errors using a new biomarkermay be a reflection of errors in the imperfect gold standard itself, rather than poor performance of the biomarker. The results of this study suggest that small changes in serum creatinine alone should not be used to define acute kidney injury in biomarker or interventional studies.",
author = "Waikar, {Sushrut S.} and Rebecca Betensky and Emerson, {Sarah C.} and Bonventre, {Joseph V.}",
year = "2012",
month = "1",
day = "1",
doi = "10.1681/ASN.2010111124",
language = "English (US)",
volume = "23",
pages = "13--21",
journal = "Journal of the American Society of Nephrology : JASN",
issn = "1046-6673",
publisher = "American Society of Nephrology",
number = "1",

}

TY - JOUR

T1 - Imperfect gold standards for kidney injury biomarker evaluation

AU - Waikar, Sushrut S.

AU - Betensky, Rebecca

AU - Emerson, Sarah C.

AU - Bonventre, Joseph V.

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Clinicians have used serumcreatinine in diagnostic testing for acute kidney injury for decades, despite its imperfect sensitivity and specificity. Novel tubular injury biomarkers may revolutionize the diagnosis of acute kidney injury; however, even if a novel tubular injury biomarker is 100% sensitive and 100% specific, itmay appear inaccurate when using serum creatinine as the gold standard. Acute kidney injury, as defined by serum creatinine, may not reflect tubular injury, and the absence of changes in serum creatinine does not assure the absence of tubular injury. In general, the apparent diagnostic performance of a biomarker depends not only on its ability to detect injury, but also on disease prevalence and the sensitivity and specificity of the imperfect gold standard. Assuming that, at a certain cutoff value, serum creatinine is 80% sensitive and 90% specific and disease prevalence is 10%, a new perfect biomarker with a true 100% sensitivity may seem to have only 47% sensitivity compared with serum creatinine as the gold standard. Minimizing misclassification by using more strict criteria to diagnose acute kidney injury will reduce the error when evaluating the performance of a biomarker under investigation. Apparent diagnostic errors using a new biomarkermay be a reflection of errors in the imperfect gold standard itself, rather than poor performance of the biomarker. The results of this study suggest that small changes in serum creatinine alone should not be used to define acute kidney injury in biomarker or interventional studies.

AB - Clinicians have used serumcreatinine in diagnostic testing for acute kidney injury for decades, despite its imperfect sensitivity and specificity. Novel tubular injury biomarkers may revolutionize the diagnosis of acute kidney injury; however, even if a novel tubular injury biomarker is 100% sensitive and 100% specific, itmay appear inaccurate when using serum creatinine as the gold standard. Acute kidney injury, as defined by serum creatinine, may not reflect tubular injury, and the absence of changes in serum creatinine does not assure the absence of tubular injury. In general, the apparent diagnostic performance of a biomarker depends not only on its ability to detect injury, but also on disease prevalence and the sensitivity and specificity of the imperfect gold standard. Assuming that, at a certain cutoff value, serum creatinine is 80% sensitive and 90% specific and disease prevalence is 10%, a new perfect biomarker with a true 100% sensitivity may seem to have only 47% sensitivity compared with serum creatinine as the gold standard. Minimizing misclassification by using more strict criteria to diagnose acute kidney injury will reduce the error when evaluating the performance of a biomarker under investigation. Apparent diagnostic errors using a new biomarkermay be a reflection of errors in the imperfect gold standard itself, rather than poor performance of the biomarker. The results of this study suggest that small changes in serum creatinine alone should not be used to define acute kidney injury in biomarker or interventional studies.

UR - http://www.scopus.com/inward/record.url?scp=84855575415&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84855575415&partnerID=8YFLogxK

U2 - 10.1681/ASN.2010111124

DO - 10.1681/ASN.2010111124

M3 - Article

VL - 23

SP - 13

EP - 21

JO - Journal of the American Society of Nephrology : JASN

JF - Journal of the American Society of Nephrology : JASN

SN - 1046-6673

IS - 1

ER -