Statistical analysis of clinical prediction rules for rehabilitation interventions: Current state of the literature

Anat Lubetzky, Marcia Ciol, Sarah Westcott McCoy

Research output: Contribution to journalArticle

Abstract

Deriving clinical prediction rules (CPRs) to identify specific characteristics of patients who would likely respond to certain interventions has become a research priority in physical rehabilitation. Understanding the appropriate statistical principles and methods of analyses underlying the derivation of CPRs is important for future rehabilitation research and clinical applications. In this article, we aimed to provide an overview of statistical techniques used for the derivation of CPRs to predict success following physical therapy interventions and to generate recommendations for improvements in CPR derivation research and statistical analysis in rehabilitation. We have summarized the current state of CPR intervention-related research by reviewing 26 studies. A common technique was found in most studies and included univariate association of factors with treatment success, stepwise logistic regression to determine the most parsimonious set of predictors for success, and calculation of accuracy statistics (focusing on positive likelihood ratios). We identified several shortcomings related to inadequate ratio of events by number of predictors, lack of standardization regarding acceptable interobserver reliability of predictors, questionable handling of predictors including reliance on univariate analysis and early categorization, and not accounting for dependence and collinearity of predictors in multivariable model construction. Interpretation of the derived CPRs was found to be difficult due to lack of precision of estimates and paradoxical findings when a subset of the predictors yielded a larger positive likelihood ratio than did the full set of predictors. Finally, we make recommendations regarding how to strengthen the use of statistical principles and methods to create consistency across rehabilitation research for CPR derivations.

Original languageEnglish (US)
Pages (from-to)188-196
Number of pages9
JournalArchives of Physical Medicine and Rehabilitation
Volume95
Issue number1
DOIs
StatePublished - Jan 2014

Fingerprint

Decision Support Techniques
Rehabilitation
Research
Logistic Models
Therapeutics

Keywords

  • Outcome and process assessment
  • Rehabilitation
  • Statistics

ASJC Scopus subject areas

  • Rehabilitation
  • Physical Therapy, Sports Therapy and Rehabilitation

Cite this

Statistical analysis of clinical prediction rules for rehabilitation interventions : Current state of the literature. / Lubetzky, Anat; Ciol, Marcia; McCoy, Sarah Westcott.

In: Archives of Physical Medicine and Rehabilitation, Vol. 95, No. 1, 01.2014, p. 188-196.

Research output: Contribution to journalArticle

@article{5a22fd7e8d7c42d1a88ea1b2340e7fd8,
title = "Statistical analysis of clinical prediction rules for rehabilitation interventions: Current state of the literature",
abstract = "Deriving clinical prediction rules (CPRs) to identify specific characteristics of patients who would likely respond to certain interventions has become a research priority in physical rehabilitation. Understanding the appropriate statistical principles and methods of analyses underlying the derivation of CPRs is important for future rehabilitation research and clinical applications. In this article, we aimed to provide an overview of statistical techniques used for the derivation of CPRs to predict success following physical therapy interventions and to generate recommendations for improvements in CPR derivation research and statistical analysis in rehabilitation. We have summarized the current state of CPR intervention-related research by reviewing 26 studies. A common technique was found in most studies and included univariate association of factors with treatment success, stepwise logistic regression to determine the most parsimonious set of predictors for success, and calculation of accuracy statistics (focusing on positive likelihood ratios). We identified several shortcomings related to inadequate ratio of events by number of predictors, lack of standardization regarding acceptable interobserver reliability of predictors, questionable handling of predictors including reliance on univariate analysis and early categorization, and not accounting for dependence and collinearity of predictors in multivariable model construction. Interpretation of the derived CPRs was found to be difficult due to lack of precision of estimates and paradoxical findings when a subset of the predictors yielded a larger positive likelihood ratio than did the full set of predictors. Finally, we make recommendations regarding how to strengthen the use of statistical principles and methods to create consistency across rehabilitation research for CPR derivations.",
keywords = "Outcome and process assessment, Rehabilitation, Statistics",
author = "Anat Lubetzky and Marcia Ciol and McCoy, {Sarah Westcott}",
year = "2014",
month = "1",
doi = "10.1016/j.apmr.2013.08.242",
language = "English (US)",
volume = "95",
pages = "188--196",
journal = "Archives of Physical Medicine and Rehabilitation",
issn = "0003-9993",
publisher = "W.B. Saunders Ltd",
number = "1",

}

TY - JOUR

T1 - Statistical analysis of clinical prediction rules for rehabilitation interventions

T2 - Current state of the literature

AU - Lubetzky, Anat

AU - Ciol, Marcia

AU - McCoy, Sarah Westcott

PY - 2014/1

Y1 - 2014/1

N2 - Deriving clinical prediction rules (CPRs) to identify specific characteristics of patients who would likely respond to certain interventions has become a research priority in physical rehabilitation. Understanding the appropriate statistical principles and methods of analyses underlying the derivation of CPRs is important for future rehabilitation research and clinical applications. In this article, we aimed to provide an overview of statistical techniques used for the derivation of CPRs to predict success following physical therapy interventions and to generate recommendations for improvements in CPR derivation research and statistical analysis in rehabilitation. We have summarized the current state of CPR intervention-related research by reviewing 26 studies. A common technique was found in most studies and included univariate association of factors with treatment success, stepwise logistic regression to determine the most parsimonious set of predictors for success, and calculation of accuracy statistics (focusing on positive likelihood ratios). We identified several shortcomings related to inadequate ratio of events by number of predictors, lack of standardization regarding acceptable interobserver reliability of predictors, questionable handling of predictors including reliance on univariate analysis and early categorization, and not accounting for dependence and collinearity of predictors in multivariable model construction. Interpretation of the derived CPRs was found to be difficult due to lack of precision of estimates and paradoxical findings when a subset of the predictors yielded a larger positive likelihood ratio than did the full set of predictors. Finally, we make recommendations regarding how to strengthen the use of statistical principles and methods to create consistency across rehabilitation research for CPR derivations.

AB - Deriving clinical prediction rules (CPRs) to identify specific characteristics of patients who would likely respond to certain interventions has become a research priority in physical rehabilitation. Understanding the appropriate statistical principles and methods of analyses underlying the derivation of CPRs is important for future rehabilitation research and clinical applications. In this article, we aimed to provide an overview of statistical techniques used for the derivation of CPRs to predict success following physical therapy interventions and to generate recommendations for improvements in CPR derivation research and statistical analysis in rehabilitation. We have summarized the current state of CPR intervention-related research by reviewing 26 studies. A common technique was found in most studies and included univariate association of factors with treatment success, stepwise logistic regression to determine the most parsimonious set of predictors for success, and calculation of accuracy statistics (focusing on positive likelihood ratios). We identified several shortcomings related to inadequate ratio of events by number of predictors, lack of standardization regarding acceptable interobserver reliability of predictors, questionable handling of predictors including reliance on univariate analysis and early categorization, and not accounting for dependence and collinearity of predictors in multivariable model construction. Interpretation of the derived CPRs was found to be difficult due to lack of precision of estimates and paradoxical findings when a subset of the predictors yielded a larger positive likelihood ratio than did the full set of predictors. Finally, we make recommendations regarding how to strengthen the use of statistical principles and methods to create consistency across rehabilitation research for CPR derivations.

KW - Outcome and process assessment

KW - Rehabilitation

KW - Statistics

UR - http://www.scopus.com/inward/record.url?scp=84891626548&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84891626548&partnerID=8YFLogxK

U2 - 10.1016/j.apmr.2013.08.242

DO - 10.1016/j.apmr.2013.08.242

M3 - Article

C2 - 24036159

AN - SCOPUS:84891626548

VL - 95

SP - 188

EP - 196

JO - Archives of Physical Medicine and Rehabilitation

JF - Archives of Physical Medicine and Rehabilitation

SN - 0003-9993

IS - 1

ER -