The role of matched controls in building an evidence base for hospital-avoidance schemes

A retrospective evaluation

Adam Steventon, Martin Bardsley, John Billings, Theo Georghiou, Geraint Hywel Lewis

Research output: Contribution to journalArticle

Abstract

Objective To test whether two hospital-avoidance interventions altered rates of hospital use: "intermediate care" and "integrated care teams." Data Sources/Study Setting Linked administrative data for England covering the period 2004 to 2009. Study Design This study was commissioned after the interventions had been in place for several years. We developed a method based on retrospective analysis of person-level data comparing health care use of participants with that of prognostically matched controls. Data Collection/Extraction Methods Individuals were linked to administrative datasets through a trusted intermediary and a unique patient identifier. Principal Findings Participants who received the intermediate care intervention showed higher rates of unscheduled hospital admission than matched controls, whereas recipients of the integrated care team intervention showed no difference. Both intervention groups showed higher rates of mortality than did their matched controls. Conclusions These are potentially powerful techniques for assessing impacts on hospital activity. Neither intervention reduced admission rates. Although our analysis of hospital utilization controlled for a wide range of observable characteristics, the difference in mortality rates suggests that some residual confounding is likely. Evaluation is constrained when performed retrospectively, and careful interpretation is needed.

Original languageEnglish (US)
Pages (from-to)1679-1698
Number of pages20
JournalHealth Services Research
Volume47
Issue number4
DOIs
StatePublished - Aug 2012

Fingerprint

Mortality
Information Storage and Retrieval
England
Delivery of Health Care
Datasets

Keywords

  • administrative data uses
  • evaluation design and research
  • observational data/quasi-experiments
  • Program evaluation

ASJC Scopus subject areas

  • Health Policy

Cite this

The role of matched controls in building an evidence base for hospital-avoidance schemes : A retrospective evaluation. / Steventon, Adam; Bardsley, Martin; Billings, John; Georghiou, Theo; Lewis, Geraint Hywel.

In: Health Services Research, Vol. 47, No. 4, 08.2012, p. 1679-1698.

Research output: Contribution to journalArticle

Steventon, Adam ; Bardsley, Martin ; Billings, John ; Georghiou, Theo ; Lewis, Geraint Hywel. / The role of matched controls in building an evidence base for hospital-avoidance schemes : A retrospective evaluation. In: Health Services Research. 2012 ; Vol. 47, No. 4. pp. 1679-1698.
@article{8ec681b04cb84c41a3fe6a376f65065b,
title = "The role of matched controls in building an evidence base for hospital-avoidance schemes: A retrospective evaluation",
abstract = "Objective To test whether two hospital-avoidance interventions altered rates of hospital use: {"}intermediate care{"} and {"}integrated care teams.{"} Data Sources/Study Setting Linked administrative data for England covering the period 2004 to 2009. Study Design This study was commissioned after the interventions had been in place for several years. We developed a method based on retrospective analysis of person-level data comparing health care use of participants with that of prognostically matched controls. Data Collection/Extraction Methods Individuals were linked to administrative datasets through a trusted intermediary and a unique patient identifier. Principal Findings Participants who received the intermediate care intervention showed higher rates of unscheduled hospital admission than matched controls, whereas recipients of the integrated care team intervention showed no difference. Both intervention groups showed higher rates of mortality than did their matched controls. Conclusions These are potentially powerful techniques for assessing impacts on hospital activity. Neither intervention reduced admission rates. Although our analysis of hospital utilization controlled for a wide range of observable characteristics, the difference in mortality rates suggests that some residual confounding is likely. Evaluation is constrained when performed retrospectively, and careful interpretation is needed.",
keywords = "administrative data uses, evaluation design and research, observational data/quasi-experiments, Program evaluation",
author = "Adam Steventon and Martin Bardsley and John Billings and Theo Georghiou and Lewis, {Geraint Hywel}",
year = "2012",
month = "8",
doi = "10.1111/j.1475-6773.2011.01367.x",
language = "English (US)",
volume = "47",
pages = "1679--1698",
journal = "Health Services Research",
issn = "0017-9124",
publisher = "Wiley-Blackwell",
number = "4",

}

TY - JOUR

T1 - The role of matched controls in building an evidence base for hospital-avoidance schemes

T2 - A retrospective evaluation

AU - Steventon, Adam

AU - Bardsley, Martin

AU - Billings, John

AU - Georghiou, Theo

AU - Lewis, Geraint Hywel

PY - 2012/8

Y1 - 2012/8

N2 - Objective To test whether two hospital-avoidance interventions altered rates of hospital use: "intermediate care" and "integrated care teams." Data Sources/Study Setting Linked administrative data for England covering the period 2004 to 2009. Study Design This study was commissioned after the interventions had been in place for several years. We developed a method based on retrospective analysis of person-level data comparing health care use of participants with that of prognostically matched controls. Data Collection/Extraction Methods Individuals were linked to administrative datasets through a trusted intermediary and a unique patient identifier. Principal Findings Participants who received the intermediate care intervention showed higher rates of unscheduled hospital admission than matched controls, whereas recipients of the integrated care team intervention showed no difference. Both intervention groups showed higher rates of mortality than did their matched controls. Conclusions These are potentially powerful techniques for assessing impacts on hospital activity. Neither intervention reduced admission rates. Although our analysis of hospital utilization controlled for a wide range of observable characteristics, the difference in mortality rates suggests that some residual confounding is likely. Evaluation is constrained when performed retrospectively, and careful interpretation is needed.

AB - Objective To test whether two hospital-avoidance interventions altered rates of hospital use: "intermediate care" and "integrated care teams." Data Sources/Study Setting Linked administrative data for England covering the period 2004 to 2009. Study Design This study was commissioned after the interventions had been in place for several years. We developed a method based on retrospective analysis of person-level data comparing health care use of participants with that of prognostically matched controls. Data Collection/Extraction Methods Individuals were linked to administrative datasets through a trusted intermediary and a unique patient identifier. Principal Findings Participants who received the intermediate care intervention showed higher rates of unscheduled hospital admission than matched controls, whereas recipients of the integrated care team intervention showed no difference. Both intervention groups showed higher rates of mortality than did their matched controls. Conclusions These are potentially powerful techniques for assessing impacts on hospital activity. Neither intervention reduced admission rates. Although our analysis of hospital utilization controlled for a wide range of observable characteristics, the difference in mortality rates suggests that some residual confounding is likely. Evaluation is constrained when performed retrospectively, and careful interpretation is needed.

KW - administrative data uses

KW - evaluation design and research

KW - observational data/quasi-experiments

KW - Program evaluation

UR - http://www.scopus.com/inward/record.url?scp=84863720523&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863720523&partnerID=8YFLogxK

U2 - 10.1111/j.1475-6773.2011.01367.x

DO - 10.1111/j.1475-6773.2011.01367.x

M3 - Article

VL - 47

SP - 1679

EP - 1698

JO - Health Services Research

JF - Health Services Research

SN - 0017-9124

IS - 4

ER -