Cost-Effectiveness Analysis of Early Reading Programs: A Demonstration With Recommendations for Future Research

Fiona M. Hollands, Michael J. Kieffer, Robert Shand, Yilin Pan, Henan Cheng, Henry M. Levin

Research output: Contribution to journalArticle

Abstract

We review the value of cost-effectiveness analysis for evaluation and decision making with respect to educational programs and discuss its application to early reading interventions. We describe the conditions for a rigorous cost-effectiveness analysis and illustrate the challenges of applying the method in practice, providing examples of programs for which we have estimated costs, but find effectiveness data lacking in comparability. We provide a demonstration of how cost-effectiveness analysis can be applied to two early reading programs: the Wilson Reading System and Corrective Reading. We use existing effectiveness data from an experimental evaluation in which the programs were implemented under similar conditions and the use of common outcomes measures for both programs yielded data that are comparable. We combine these data with cost data we collected using the ingredients method to calculate cost-effectiveness ratios for the alphabetics domain. A complete picture of the relative cost-effectiveness of each program could be provided if effectiveness metrics were available for fluency, vocabulary, and comprehension. We highlight the obstacles to applying cost-effectiveness analysis more frequently and recommend strategies for improving the availability of the requisite data.

Original languageEnglish (US)
Pages (from-to)30-53
Number of pages24
JournalJournal of Research on Educational Effectiveness
Volume9
Issue number1
DOIs
StatePublished - Jan 2 2016

Fingerprint

costs
evaluation
educational program
vocabulary
comprehension
decision making
Values

Keywords

  • cost-effectiveness
  • early reading
  • program evaluation

ASJC Scopus subject areas

  • Education

Cite this

Cost-Effectiveness Analysis of Early Reading Programs : A Demonstration With Recommendations for Future Research. / Hollands, Fiona M.; Kieffer, Michael J.; Shand, Robert; Pan, Yilin; Cheng, Henan; Levin, Henry M.

In: Journal of Research on Educational Effectiveness, Vol. 9, No. 1, 02.01.2016, p. 30-53.

Research output: Contribution to journalArticle

Hollands, Fiona M. ; Kieffer, Michael J. ; Shand, Robert ; Pan, Yilin ; Cheng, Henan ; Levin, Henry M. / Cost-Effectiveness Analysis of Early Reading Programs : A Demonstration With Recommendations for Future Research. In: Journal of Research on Educational Effectiveness. 2016 ; Vol. 9, No. 1. pp. 30-53.
@article{f82369f7e94d452c94eed23a7a06e17b,
title = "Cost-Effectiveness Analysis of Early Reading Programs: A Demonstration With Recommendations for Future Research",
abstract = "We review the value of cost-effectiveness analysis for evaluation and decision making with respect to educational programs and discuss its application to early reading interventions. We describe the conditions for a rigorous cost-effectiveness analysis and illustrate the challenges of applying the method in practice, providing examples of programs for which we have estimated costs, but find effectiveness data lacking in comparability. We provide a demonstration of how cost-effectiveness analysis can be applied to two early reading programs: the Wilson Reading System and Corrective Reading. We use existing effectiveness data from an experimental evaluation in which the programs were implemented under similar conditions and the use of common outcomes measures for both programs yielded data that are comparable. We combine these data with cost data we collected using the ingredients method to calculate cost-effectiveness ratios for the alphabetics domain. A complete picture of the relative cost-effectiveness of each program could be provided if effectiveness metrics were available for fluency, vocabulary, and comprehension. We highlight the obstacles to applying cost-effectiveness analysis more frequently and recommend strategies for improving the availability of the requisite data.",
keywords = "cost-effectiveness, early reading, program evaluation",
author = "Hollands, {Fiona M.} and Kieffer, {Michael J.} and Robert Shand and Yilin Pan and Henan Cheng and Levin, {Henry M.}",
year = "2016",
month = "1",
day = "2",
doi = "10.1080/19345747.2015.1055639",
language = "English (US)",
volume = "9",
pages = "30--53",
journal = "Journal of Research on Educational Effectiveness",
issn = "1934-5747",
publisher = "Routledge",
number = "1",

}

TY - JOUR

T1 - Cost-Effectiveness Analysis of Early Reading Programs

T2 - A Demonstration With Recommendations for Future Research

AU - Hollands, Fiona M.

AU - Kieffer, Michael J.

AU - Shand, Robert

AU - Pan, Yilin

AU - Cheng, Henan

AU - Levin, Henry M.

PY - 2016/1/2

Y1 - 2016/1/2

N2 - We review the value of cost-effectiveness analysis for evaluation and decision making with respect to educational programs and discuss its application to early reading interventions. We describe the conditions for a rigorous cost-effectiveness analysis and illustrate the challenges of applying the method in practice, providing examples of programs for which we have estimated costs, but find effectiveness data lacking in comparability. We provide a demonstration of how cost-effectiveness analysis can be applied to two early reading programs: the Wilson Reading System and Corrective Reading. We use existing effectiveness data from an experimental evaluation in which the programs were implemented under similar conditions and the use of common outcomes measures for both programs yielded data that are comparable. We combine these data with cost data we collected using the ingredients method to calculate cost-effectiveness ratios for the alphabetics domain. A complete picture of the relative cost-effectiveness of each program could be provided if effectiveness metrics were available for fluency, vocabulary, and comprehension. We highlight the obstacles to applying cost-effectiveness analysis more frequently and recommend strategies for improving the availability of the requisite data.

AB - We review the value of cost-effectiveness analysis for evaluation and decision making with respect to educational programs and discuss its application to early reading interventions. We describe the conditions for a rigorous cost-effectiveness analysis and illustrate the challenges of applying the method in practice, providing examples of programs for which we have estimated costs, but find effectiveness data lacking in comparability. We provide a demonstration of how cost-effectiveness analysis can be applied to two early reading programs: the Wilson Reading System and Corrective Reading. We use existing effectiveness data from an experimental evaluation in which the programs were implemented under similar conditions and the use of common outcomes measures for both programs yielded data that are comparable. We combine these data with cost data we collected using the ingredients method to calculate cost-effectiveness ratios for the alphabetics domain. A complete picture of the relative cost-effectiveness of each program could be provided if effectiveness metrics were available for fluency, vocabulary, and comprehension. We highlight the obstacles to applying cost-effectiveness analysis more frequently and recommend strategies for improving the availability of the requisite data.

KW - cost-effectiveness

KW - early reading

KW - program evaluation

UR - http://www.scopus.com/inward/record.url?scp=84957846875&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84957846875&partnerID=8YFLogxK

U2 - 10.1080/19345747.2015.1055639

DO - 10.1080/19345747.2015.1055639

M3 - Article

AN - SCOPUS:84957846875

VL - 9

SP - 30

EP - 53

JO - Journal of Research on Educational Effectiveness

JF - Journal of Research on Educational Effectiveness

SN - 1934-5747

IS - 1

ER -