The use of qualitative methods in large-scale evaluation: Improving the quality of the evaluation and the meaningfulness of the findings

Julie Slayton, Lorena Llosa

Research output: Contribution to journalArticle

Abstract

In light of the current debate over the meaning of scientifically based research, we argue that qualitative methods should be an essential part of large-scale program evaluations if program effectiveness is to be determined and understood. This article chronicles the challenges involved in incorporating qualitative methods into the large-scale evaluation of the Waterford Early Reading Program and the decisions made in light of those challenges. We demonstrate that, in spite of the challenges, there are significant benefits associated with using qualitative methods on a large scale. More specifically, by using qualitative methods, we were able to improve the evaluation and generate findings that were meaningful and useful to stakeholders. It is our hope that our experiences can be used by others to inform their work as they seek to incorporate qualitative methods into their large-scale evaluations.

Original languageEnglish (US)
Pages (from-to)2543-2565
Number of pages23
JournalTeachers College Record
Volume107
Issue number12
DOIs
StatePublished - Dec 2005

Fingerprint

qualitative method
evaluation
stakeholder
experience

ASJC Scopus subject areas

  • Education

Cite this

@article{e11ce04801f14abba8d4dd1c2cde12f0,
title = "The use of qualitative methods in large-scale evaluation: Improving the quality of the evaluation and the meaningfulness of the findings",
abstract = "In light of the current debate over the meaning of scientifically based research, we argue that qualitative methods should be an essential part of large-scale program evaluations if program effectiveness is to be determined and understood. This article chronicles the challenges involved in incorporating qualitative methods into the large-scale evaluation of the Waterford Early Reading Program and the decisions made in light of those challenges. We demonstrate that, in spite of the challenges, there are significant benefits associated with using qualitative methods on a large scale. More specifically, by using qualitative methods, we were able to improve the evaluation and generate findings that were meaningful and useful to stakeholders. It is our hope that our experiences can be used by others to inform their work as they seek to incorporate qualitative methods into their large-scale evaluations.",
author = "Julie Slayton and Lorena Llosa",
year = "2005",
month = "12",
doi = "10.1111/j.1467-9620.2005.00627.x",
language = "English (US)",
volume = "107",
pages = "2543--2565",
journal = "Teachers College Record",
issn = "0161-4681",
publisher = "Teachers College Record",
number = "12",

}

TY - JOUR

T1 - The use of qualitative methods in large-scale evaluation

T2 - Improving the quality of the evaluation and the meaningfulness of the findings

AU - Slayton, Julie

AU - Llosa, Lorena

PY - 2005/12

Y1 - 2005/12

N2 - In light of the current debate over the meaning of scientifically based research, we argue that qualitative methods should be an essential part of large-scale program evaluations if program effectiveness is to be determined and understood. This article chronicles the challenges involved in incorporating qualitative methods into the large-scale evaluation of the Waterford Early Reading Program and the decisions made in light of those challenges. We demonstrate that, in spite of the challenges, there are significant benefits associated with using qualitative methods on a large scale. More specifically, by using qualitative methods, we were able to improve the evaluation and generate findings that were meaningful and useful to stakeholders. It is our hope that our experiences can be used by others to inform their work as they seek to incorporate qualitative methods into their large-scale evaluations.

AB - In light of the current debate over the meaning of scientifically based research, we argue that qualitative methods should be an essential part of large-scale program evaluations if program effectiveness is to be determined and understood. This article chronicles the challenges involved in incorporating qualitative methods into the large-scale evaluation of the Waterford Early Reading Program and the decisions made in light of those challenges. We demonstrate that, in spite of the challenges, there are significant benefits associated with using qualitative methods on a large scale. More specifically, by using qualitative methods, we were able to improve the evaluation and generate findings that were meaningful and useful to stakeholders. It is our hope that our experiences can be used by others to inform their work as they seek to incorporate qualitative methods into their large-scale evaluations.

UR - http://www.scopus.com/inward/record.url?scp=33745306874&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745306874&partnerID=8YFLogxK

U2 - 10.1111/j.1467-9620.2005.00627.x

DO - 10.1111/j.1467-9620.2005.00627.x

M3 - Article

AN - SCOPUS:33745306874

VL - 107

SP - 2543

EP - 2565

JO - Teachers College Record

JF - Teachers College Record

SN - 0161-4681

IS - 12

ER -