Opening the black box: Intervention fidelity in a randomized trial of a preschool teacher professional development program

Susana Mendive, Christina Weiland, Hirokazu Yoshikawa, Catherine Snow

Research output: Contribution to journalArticle

Abstract

Un Buen Comienzo [A Good Start] was a professional development program implemented with prekindergarten and kindergarten teachers in Chilean public schools serving low-income families. In a randomized trial, the program showed moderate to large impacts on classroom quality but no impacts on targeted child outcomes. To unpack these findings, we examined intervention fidelity (IF) in both treatment and control groups. Specifically, the study examined (a) whether teachers in the treatment group showed greater fidelity to teaching practices prescribed by the intervention, as measured by dosage and adherence, at the end of prekindergarten and the end of kindergarten, than their control-group counterparts; and (b) whether language and literacy instructional dosage predicted gains in children's language and literacy outcomes at the end of prekindergarten and the end of kindergarten. IF data were coded minute by minute from videotapes of study classrooms collected at the beginning of prekindergarten, the end of prekindergarten, and the end of kindergarten. There were significant and large impacts of the intervention on dosage and adherence. Additionally, small but statistically significant associations were found between 2-year accumulated overall program dosage and children's reading and writing skills at the end of kindergarten. Results reveal that teacher practices changed in response to the intervention, but that increases in time spent on language and literacy instruction were not very substantial. This pattern may explain the absence of an overall impact on children's skills in the experimental study. Findings have implications for the design of both future preschool interventions and IF studies.

Original languageEnglish (US)
Pages (from-to)130-145
Number of pages16
JournalJournal of Educational Psychology
Volume108
Issue number1
DOIs
StatePublished - Jan 1 2016

Fingerprint

kindergarten
Language
teacher
Child Language
Control Groups
Videotape Recording
literacy
Reading
Teaching
language
kindergarten teacher
classroom
Therapeutics
Group
Literacy
teaching practice
low income
instruction
school

Keywords

  • Early childhood education
  • Early literacy
  • Intervention fidelity
  • Randomized controlled trials
  • Teacher professional development

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Education

Cite this

Opening the black box : Intervention fidelity in a randomized trial of a preschool teacher professional development program. / Mendive, Susana; Weiland, Christina; Yoshikawa, Hirokazu; Snow, Catherine.

In: Journal of Educational Psychology, Vol. 108, No. 1, 01.01.2016, p. 130-145.

Research output: Contribution to journalArticle

@article{e399f037e1124b40b889c1fa10bd85ec,
title = "Opening the black box: Intervention fidelity in a randomized trial of a preschool teacher professional development program",
abstract = "Un Buen Comienzo [A Good Start] was a professional development program implemented with prekindergarten and kindergarten teachers in Chilean public schools serving low-income families. In a randomized trial, the program showed moderate to large impacts on classroom quality but no impacts on targeted child outcomes. To unpack these findings, we examined intervention fidelity (IF) in both treatment and control groups. Specifically, the study examined (a) whether teachers in the treatment group showed greater fidelity to teaching practices prescribed by the intervention, as measured by dosage and adherence, at the end of prekindergarten and the end of kindergarten, than their control-group counterparts; and (b) whether language and literacy instructional dosage predicted gains in children's language and literacy outcomes at the end of prekindergarten and the end of kindergarten. IF data were coded minute by minute from videotapes of study classrooms collected at the beginning of prekindergarten, the end of prekindergarten, and the end of kindergarten. There were significant and large impacts of the intervention on dosage and adherence. Additionally, small but statistically significant associations were found between 2-year accumulated overall program dosage and children's reading and writing skills at the end of kindergarten. Results reveal that teacher practices changed in response to the intervention, but that increases in time spent on language and literacy instruction were not very substantial. This pattern may explain the absence of an overall impact on children's skills in the experimental study. Findings have implications for the design of both future preschool interventions and IF studies.",
keywords = "Early childhood education, Early literacy, Intervention fidelity, Randomized controlled trials, Teacher professional development",
author = "Susana Mendive and Christina Weiland and Hirokazu Yoshikawa and Catherine Snow",
year = "2016",
month = "1",
day = "1",
doi = "10.1037/edu0000047",
language = "English (US)",
volume = "108",
pages = "130--145",
journal = "Journal of Educational Psychology",
issn = "0022-0663",
publisher = "American Psychological Association Inc.",
number = "1",

}

TY - JOUR

T1 - Opening the black box

T2 - Intervention fidelity in a randomized trial of a preschool teacher professional development program

AU - Mendive, Susana

AU - Weiland, Christina

AU - Yoshikawa, Hirokazu

AU - Snow, Catherine

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Un Buen Comienzo [A Good Start] was a professional development program implemented with prekindergarten and kindergarten teachers in Chilean public schools serving low-income families. In a randomized trial, the program showed moderate to large impacts on classroom quality but no impacts on targeted child outcomes. To unpack these findings, we examined intervention fidelity (IF) in both treatment and control groups. Specifically, the study examined (a) whether teachers in the treatment group showed greater fidelity to teaching practices prescribed by the intervention, as measured by dosage and adherence, at the end of prekindergarten and the end of kindergarten, than their control-group counterparts; and (b) whether language and literacy instructional dosage predicted gains in children's language and literacy outcomes at the end of prekindergarten and the end of kindergarten. IF data were coded minute by minute from videotapes of study classrooms collected at the beginning of prekindergarten, the end of prekindergarten, and the end of kindergarten. There were significant and large impacts of the intervention on dosage and adherence. Additionally, small but statistically significant associations were found between 2-year accumulated overall program dosage and children's reading and writing skills at the end of kindergarten. Results reveal that teacher practices changed in response to the intervention, but that increases in time spent on language and literacy instruction were not very substantial. This pattern may explain the absence of an overall impact on children's skills in the experimental study. Findings have implications for the design of both future preschool interventions and IF studies.

AB - Un Buen Comienzo [A Good Start] was a professional development program implemented with prekindergarten and kindergarten teachers in Chilean public schools serving low-income families. In a randomized trial, the program showed moderate to large impacts on classroom quality but no impacts on targeted child outcomes. To unpack these findings, we examined intervention fidelity (IF) in both treatment and control groups. Specifically, the study examined (a) whether teachers in the treatment group showed greater fidelity to teaching practices prescribed by the intervention, as measured by dosage and adherence, at the end of prekindergarten and the end of kindergarten, than their control-group counterparts; and (b) whether language and literacy instructional dosage predicted gains in children's language and literacy outcomes at the end of prekindergarten and the end of kindergarten. IF data were coded minute by minute from videotapes of study classrooms collected at the beginning of prekindergarten, the end of prekindergarten, and the end of kindergarten. There were significant and large impacts of the intervention on dosage and adherence. Additionally, small but statistically significant associations were found between 2-year accumulated overall program dosage and children's reading and writing skills at the end of kindergarten. Results reveal that teacher practices changed in response to the intervention, but that increases in time spent on language and literacy instruction were not very substantial. This pattern may explain the absence of an overall impact on children's skills in the experimental study. Findings have implications for the design of both future preschool interventions and IF studies.

KW - Early childhood education

KW - Early literacy

KW - Intervention fidelity

KW - Randomized controlled trials

KW - Teacher professional development

UR - http://www.scopus.com/inward/record.url?scp=84954370931&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954370931&partnerID=8YFLogxK

U2 - 10.1037/edu0000047

DO - 10.1037/edu0000047

M3 - Article

AN - SCOPUS:84954370931

VL - 108

SP - 130

EP - 145

JO - Journal of Educational Psychology

JF - Journal of Educational Psychology

SN - 0022-0663

IS - 1

ER -