The effects of accountability system design on teachers' use of test score data

Jennifer Jennings

    Research output: Contribution to journalArticle

    Abstract

    Background/Context: Many studies have concluded that educational accountability policies increase data use, but we know little about how to design accountability systems to encourage productive versus distortive uses of test score data. Purpose: I propose that five features of accountability systems affect how test score data are used and examine how individual and organizational characteristics interact with system features to influence teachers' data use. First, systems apply varying amounts of pressure. Second, the locus of pressure varies across systems. Third, systems diverge in the distributional goals they set for student performance. Fourth, the characteristics of assessments vary across systems. Finally, systems differ in scope-that is, whether they incorporate multiple measures or are process- or outcome oriented. Research Design: I review the literature on the effects of accountability systems on teachers' data use and propose a research agenda to further our understanding of this area. Conclusions/Recommendations: Researchers have spent much more time analyzing test score data than investigating how teachers use data in their work. Evolving accountability systems provide new opportunities for scholars to study how the interactions between accountability features, individual characteristics, and organizational contexts affect teachers' test score data use.

    Original languageEnglish (US)
    Article number110304
    JournalTeachers College Record
    Volume114
    Issue number11
    StatePublished - 2012

    Fingerprint

    responsibility
    teacher
    research planning
    interaction
    performance
    student

    ASJC Scopus subject areas

    • Education

    Cite this

    The effects of accountability system design on teachers' use of test score data. / Jennings, Jennifer.

    In: Teachers College Record, Vol. 114, No. 11, 110304, 2012.

    Research output: Contribution to journalArticle

    @article{38e4c75990db40adb3d8d136cc889557,
    title = "The effects of accountability system design on teachers' use of test score data",
    abstract = "Background/Context: Many studies have concluded that educational accountability policies increase data use, but we know little about how to design accountability systems to encourage productive versus distortive uses of test score data. Purpose: I propose that five features of accountability systems affect how test score data are used and examine how individual and organizational characteristics interact with system features to influence teachers' data use. First, systems apply varying amounts of pressure. Second, the locus of pressure varies across systems. Third, systems diverge in the distributional goals they set for student performance. Fourth, the characteristics of assessments vary across systems. Finally, systems differ in scope-that is, whether they incorporate multiple measures or are process- or outcome oriented. Research Design: I review the literature on the effects of accountability systems on teachers' data use and propose a research agenda to further our understanding of this area. Conclusions/Recommendations: Researchers have spent much more time analyzing test score data than investigating how teachers use data in their work. Evolving accountability systems provide new opportunities for scholars to study how the interactions between accountability features, individual characteristics, and organizational contexts affect teachers' test score data use.",
    author = "Jennifer Jennings",
    year = "2012",
    language = "English (US)",
    volume = "114",
    journal = "Teachers College Record",
    issn = "0161-4681",
    publisher = "Teachers College Record",
    number = "11",

    }

    TY - JOUR

    T1 - The effects of accountability system design on teachers' use of test score data

    AU - Jennings, Jennifer

    PY - 2012

    Y1 - 2012

    N2 - Background/Context: Many studies have concluded that educational accountability policies increase data use, but we know little about how to design accountability systems to encourage productive versus distortive uses of test score data. Purpose: I propose that five features of accountability systems affect how test score data are used and examine how individual and organizational characteristics interact with system features to influence teachers' data use. First, systems apply varying amounts of pressure. Second, the locus of pressure varies across systems. Third, systems diverge in the distributional goals they set for student performance. Fourth, the characteristics of assessments vary across systems. Finally, systems differ in scope-that is, whether they incorporate multiple measures or are process- or outcome oriented. Research Design: I review the literature on the effects of accountability systems on teachers' data use and propose a research agenda to further our understanding of this area. Conclusions/Recommendations: Researchers have spent much more time analyzing test score data than investigating how teachers use data in their work. Evolving accountability systems provide new opportunities for scholars to study how the interactions between accountability features, individual characteristics, and organizational contexts affect teachers' test score data use.

    AB - Background/Context: Many studies have concluded that educational accountability policies increase data use, but we know little about how to design accountability systems to encourage productive versus distortive uses of test score data. Purpose: I propose that five features of accountability systems affect how test score data are used and examine how individual and organizational characteristics interact with system features to influence teachers' data use. First, systems apply varying amounts of pressure. Second, the locus of pressure varies across systems. Third, systems diverge in the distributional goals they set for student performance. Fourth, the characteristics of assessments vary across systems. Finally, systems differ in scope-that is, whether they incorporate multiple measures or are process- or outcome oriented. Research Design: I review the literature on the effects of accountability systems on teachers' data use and propose a research agenda to further our understanding of this area. Conclusions/Recommendations: Researchers have spent much more time analyzing test score data than investigating how teachers use data in their work. Evolving accountability systems provide new opportunities for scholars to study how the interactions between accountability features, individual characteristics, and organizational contexts affect teachers' test score data use.

    UR - http://www.scopus.com/inward/record.url?scp=84875082287&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84875082287&partnerID=8YFLogxK

    M3 - Article

    VL - 114

    JO - Teachers College Record

    JF - Teachers College Record

    SN - 0161-4681

    IS - 11

    M1 - 110304

    ER -