Regression Discontinuity Designs With Multiple Rating-Score Variables

Sean F. Reardon, Joseph P. Robinson

Research output: Contribution to journalArticle

Abstract

In the absence of a randomized control trial, regression discontinuity (RD) designs can produce plausible estimates of the treatment effect on an outcome for individuals near a cutoff score. In the standard RD design, individuals with rating scores higher than some exogenously determined cutoff score are assigned to one treatment condition; those with rating scores below the cutoff score are assigned to an alternate treatment condition. Many education policies, however, assign treatment status on the basis of more than one rating-score dimension. We refer to this class of RD designs as "multiple rating score regression discontinuity" (MRSRD) designs. In this paper, we discuss five different approaches to estimating treatment effects using MRSRD designs (response surface RD; frontier RD; fuzzy frontier RD; distance-based RD; and binding-score RD). We discuss differences among them in terms of their estimands, applications, statistical power, and potential extensions for studying heterogeneity of treatment effects.

Original languageEnglish (US)
Pages (from-to)83-104
Number of pages22
JournalJournal of Research on Educational Effectiveness
Volume5
Issue number1
DOIs
StatePublished - Jan 2012

Fingerprint

rating
regression
education

Keywords

  • causal inference
  • multiple rating score variables
  • regression discontinuity design

ASJC Scopus subject areas

  • Education

Cite this

Regression Discontinuity Designs With Multiple Rating-Score Variables. / Reardon, Sean F.; Robinson, Joseph P.

In: Journal of Research on Educational Effectiveness, Vol. 5, No. 1, 01.2012, p. 83-104.

Research output: Contribution to journalArticle

@article{3b69be90b9af4a1ebdb5e622f3659deb,
title = "Regression Discontinuity Designs With Multiple Rating-Score Variables",
abstract = "In the absence of a randomized control trial, regression discontinuity (RD) designs can produce plausible estimates of the treatment effect on an outcome for individuals near a cutoff score. In the standard RD design, individuals with rating scores higher than some exogenously determined cutoff score are assigned to one treatment condition; those with rating scores below the cutoff score are assigned to an alternate treatment condition. Many education policies, however, assign treatment status on the basis of more than one rating-score dimension. We refer to this class of RD designs as {"}multiple rating score regression discontinuity{"} (MRSRD) designs. In this paper, we discuss five different approaches to estimating treatment effects using MRSRD designs (response surface RD; frontier RD; fuzzy frontier RD; distance-based RD; and binding-score RD). We discuss differences among them in terms of their estimands, applications, statistical power, and potential extensions for studying heterogeneity of treatment effects.",
keywords = "causal inference, multiple rating score variables, regression discontinuity design",
author = "Reardon, {Sean F.} and Robinson, {Joseph P.}",
year = "2012",
month = "1",
doi = "10.1080/19345747.2011.609583",
language = "English (US)",
volume = "5",
pages = "83--104",
journal = "Journal of Research on Educational Effectiveness",
issn = "1934-5747",
publisher = "Routledge",
number = "1",

}

TY - JOUR

T1 - Regression Discontinuity Designs With Multiple Rating-Score Variables

AU - Reardon, Sean F.

AU - Robinson, Joseph P.

PY - 2012/1

Y1 - 2012/1

N2 - In the absence of a randomized control trial, regression discontinuity (RD) designs can produce plausible estimates of the treatment effect on an outcome for individuals near a cutoff score. In the standard RD design, individuals with rating scores higher than some exogenously determined cutoff score are assigned to one treatment condition; those with rating scores below the cutoff score are assigned to an alternate treatment condition. Many education policies, however, assign treatment status on the basis of more than one rating-score dimension. We refer to this class of RD designs as "multiple rating score regression discontinuity" (MRSRD) designs. In this paper, we discuss five different approaches to estimating treatment effects using MRSRD designs (response surface RD; frontier RD; fuzzy frontier RD; distance-based RD; and binding-score RD). We discuss differences among them in terms of their estimands, applications, statistical power, and potential extensions for studying heterogeneity of treatment effects.

AB - In the absence of a randomized control trial, regression discontinuity (RD) designs can produce plausible estimates of the treatment effect on an outcome for individuals near a cutoff score. In the standard RD design, individuals with rating scores higher than some exogenously determined cutoff score are assigned to one treatment condition; those with rating scores below the cutoff score are assigned to an alternate treatment condition. Many education policies, however, assign treatment status on the basis of more than one rating-score dimension. We refer to this class of RD designs as "multiple rating score regression discontinuity" (MRSRD) designs. In this paper, we discuss five different approaches to estimating treatment effects using MRSRD designs (response surface RD; frontier RD; fuzzy frontier RD; distance-based RD; and binding-score RD). We discuss differences among them in terms of their estimands, applications, statistical power, and potential extensions for studying heterogeneity of treatment effects.

KW - causal inference

KW - multiple rating score variables

KW - regression discontinuity design

UR - http://www.scopus.com/inward/record.url?scp=84855496326&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84855496326&partnerID=8YFLogxK

U2 - 10.1080/19345747.2011.609583

DO - 10.1080/19345747.2011.609583

M3 - Article

VL - 5

SP - 83

EP - 104

JO - Journal of Research on Educational Effectiveness

JF - Journal of Research on Educational Effectiveness

SN - 1934-5747

IS - 1

ER -