From Local to Global: External Validity in a Fertility Natural Experiment

Rajeev Dehejia, Cristian Pop-Eleches, Cyrus Samii

Research output: Contribution to journalArticle

Abstract

We study issues related to external validity for treatment effects using over 100 replications of the Angrist and Evans natural experiment on the effects of sibling sex composition on fertility and labor supply. The replications are based on census data from around the world going back to 1960. We decompose sources of error in predicting treatment effects in external contexts in terms of macro and micro sources of variation. In our empirical setting, we find that macro covariates dominate over micro covariates for reducing errors in predicting treatments, an issue that past studies of external validity have been unable to evaluate. We develop methods for two applications to evidence-based decision-making, including determining where to locate an experiment and whether policy-makers should commission new experiments or rely on an existing evidence base for making a policy decision.

Original languageEnglish (US)
JournalJournal of Business and Economic Statistics
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Fertility
fertility
Treatment Effects
Replication
Covariates
experiment
Labor Supply
Experiment
labor supply
Census
evidence
census
Decision Making
decision making
Decompose
Evaluate
External validity
Natural experiment
Treatment effects
Evidence

Keywords

  • Experiments
  • Extrapolation
  • Prediction

ASJC Scopus subject areas

  • Statistics and Probability
  • Social Sciences (miscellaneous)
  • Economics and Econometrics
  • Statistics, Probability and Uncertainty

Cite this

From Local to Global : External Validity in a Fertility Natural Experiment. / Dehejia, Rajeev; Pop-Eleches, Cristian; Samii, Cyrus.

In: Journal of Business and Economic Statistics, 01.01.2019.

Research output: Contribution to journalArticle

@article{c06ae913eccd4f60b86becf8b3566ad6,
title = "From Local to Global: External Validity in a Fertility Natural Experiment",
abstract = "We study issues related to external validity for treatment effects using over 100 replications of the Angrist and Evans natural experiment on the effects of sibling sex composition on fertility and labor supply. The replications are based on census data from around the world going back to 1960. We decompose sources of error in predicting treatment effects in external contexts in terms of macro and micro sources of variation. In our empirical setting, we find that macro covariates dominate over micro covariates for reducing errors in predicting treatments, an issue that past studies of external validity have been unable to evaluate. We develop methods for two applications to evidence-based decision-making, including determining where to locate an experiment and whether policy-makers should commission new experiments or rely on an existing evidence base for making a policy decision.",
keywords = "Experiments, Extrapolation, Prediction",
author = "Rajeev Dehejia and Cristian Pop-Eleches and Cyrus Samii",
year = "2019",
month = "1",
day = "1",
doi = "10.1080/07350015.2019.1639407",
language = "English (US)",
journal = "Journal of Business and Economic Statistics",
issn = "0735-0015",
publisher = "American Statistical Association",

}

TY - JOUR

T1 - From Local to Global

T2 - External Validity in a Fertility Natural Experiment

AU - Dehejia, Rajeev

AU - Pop-Eleches, Cristian

AU - Samii, Cyrus

PY - 2019/1/1

Y1 - 2019/1/1

N2 - We study issues related to external validity for treatment effects using over 100 replications of the Angrist and Evans natural experiment on the effects of sibling sex composition on fertility and labor supply. The replications are based on census data from around the world going back to 1960. We decompose sources of error in predicting treatment effects in external contexts in terms of macro and micro sources of variation. In our empirical setting, we find that macro covariates dominate over micro covariates for reducing errors in predicting treatments, an issue that past studies of external validity have been unable to evaluate. We develop methods for two applications to evidence-based decision-making, including determining where to locate an experiment and whether policy-makers should commission new experiments or rely on an existing evidence base for making a policy decision.

AB - We study issues related to external validity for treatment effects using over 100 replications of the Angrist and Evans natural experiment on the effects of sibling sex composition on fertility and labor supply. The replications are based on census data from around the world going back to 1960. We decompose sources of error in predicting treatment effects in external contexts in terms of macro and micro sources of variation. In our empirical setting, we find that macro covariates dominate over micro covariates for reducing errors in predicting treatments, an issue that past studies of external validity have been unable to evaluate. We develop methods for two applications to evidence-based decision-making, including determining where to locate an experiment and whether policy-makers should commission new experiments or rely on an existing evidence base for making a policy decision.

KW - Experiments

KW - Extrapolation

KW - Prediction

UR - http://www.scopus.com/inward/record.url?scp=85070965750&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070965750&partnerID=8YFLogxK

U2 - 10.1080/07350015.2019.1639407

DO - 10.1080/07350015.2019.1639407

M3 - Article

AN - SCOPUS:85070965750

JO - Journal of Business and Economic Statistics

JF - Journal of Business and Economic Statistics

SN - 0735-0015

ER -