Classification Errors and Bias Regarding Research on Sexual Minority Youths

Research output: Contribution to journalArticle

Abstract

Quantitative research on sexual minority youths (SMYs) has likely contributed to misperceptions about the risk and deviance of this population. In part because it often relies on self-reported data from population-based self-administered questionnaires, this research is susceptible to misclassification bias whereby youths who are not SMYs are classified as such and vice versa. I introduce a taxonomy of classification errors, including seven unique sources, and discuss the potential effects of each error on estimates of youth outcomes. Through examples, I illustrate how researchers can detect and correct such errors and discuss how piecewise attempts to address bias can sometimes unintentionally exacerbate other forms of bias. Finally, I propose a unified conceptual model for addressing the various error sources, urging researchers to take a proactive and integrative approach to data validity by attending to errors at each step in the research process, from questionnaire development to data analysis. Although I focus on errors specific to the topic of sexuality research on youths, this argument can serve as a broader template for the development of taxonomies of error along other dimensions considered in educational research, such as race and disability status.

Original languageEnglish (US)
Pages (from-to)517-529
Number of pages13
JournalEducational Researcher
Volume46
Issue number9
DOIs
StatePublished - Dec 1 2017

Fingerprint

minority
trend
taxonomy
questionnaire
quantitative research
deviant behavior
research process
educational research
sexuality
data analysis
disability

Keywords

  • adolescence
  • at-risk students
  • classification error
  • conceptual model
  • dichotomization
  • disparities
  • evaluation
  • fluidity
  • gay/lesbian studies
  • LGBQ
  • mischievous responders
  • research methodology
  • sexual minorities
  • taxonomy
  • validity/reliability

ASJC Scopus subject areas

  • Education

Cite this

Classification Errors and Bias Regarding Research on Sexual Minority Youths. / Cimpian, Joseph.

In: Educational Researcher, Vol. 46, No. 9, 01.12.2017, p. 517-529.

Research output: Contribution to journalArticle

@article{7bcacc191aaa4e9b9a462eb3fd4db58e,
title = "Classification Errors and Bias Regarding Research on Sexual Minority Youths",
abstract = "Quantitative research on sexual minority youths (SMYs) has likely contributed to misperceptions about the risk and deviance of this population. In part because it often relies on self-reported data from population-based self-administered questionnaires, this research is susceptible to misclassification bias whereby youths who are not SMYs are classified as such and vice versa. I introduce a taxonomy of classification errors, including seven unique sources, and discuss the potential effects of each error on estimates of youth outcomes. Through examples, I illustrate how researchers can detect and correct such errors and discuss how piecewise attempts to address bias can sometimes unintentionally exacerbate other forms of bias. Finally, I propose a unified conceptual model for addressing the various error sources, urging researchers to take a proactive and integrative approach to data validity by attending to errors at each step in the research process, from questionnaire development to data analysis. Although I focus on errors specific to the topic of sexuality research on youths, this argument can serve as a broader template for the development of taxonomies of error along other dimensions considered in educational research, such as race and disability status.",
keywords = "adolescence, at-risk students, classification error, conceptual model, dichotomization, disparities, evaluation, fluidity, gay/lesbian studies, LGBQ, mischievous responders, research methodology, sexual minorities, taxonomy, validity/reliability",
author = "Joseph Cimpian",
year = "2017",
month = "12",
day = "1",
doi = "10.3102/0013189X17733973",
language = "English (US)",
volume = "46",
pages = "517--529",
journal = "Educational Researcher",
issn = "0013-189X",
publisher = "SAGE Publications Inc.",
number = "9",

}

TY - JOUR

T1 - Classification Errors and Bias Regarding Research on Sexual Minority Youths

AU - Cimpian, Joseph

PY - 2017/12/1

Y1 - 2017/12/1

N2 - Quantitative research on sexual minority youths (SMYs) has likely contributed to misperceptions about the risk and deviance of this population. In part because it often relies on self-reported data from population-based self-administered questionnaires, this research is susceptible to misclassification bias whereby youths who are not SMYs are classified as such and vice versa. I introduce a taxonomy of classification errors, including seven unique sources, and discuss the potential effects of each error on estimates of youth outcomes. Through examples, I illustrate how researchers can detect and correct such errors and discuss how piecewise attempts to address bias can sometimes unintentionally exacerbate other forms of bias. Finally, I propose a unified conceptual model for addressing the various error sources, urging researchers to take a proactive and integrative approach to data validity by attending to errors at each step in the research process, from questionnaire development to data analysis. Although I focus on errors specific to the topic of sexuality research on youths, this argument can serve as a broader template for the development of taxonomies of error along other dimensions considered in educational research, such as race and disability status.

AB - Quantitative research on sexual minority youths (SMYs) has likely contributed to misperceptions about the risk and deviance of this population. In part because it often relies on self-reported data from population-based self-administered questionnaires, this research is susceptible to misclassification bias whereby youths who are not SMYs are classified as such and vice versa. I introduce a taxonomy of classification errors, including seven unique sources, and discuss the potential effects of each error on estimates of youth outcomes. Through examples, I illustrate how researchers can detect and correct such errors and discuss how piecewise attempts to address bias can sometimes unintentionally exacerbate other forms of bias. Finally, I propose a unified conceptual model for addressing the various error sources, urging researchers to take a proactive and integrative approach to data validity by attending to errors at each step in the research process, from questionnaire development to data analysis. Although I focus on errors specific to the topic of sexuality research on youths, this argument can serve as a broader template for the development of taxonomies of error along other dimensions considered in educational research, such as race and disability status.

KW - adolescence

KW - at-risk students

KW - classification error

KW - conceptual model

KW - dichotomization

KW - disparities

KW - evaluation

KW - fluidity

KW - gay/lesbian studies

KW - LGBQ

KW - mischievous responders

KW - research methodology

KW - sexual minorities

KW - taxonomy

KW - validity/reliability

UR - http://www.scopus.com/inward/record.url?scp=85038598904&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85038598904&partnerID=8YFLogxK

U2 - 10.3102/0013189X17733973

DO - 10.3102/0013189X17733973

M3 - Article

VL - 46

SP - 517

EP - 529

JO - Educational Researcher

JF - Educational Researcher

SN - 0013-189X

IS - 9

ER -