Reliability of the core items in the General Social Survey

Estimates from the three-wave panels, 2006-2014

Michael Hout, Orestes P. Hastings

Research output: Contribution to journalArticle

Abstract

We used standard and multilevel models to assess the reliability of core items in the General Social Survey panel studies spanning 2006 to 2014. Most of the 293 core items scored well on the measure of reliability: 62 items (21 percent) had reliability measures greater than 0.85; another 71 (24 percent) had reliability measures between 0.70 and 0.85. Objective items, especially facts about demography and religion, were generally more reliable than subjective items. The economic recession of 2007-2009, the slow recovery afterward, and the election of Barack Obama in 2008 altered the social context in ways that may look like unreliability of items. For example, unemployment status, hours worked, and weeks worked have lower reliability than most work-related items, reflecting the consequences of the recession on the facts of peoples lives. Items regarding racial and gender discrimination and racial stereotypes scored as particularly unreliable, accounting for most of the 15 items with reliability coefficients less than 0.40. Our results allow scholars to more easily take measurement reliability into consideration in their own research, while also highlighting the limitations of these approaches.

Original languageEnglish (US)
Pages (from-to)971-1002
Number of pages32
JournalSociological Science
Volume3
DOIs
StatePublished - Nov 14 2016

Fingerprint

recession
demography
stereotype
unemployment
discrimination
election
Religion
gender
economics

Keywords

  • General Social Survey
  • Measurement error
  • Reliability
  • Survey methodology

ASJC Scopus subject areas

  • Social Sciences(all)

Cite this

Reliability of the core items in the General Social Survey : Estimates from the three-wave panels, 2006-2014. / Hout, Michael; Hastings, Orestes P.

In: Sociological Science, Vol. 3, 14.11.2016, p. 971-1002.

Research output: Contribution to journalArticle

@article{ae27d561c1d240818a5a8cc4b36a6819,
title = "Reliability of the core items in the General Social Survey: Estimates from the three-wave panels, 2006-2014",
abstract = "We used standard and multilevel models to assess the reliability of core items in the General Social Survey panel studies spanning 2006 to 2014. Most of the 293 core items scored well on the measure of reliability: 62 items (21 percent) had reliability measures greater than 0.85; another 71 (24 percent) had reliability measures between 0.70 and 0.85. Objective items, especially facts about demography and religion, were generally more reliable than subjective items. The economic recession of 2007-2009, the slow recovery afterward, and the election of Barack Obama in 2008 altered the social context in ways that may look like unreliability of items. For example, unemployment status, hours worked, and weeks worked have lower reliability than most work-related items, reflecting the consequences of the recession on the facts of peoples lives. Items regarding racial and gender discrimination and racial stereotypes scored as particularly unreliable, accounting for most of the 15 items with reliability coefficients less than 0.40. Our results allow scholars to more easily take measurement reliability into consideration in their own research, while also highlighting the limitations of these approaches.",
keywords = "General Social Survey, Measurement error, Reliability, Survey methodology",
author = "Michael Hout and Hastings, {Orestes P.}",
year = "2016",
month = "11",
day = "14",
doi = "10.15195/v3.a43",
language = "English (US)",
volume = "3",
pages = "971--1002",
journal = "Sociological Science",
issn = "2330-6696",
publisher = "Society for Sociological Science",

}

TY - JOUR

T1 - Reliability of the core items in the General Social Survey

T2 - Estimates from the three-wave panels, 2006-2014

AU - Hout, Michael

AU - Hastings, Orestes P.

PY - 2016/11/14

Y1 - 2016/11/14

N2 - We used standard and multilevel models to assess the reliability of core items in the General Social Survey panel studies spanning 2006 to 2014. Most of the 293 core items scored well on the measure of reliability: 62 items (21 percent) had reliability measures greater than 0.85; another 71 (24 percent) had reliability measures between 0.70 and 0.85. Objective items, especially facts about demography and religion, were generally more reliable than subjective items. The economic recession of 2007-2009, the slow recovery afterward, and the election of Barack Obama in 2008 altered the social context in ways that may look like unreliability of items. For example, unemployment status, hours worked, and weeks worked have lower reliability than most work-related items, reflecting the consequences of the recession on the facts of peoples lives. Items regarding racial and gender discrimination and racial stereotypes scored as particularly unreliable, accounting for most of the 15 items with reliability coefficients less than 0.40. Our results allow scholars to more easily take measurement reliability into consideration in their own research, while also highlighting the limitations of these approaches.

AB - We used standard and multilevel models to assess the reliability of core items in the General Social Survey panel studies spanning 2006 to 2014. Most of the 293 core items scored well on the measure of reliability: 62 items (21 percent) had reliability measures greater than 0.85; another 71 (24 percent) had reliability measures between 0.70 and 0.85. Objective items, especially facts about demography and religion, were generally more reliable than subjective items. The economic recession of 2007-2009, the slow recovery afterward, and the election of Barack Obama in 2008 altered the social context in ways that may look like unreliability of items. For example, unemployment status, hours worked, and weeks worked have lower reliability than most work-related items, reflecting the consequences of the recession on the facts of peoples lives. Items regarding racial and gender discrimination and racial stereotypes scored as particularly unreliable, accounting for most of the 15 items with reliability coefficients less than 0.40. Our results allow scholars to more easily take measurement reliability into consideration in their own research, while also highlighting the limitations of these approaches.

KW - General Social Survey

KW - Measurement error

KW - Reliability

KW - Survey methodology

UR - http://www.scopus.com/inward/record.url?scp=85044122347&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044122347&partnerID=8YFLogxK

U2 - 10.15195/v3.a43

DO - 10.15195/v3.a43

M3 - Article

VL - 3

SP - 971

EP - 1002

JO - Sociological Science

JF - Sociological Science

SN - 2330-6696

ER -