Plausible assumptions, questionable assumptions and post hoc rationalizations

Will the real IAT, please stand up?

Hart Blanton, James Jaccard, Charlene Christie, Patricia M. Gonzales

Research output: Contribution to journalArticle

Abstract

In a recent article, we described psychometric limitations to the Implicit Association Test (IAT). These limitations restrict the utility of this measure and render it problematic for testing many psychological theories that posit a causal role for implicit attitudes. Past failures to recognize this may have promoted faulty conclusions in the literature. In a critique of our article, Nosek and Sriram rejected our entire analysis. They asserted that our original article was based on faulty assumptions and argued that the IAT performs nicely when these assumptions are replaced by other, more plausible assumptions. We show that these plausible assumptions have all the hallmarks of post hoc rationalizations. They make little theoretical sense, are buttressed by deceptive statistical practices, contradict statements these same researchers have made in the past and do little to advance research and theory on implicit attitudes. We close by considering the vigor with which IAT researchers have dismissed meaningful criticisms of their measure.

Original languageEnglish (US)
Pages (from-to)399-409
Number of pages11
JournalJournal of Experimental Social Psychology
Volume43
Issue number3
DOIs
StatePublished - May 2007

Fingerprint

rationalization
Research Personnel
Psychological Theory
Psychometrics
psychological theory
psychometrics
criticism
Research
Rationalization

Keywords

  • Discrimination
  • Implicit association test
  • Prejudice
  • Psychometrics
  • Theory testing
  • Validity

ASJC Scopus subject areas

  • Social Psychology
  • Sociology and Political Science

Cite this

Plausible assumptions, questionable assumptions and post hoc rationalizations : Will the real IAT, please stand up? / Blanton, Hart; Jaccard, James; Christie, Charlene; Gonzales, Patricia M.

In: Journal of Experimental Social Psychology, Vol. 43, No. 3, 05.2007, p. 399-409.

Research output: Contribution to journalArticle

@article{f08d0afb2f4f4a9b9d727f64502065c5,
title = "Plausible assumptions, questionable assumptions and post hoc rationalizations: Will the real IAT, please stand up?",
abstract = "In a recent article, we described psychometric limitations to the Implicit Association Test (IAT). These limitations restrict the utility of this measure and render it problematic for testing many psychological theories that posit a causal role for implicit attitudes. Past failures to recognize this may have promoted faulty conclusions in the literature. In a critique of our article, Nosek and Sriram rejected our entire analysis. They asserted that our original article was based on faulty assumptions and argued that the IAT performs nicely when these assumptions are replaced by other, more plausible assumptions. We show that these plausible assumptions have all the hallmarks of post hoc rationalizations. They make little theoretical sense, are buttressed by deceptive statistical practices, contradict statements these same researchers have made in the past and do little to advance research and theory on implicit attitudes. We close by considering the vigor with which IAT researchers have dismissed meaningful criticisms of their measure.",
keywords = "Discrimination, Implicit association test, Prejudice, Psychometrics, Theory testing, Validity",
author = "Hart Blanton and James Jaccard and Charlene Christie and Gonzales, {Patricia M.}",
year = "2007",
month = "5",
doi = "10.1016/j.jesp.2006.10.019",
language = "English (US)",
volume = "43",
pages = "399--409",
journal = "Journal of Experimental Social Psychology",
issn = "0022-1031",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - Plausible assumptions, questionable assumptions and post hoc rationalizations

T2 - Will the real IAT, please stand up?

AU - Blanton, Hart

AU - Jaccard, James

AU - Christie, Charlene

AU - Gonzales, Patricia M.

PY - 2007/5

Y1 - 2007/5

N2 - In a recent article, we described psychometric limitations to the Implicit Association Test (IAT). These limitations restrict the utility of this measure and render it problematic for testing many psychological theories that posit a causal role for implicit attitudes. Past failures to recognize this may have promoted faulty conclusions in the literature. In a critique of our article, Nosek and Sriram rejected our entire analysis. They asserted that our original article was based on faulty assumptions and argued that the IAT performs nicely when these assumptions are replaced by other, more plausible assumptions. We show that these plausible assumptions have all the hallmarks of post hoc rationalizations. They make little theoretical sense, are buttressed by deceptive statistical practices, contradict statements these same researchers have made in the past and do little to advance research and theory on implicit attitudes. We close by considering the vigor with which IAT researchers have dismissed meaningful criticisms of their measure.

AB - In a recent article, we described psychometric limitations to the Implicit Association Test (IAT). These limitations restrict the utility of this measure and render it problematic for testing many psychological theories that posit a causal role for implicit attitudes. Past failures to recognize this may have promoted faulty conclusions in the literature. In a critique of our article, Nosek and Sriram rejected our entire analysis. They asserted that our original article was based on faulty assumptions and argued that the IAT performs nicely when these assumptions are replaced by other, more plausible assumptions. We show that these plausible assumptions have all the hallmarks of post hoc rationalizations. They make little theoretical sense, are buttressed by deceptive statistical practices, contradict statements these same researchers have made in the past and do little to advance research and theory on implicit attitudes. We close by considering the vigor with which IAT researchers have dismissed meaningful criticisms of their measure.

KW - Discrimination

KW - Implicit association test

KW - Prejudice

KW - Psychometrics

KW - Theory testing

KW - Validity

UR - http://www.scopus.com/inward/record.url?scp=69849103399&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=69849103399&partnerID=8YFLogxK

U2 - 10.1016/j.jesp.2006.10.019

DO - 10.1016/j.jesp.2006.10.019

M3 - Article

VL - 43

SP - 399

EP - 409

JO - Journal of Experimental Social Psychology

JF - Journal of Experimental Social Psychology

SN - 0022-1031

IS - 3

ER -