Strong Claims and Weak Evidence

Reassessing the Predictive Validity of the IAT

Hart Blanton, James Jaccard, Jonathan Klick, Barbara Mellers, Gregory Mitchell, Philip E. Tetlock

Research output: Contribution to journalArticle

Abstract

The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold (2001) and J. C. Ziegert and P. J. Hanges (2005)-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.

Original languageEnglish (US)
Pages (from-to)567-582
Number of pages16
JournalJournal of Applied Psychology
Volume94
Issue number3
DOIs
StatePublished - May 2009

Keywords

  • discrimination
  • Implicit Association Test
  • implicit bias
  • predictive validity

ASJC Scopus subject areas

  • Applied Psychology

Cite this

Strong Claims and Weak Evidence : Reassessing the Predictive Validity of the IAT. / Blanton, Hart; Jaccard, James; Klick, Jonathan; Mellers, Barbara; Mitchell, Gregory; Tetlock, Philip E.

In: Journal of Applied Psychology, Vol. 94, No. 3, 05.2009, p. 567-582.

Research output: Contribution to journalArticle

Blanton, Hart ; Jaccard, James ; Klick, Jonathan ; Mellers, Barbara ; Mitchell, Gregory ; Tetlock, Philip E. / Strong Claims and Weak Evidence : Reassessing the Predictive Validity of the IAT. In: Journal of Applied Psychology. 2009 ; Vol. 94, No. 3. pp. 567-582.
@article{26b238d5ef85417eb0846abc97f47ee6,
title = "Strong Claims and Weak Evidence: Reassessing the Predictive Validity of the IAT",
abstract = "The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold (2001) and J. C. Ziegert and P. J. Hanges (2005)-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.",
keywords = "discrimination, Implicit Association Test, implicit bias, predictive validity",
author = "Hart Blanton and James Jaccard and Jonathan Klick and Barbara Mellers and Gregory Mitchell and Tetlock, {Philip E.}",
year = "2009",
month = "5",
doi = "10.1037/a0014665",
language = "English (US)",
volume = "94",
pages = "567--582",
journal = "Journal of Applied Psychology",
issn = "0021-9010",
publisher = "American Psychological Association Inc.",
number = "3",

}

TY - JOUR

T1 - Strong Claims and Weak Evidence

T2 - Reassessing the Predictive Validity of the IAT

AU - Blanton, Hart

AU - Jaccard, James

AU - Klick, Jonathan

AU - Mellers, Barbara

AU - Mitchell, Gregory

AU - Tetlock, Philip E.

PY - 2009/5

Y1 - 2009/5

N2 - The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold (2001) and J. C. Ziegert and P. J. Hanges (2005)-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.

AB - The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold (2001) and J. C. Ziegert and P. J. Hanges (2005)-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.

KW - discrimination

KW - Implicit Association Test

KW - implicit bias

KW - predictive validity

UR - http://www.scopus.com/inward/record.url?scp=65649135469&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=65649135469&partnerID=8YFLogxK

U2 - 10.1037/a0014665

DO - 10.1037/a0014665

M3 - Article

VL - 94

SP - 567

EP - 582

JO - Journal of Applied Psychology

JF - Journal of Applied Psychology

SN - 0021-9010

IS - 3

ER -