Tag Archives: IAT

Questioning the implicit association test

7 Jul

New York Magazine has published a devastating critique of the widely cited implicit association test (IAT). The creators of the IAT claim that it can ferret unconscious biases. From the point of view of psychometrics, the first important question we must ask about any instrument is its reliability, that is, does the measure yield consistent results if the measured phenomenon has not changed. It is a basic law of measurement that an unreliable measure can not be valid.

Here is what the article says about reliability:

What constitutes an acceptable level of test-retest reliability? It depends a lot on context, but, generally speaking, researchers are comfortable if a given instrument hits r = .8 or so. The IAT’s architects have reported that overall, when you lump together the IAT’s many different varieties, from race to disability to gender, it has a test-retest reliability of about r = .55. By the normal standards of psychology, this puts these IATs well below the threshold of being useful in most practical, real-world settings.

 

%d bloggers like this: