Article (Scientific journals)
Type I error inflation in DIF identification with Mantel-Haenszel: an explanation and a solution
Magis, David; De Boeck, Paul
2014In Educational and Psychological Measurement, 74, p. 713-728
Peer Reviewed verified by ORBi
 

Files


Full Text
Educational and Psychological measurement 74 (2014), 713-728.pdf
Publisher postprint (179.62 kB)
Request a copy

All documents in ORBi are protected by a user license.

Send to



Details



Keywords :
Differential item functioning; Mantel-Haenszel; impact; Type I error inflation; dispersion
Abstract :
[en] It is known that sum score-based methods for the identification of differential item functioning (DIF), such as the Mantel-Haenszel (MH) approach, can be affected by Type I error inflation in the absence of any DIF effect. This may happen when the items differ in discrimination and when there is item impact. On the other hand, outlier DIF methods have been developed that are robust against this Type I error inflation, while they are still based on the MH DIF statistic. The present paper gives an explanation for why the common MH method is indeed vulnerable to the inflation effect while the outlier DIF versions are not. In a simulation study we were able to produce the Type I error inflation by inducing item impact and item differences in discrimination. At the same time and in parallel with the Type I error inflation the dispersion of the DIF statistic across items was increased. As expected, the outlier DIF methods did not seem sensitive to impact and differences in item discrimination.
Disciplines :
Education & instruction
Author, co-author :
Magis, David ;  Université de Liège - ULiège > Département des sciences biomédicales et précliniques > Histologie
De Boeck, Paul
Language :
English
Title :
Type I error inflation in DIF identification with Mantel-Haenszel: an explanation and a solution
Publication date :
2014
Journal title :
Educational and Psychological Measurement
ISSN :
0013-1644
Publisher :
SAGE Publications
Volume :
74
Pages :
713-728
Peer reviewed :
Peer Reviewed verified by ORBi
Available on ORBi :
since 24 November 2013

Statistics


Number of views
36 (1 by ULiège)
Number of downloads
1 (1 by ULiège)

Scopus citations®
 
8
Scopus citations®
without self-citations
7
OpenCitations
 
7

Bibliography


Similar publications



Contact ORBi