Reference : A robust outlier approach to prevent Type I error inflation in DIF
Scientific journals : Article
Physical, chemical, mathematical & earth Sciences : Mathematics
A robust outlier approach to prevent Type I error inflation in DIF
Magis, David mailto [Université de Liège - ULg > Département de mathématique > Statistique mathématique >]
De Boeck, Paul [ > > ]
Educational & Psychological Measurement
SAGE Publications
Yes (verified by ORBi)
[en] Differential item functioning ; Mantel-Haenszel ; Type I error ; Outlier ; Robust statistics
[en] The identification of differential item functioning (DIF) is often performed by means of statistical approaches that consider the raw scores as proxys for the ability trait level. One of the most popular approaches, the Mantel-Haenszel (MH) method, belongs to this category. However, replacing the ability level by the simple raw score is a source of potential Type I error inflation, especially in the presence of DIF but also when DIF is absent and in the presence of impact. The purpose of this paper is to present an alternative statistical inference approach based on the same measure of DIF but such that the Type I error inflation is prevented. The key notion is that for DIF items, the measure has an outlying value which can be identified as such with inference tools from robust statistics. Although we use the MH log-odds ratio as a statistic, the inference is different. A simulation study is performed to compare the robust statistical inference with the classical inference method, both based on the MH statistic. As expected the Type I error rate inflation is avoided with the robust approach, while the power of the two methods is similar.

File(s) associated to this reference

Fulltext file(s):

Restricted access
EPM paper.pdfAuthor preprint1.04 MBRequest copy

Bookmark and Share SFX Query

All documents in ORBi are protected by a user license.