We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Statistical Equivalence Testing Approaches for Mantel-Haenszel DIF Analysis.
- Authors
Casabianca, Jodi M.; Lewis, Charles
- Abstract
The null hypothesis test used in differential item functioning (DIF) detection tests for a subgroup difference in item-level performance--if the null hypothesis of "no DIF" is rejected, the item is flagged for DIF. Conversely, an item is kept in the test form if there is insufficient evidence of DIF. We present frequentist and empirical Bayes approaches for implementing statistical equivalence testing for DIF using the Mantel-Haenszel (MH) DIF statistic. With these approaches, rejection of the null hypothesis of "DIF" allows the conclusion of statistical equivalence, a more stringent criterion for keeping items. In other words, the roles of the null and alternative hypotheses are interchanged in order to have positive evidence that the DIF of an item is small. A simulation study compares the equivalence testing approaches to the traditional MH DIF detection method with the Educational Testing Service classification system. We illustrate the methods with item response data from the 2012 Programme for International Student Assessment.
- Subjects
DIFFERENTIAL item functioning (Research bias); NULL hypothesis; EMPIRICAL Bayes methods; MATHEMATICAL statistics; EQUIVALENCE relations (Set theory)
- Publication
Journal of Educational & Behavioral Statistics, 2018, Vol 43, Issue 4, p407
- ISSN
1076-9986
- Publication type
Article
- DOI
10.3102/1076998617742410