We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Investigating Robustness of Item Response Theory Proficiency Estimators to Atypical Response Behaviors Under Two-Stage Multistage Testing.
- Authors
Kim, Sooyeon; Moses, Tim
- Abstract
The purpose of this study is to evaluate the extent to which item response theory ( IRT) proficiency estimation methods are robust to the presence of aberrant responses under the GRE® General Test multistage adaptive testing ( MST) design. To that end, a wide range of atypical response behaviors affecting as much as 10% of the test items were simulated using a generic GRE 2-stage MST and the 2-parameter logistic ( 2PL) IRT model. As expected, some differences were found among the 5 estimators in terms of the recovery of the true theta ability; for example, Bayesian estimators had lower error variance and their estimates were regressed to the mean. Once the IRT theta estimates were scaled onto a comparable reporting score scale, however, it was found that all the estimation methods investigated, including the one currently used to score GRE MSTs, were equally robust under the simulated conditions.
- Subjects
ITEM response theory; EDUCATIONAL tests &; measurements; ABILITY
- Publication
ETS Research Reports Series, 2016, Vol 2016, Issue 2, p1
- ISSN
2330-8516
- Publication type
Article
- DOI
10.1002/ets2.12111