We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Estimating Classification Accuracy for Complex Decision Rules Based on Multiple Scores.
- Authors
Douglas, Karen M.; Mislevy, Robert J.
- Abstract
Important decisions about students are made by combining multiple measures using complex decision rules. Although methods for characterizing the accuracy of decisions based on a single measure have been suggested by numerous researchers, such methods are not useful for estimating the accuracy of decisions based on multiple measures. This study presents a simulation method useful for estimating classification accuracy for any measurement model and complex decision rule. The utility of the method is demonstrated by application to actual data from General Educational Development (GED) test takers. Findings in this study illustrate how multiple scores that are combined can have a large impact on the accuracy of the resulting decision. Furthermore, choice of measure of agreement is of central importance in describing decision accuracy.
- Subjects
DECISION making; HIGH-stakes tests; EDUCATIONAL tests &; measurements; GED tests; TEST validity; ACADEMIC achievement
- Publication
Journal of Educational & Behavioral Statistics, 2010, Vol 35, Issue 3, p280
- ISSN
1076-9986
- Publication type
Article
- DOI
10.3102/1076998609346969