We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Digital ITEMS Module 1: Reliability in Classical Test Theory.
- Authors
Lewis, Charlie; Chajewski, Michael; Rupp, André A.
- Abstract
Abstract: In this ITEMS module, we provide a two‐part introduction to the topic of reliability from the perspective of classical test theory (CTT). In the first part, which is directed primarily at beginning learners, we review and build on the content presented in the original didactic ITEMS article by Traub and Rowley (1991). Specifically, we discuss the notion of reliability as an intuitive everyday concept to lay the foundation for its formalization as a reliability coefficient via the basic CTT model. We then walk through the step‐by‐step computation of key reliability indices and discuss the data collection conditions under which each is most suitable. In the second part, which is directed primarily at intermediary learners, we present a distribution‐centered perspective on the same content. We discuss the associated assumptions of various CTT models ranging from parallel to congeneric, and review how these affect the choice of reliability statistics. Throughout the module, we use a customized Excel workbook with sample data and basic data manipulation functionalities to illustrate the computation of individual statistics and to allow for structured independent exploration. In addition, we provide quiz questions with diagnostic feedback as well as short videos that walk through sample exercises within the workbook.
- Subjects
TEST theory; EXAMINATION item analysis; SCALE items; TEST validity; EXAMINATION item response theory (Education)
- Publication
Educational Measurement: Issues & Practice, 2018, Vol 37, Issue 2, p71
- ISSN
0731-1745
- Publication type
Article
- DOI
10.1111/emip.12209