We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
A Bayesian approach to improving measurement precision over multiple test occasions.
- Authors
Van Moere, Alistair; Hanlon, Sean
- Abstract
In language assessment and in educational measurement more broadly, there is a tendency to interpret scores from single-administration tests as accurate indicators of a latent trait (e.g., reading ability). Even in contexts where learners receive multiple formative assessments throughout the year, estimates of student ability are determined based on the most recent assessment. This paper demonstrates a technique that incorporates prior test scores with current scores for learners who re-test periodically, in order to arrive at an estimate closer to the learners' true score. Over 21,000 learners from two separate studies (EFL and native speaker) were tested for reading proficiency between three and five times each, over a one- to two-year period, on a multiple-choice reading test which reported reading ability in Lexile® measures. Applying Bayes theorem, prior scores and the most recent test score were combined with uncertainty parameters (i.e., measurement error) to produce new estimates of student ability. This is advantageous as prior administration data is re-used rather than discarded. The approach is recommended in the context of periodic low-stakes tests designed to measure proficiency gains over time, as well as for high-stakes tests as an alternative to allowing candidates to cherry-pick their highest score for university applications.
- Subjects
TEST of English as a Foreign Language; ENGLISH language education; LANGUAGE ability testing; TEST scoring; ENGLISH language examinations; SCHOOL children; TEST validity
- Publication
Language Testing, 2020, Vol 37, Issue 4, p482
- ISSN
0265-5322
- Publication type
Article
- DOI
10.1177/0265532220934203