We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Using Multilevel Analysis to Monitor Test Performance Across Administrations.
- Authors
Wei, Youhua; Qu, Yanxuan
- Abstract
For a testing program with frequent administrations, it is important to understand and monitor the stability and fluctuation of test performance across administrations. Different methods have been proposed for this purpose. This study explored the potential of using multilevel analysis to understand and monitor examinees' test performance across administrations based on their background information. Based on the data of 330,091 examinees' test scores and their background information collected from 254 administrations of an English-speaking test, the study found: (a) at the individual examinee level, examinees' background had statistically significant relationships with their test performance, and the relationships varied across administrations; however, the prediction of individuals' test scores based on their background variables was not strong, and (b) at the administration level, group composition had strong relationships with administration means; the prediction of administration means based on group composition variables was fairly strong. The results suggest that multilevel analysis has potential application in understanding and monitoring test performance across administrations by identifying statistical relationships between examinees' characteristics and their test performance at both individual and administration levels.
- Subjects
QUALITY control; PREDICTION models; PERFORMANCE evaluation; EDUCATIONAL testing services; MULTILEVEL models
- Publication
ETS Research Reports Series, 2014, Vol 2014, Issue 2, p1
- ISSN
2330-8516
- Publication type
Article
- DOI
10.1002/ets2.12029