We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
A Note on Construct Validity of the Anchoring Method in PISA 2012.
- Authors
Stankov, Lazar; Lee, Jihyun; von Davier, Matthias
- Abstract
We examine construct validity of the anchoring method used with 12 noncognitive scales from the Programme for International Student Assessment (PISA) 2012 project. This method combines individuals’ responses to vignettes and self-rated scores based on Likert-type items. It has been reported that the use of anchoring vignettes can reverse country-level correlations between academic achievement scores and noncognitive measures from negative to positive, and therefore align them with the typically reported individual-level correlations. Using the PISA 2012 data, we show that construct validity of this approach may be open to question because the anchored scales produce a different set of latent dimensions in comparison with nonanchored scales, even though both scales were created from the same set of individual responses. We also demonstrate that only one of three vignettes may be responsible for the resolution of the “paradox” highlighting that the choice of vignettes may be more important than what was previously reported.
- Subjects
ACADEMIC achievement; STATISTICAL correlation; EXPERIMENTAL design; RESEARCH methodology; CASE studies; SCALE analysis (Psychology); SELF-evaluation; STUDENT attitudes; RATING of students; ETHNOLOGY research; MULTITRAIT multimethod techniques; CULTURAL prejudices; RESEARCH methodology evaluation
- Publication
Journal of Psychoeducational Assessment, 2018, Vol 25, Issue 3, p709
- ISSN
0734-2829
- Publication type
Article
- DOI
10.1177/0734282917702270