We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Some Paradoxical Results for the Quadratically Weighted Kappa.
- Authors
Warrens, Matthijs
- Abstract
The quadratically weighted kappa is the most commonly used weighted kappa statistic for summarizing interrater agreement on an ordinal scale. The paper presents several properties of the quadratically weighted kappa that are paradoxical. For agreement tables with an odd number of categories n it is shown that if one of the raters uses the same base rates for categories 1 and n, categories 2 and n−1, and so on, then the value of quadratically weighted kappa does not depend on the value of the center cell of the agreement table. Since the center cell reflects the exact agreement of the two raters on the middle category, this result questions the applicability of the quadratically weighted kappa to agreement studies. If one wants to report a single index of agreement for an ordinal scale, it is recommended that the linearly weighted kappa instead of the quadratically weighted kappa is used.
- Subjects
INTER-observer reliability; ORDINAL numbers; PSYCHOMETRICS; EVALUATION methodology; NOMINAL measurement
- Publication
Psychometrika, 2012, Vol 77, Issue 2, p315
- ISSN
0033-3123
- Publication type
Article
- DOI
10.1007/s11336-012-9258-4