We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Fleiss' kappa statistic without paradoxes.
- Authors
Falotico, Rosa; Quatto, Piero
- Abstract
The Fleiss' kappa statistic is a well-known index for assessing the reliability of agreement between raters. It is used both in the psychological and in the psychiatric field. Unfortunately, the kappa statistic may behave inconsistently in case of strong agreement between raters, since this index assumes lower values than it would have been expected. The aim of this paper is to propose a new method to avoid this paradox through permutation techniques. Furthermore, we study the problem of kappa confidence intervals and, in particular, we suggest to use Bootstrap confidence intervals free of paradoxes.
- Subjects
COHEN'S kappa coefficient (Statistics); RELIABILITY (Personality trait); MENTAL health services; PERMUTATIONS; MONTE Carlo method
- Publication
Quality & Quantity, 2015, Vol 49, Issue 2, p463
- ISSN
0033-5177
- Publication type
Article
- DOI
10.1007/s11135-014-0003-1