We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
INFLUENCES OF RESPONSE RATE AND DISTRIBUTION ON THE CALCULATION OF INTEROBSERVER RELIABILITY SCORES.
- Authors
ROLIDER, NATALIE U.; IWATA, BRIAN A.; BULLOCK, CHRISTOPHER E.
- Abstract
We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high-rate responding, proportional reliability was somewhat lower for high-rate responding, and exact-agreement reliability was the lowest of the measures, especially for high-rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end-of-interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact-agreement reliability markedly.
- Subjects
DISTRIBUTION (Probability theory); BEHAVIORAL research; COMPARATIVE studies; RESPONSE rates; SCREEN savers (Computer programs); DATA analysis
- Publication
Journal of Applied Behavior Analysis, 2012, Vol 45, Issue 4, p753
- ISSN
0021-8855
- Publication type
Article
- DOI
10.1901/jaba.2012.45-753