We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Validity and Judgment Bias in Visual Analysis of Single-Case Data.
- Authors
Wilbert, Jürgen; Bosch, Jannis; Lüke, Timo
- Abstract
Analysis of data from single-case intervention studies commonly involves visual analysis. Previous research indicates that visual analysis may suffer from low reliability and unpromising error rates. We investigated the reliability and validity of visual analysis and explored to what extent data trends affect judgments. We administered a within-subject experiment in which 186 teacher-education students visually analyzed specifically constructed single-case graphs that included either an intervention effect, a trend effect, both effects, or no effect. Participants identified intervention effects in 75% of the graphs, regardless of the existence of a trend. Type I error rates were low (5%) in graphs without a trend but increased fivefold (25%) for graphs with a trend. Inter- and intra-rater reliability was low, particularly when a trend was present in the data.
- Subjects
JUDGMENT (Logic); TREND analysis; CURRICULUM-based assessment; RELIABILITY (Personality trait); TEST validity
- Publication
International Journal for Research in Learning Disabilities, 2021, Vol 5, Issue 1, p13
- ISSN
2325-565X
- Publication type
Article
- DOI
10.28987/5.1.13