We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Type I error rates and power of two randomization test procedures for the changing criterion design.
- Authors
Manolov, Rumen; Tanious, René
- Abstract
Single-case experimental design (SCED) data can be analyzed following different approaches. One of the first historically proposed options is randomizations tests, benefiting from the inclusion of randomization in the design: a desirable methodological feature. Randomization tests have become more feasible with the availability of computational resources, and such tests have been proposed for all major types of SCEDs: multiple-baseline, reversal/withdrawal, alternating treatments, and changing criterion designs. The focus of the current text is on the last of these, given that they have not been the subject of any previous simulation study. Specifically, we estimate type I error rates and statistical power for two different randomization procedures applicable to changing criterion designs: the phase change moment randomization and the blocked alternating criterion randomization. We include different series lengths, number of phases, levels of autocorrelation, and random variability. The results suggest that type I error rates are generally controlled and that sufficient power can be achieved with as few as 28–30 measurements for independent data, although more measurements are needed in case of positive autocorrelation. The presence of a reversal to a previous criterion level is beneficial. R code is provided for carrying out randomization tests following the two randomization procedures.
- Subjects
FALSE positive error; ERROR rates; STATISTICAL power analysis; STATISTICAL errors
- Publication
Behavior Research Methods, 2024, Vol 56, Issue 4, p3637
- ISSN
1554-351X
- Publication type
Article
- DOI
10.3758/s13428-023-02303-1