We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Expected p-values in light of an ROC curve analysis applied to optimal multiple testing procedures.
- Authors
Vexler, Albert; Yu, Jihnhee; Zhao, Yang; Hutson, Alan D.; Gurevich, Gregory
- Abstract
Many statistical studies report p-values for inferential purposes. In several scenarios, the stochastic aspect of p-values is neglected, which may contribute to drawing wrong conclusions in real data experiments. The stochastic nature of p-values makes their use to examine the performance of given testing procedures or associations between investigated factors to be difficult. We turn our focus on the modern statistical literature to address the expected p-value (EPV) as a measure of the performance of decision-making rules. During the course of our study, we prove that the EPV can be considered in the context of receiver operating characteristic (ROC) curve analysis, a well-established biostatistical methodology. The ROC-based framework provides a new and efficient methodology for investigating and constructing statistical decision-making procedures, including: (1) evaluation and visualization of properties of the testing mechanisms, considering, e.g. partial EPVs; (2) developing optimal tests via the minimization of EPVs; (3) creation of novel methods for optimally combining multiple test statistics. We demonstrate that the proposed EPV-based approach allows us to maximize the integrated power of testing algorithms with respect to various significance levels. In an application, we use the proposed method to construct the optimal test and analyze a myocardial infarction disease dataset. We outline the usefulness of the "EPV/ROC" technique for evaluating different decision-making procedures, their constructions and properties with an eye towards practical applications.
- Subjects
RECEIVER operating characteristic curves; STOCHASTIC analysis; P-value (Statistics); STATISTICAL decision making; ALGORITHMS
- Publication
Statistical Methods in Medical Research, 2018, Vol 27, Issue 12, p3560
- ISSN
0962-2802
- Publication type
journal article
- DOI
10.1177/0962280217704451