EBSCO Logo
Connecting you to content on EBSCOhost
Results
Title

A new integrated discrimination improvement index via odds.

Authors

Hayashi, Kenichi; Eguchi, Shinto

Abstract

Consider adding new covariates to an established binary regression model to improve prediction performance. Although difference in the area under the ROC curve (delta AUC) is typically used to evaluate the degree of improvement in such situations, its power is not high due to being a rank-based statistic. As an alternative to delta AUC, integrated discrimination improvement (IDI) has been proposed by Pencina et al. (2008). However, several papers have pointed out that IDI erroneously detects meaningless improvement. In the present study, we propose a novel index for prediction improvement having Fisher consistency, implying that it overcomes the problems in both delta AUC and IDI. Furthermore, our proposed index also has an advantage that the index we proposed in our previous study (Hayashi and Eguchi 2019) lacked: it does not require any hyperparameters or complicated transformations that would make interpretation difficult.

Subjects

RECEIVER operating characteristic curves; LOGISTIC regression analysis; REGRESSION analysis; PREDICTION models; FORECASTING

Publication

Statistical Papers, 2024, Vol 65, Issue 8, p4971

ISSN

0932-5026

Publication type

Academic Journal

DOI

10.1007/s00362-024-01585-7

EBSCO Connect | Privacy policy | Terms of use | Copyright | Manage my cookies
Journals | Subjects | Sitemap
© 2025 EBSCO Industries, Inc. All rights reserved