We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Improvement of risk prediction by genomic profiling: reclassification measures versus the area under the receiver operating characteristic curve.
- Authors
Mihaescu, Raluca; van Zitteren, Moniek; van Hoek, Mandy; Sijbrands, Eric J G; Uitterlinden, André G; Witteman, Jacqueline C M; Hofman, Albert; Hunink, M G Myriam; van Duijn, Cornelia M; Janssens, A Cecile J W
- Abstract
Reclassification is observed even when there is no or minimal improvement in the area under the receiver operating characteristic curve (AUC), and it is unclear whether it indicates improved clinical utility. The authors investigated total reclassification, net reclassification improvement, and integrated discrimination improvement for different DeltaAUC using empirical and simulated data. Empirical analyses compared prediction of type 2 diabetes risk based on age, sex, and body mass index with prediction updated with 18 established genetic risk factors. Simulated data were used to investigate measures of reclassification against DeltaAUCs of 0.005, 0.05, and 0.10. Total reclassification and net reclassification improvement were calculated for all possible cutoff values. The AUC of type 2 diabetes risk prediction improved from 0.63 to 0.66 when 18 polymorphisms were added, whereas total reclassification ranged from 0% to 22.5% depending on the cutoff value chosen. In the simulation study, total reclassification, net reclassification improvement, and integrated discrimination improvement increased with higher DeltaAUC. When DeltaAUC was low (0.005), net reclassification improvement values were close to zero, integrated discrimination improvement was 0.08% (P > 0.05), but total reclassification ranged from 0 to 6.7%. Reclassification increases with increasing AUC but predominantly varies with the cutoff values chosen. Reclassification observed in the absence of AUC increase is unlikely to improve clinical utility.
- Publication
American journal of epidemiology, 2010, Vol 172, Issue 3, p353
- ISSN
1476-6256
- Publication type
Journal Article
- DOI
10.1093/aje/kwq122