We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Prospective validation of dermoscopy-based open-source artificial intelligence for melanoma diagnosis (PROVE-AI study).
- Authors
Marchetti, Michael A.; Cowen, Emily A.; Kurtansky, Nicholas R.; Weber, Jochen; Dauscher, Megan; DeFazio, Jennifer; Deng, Liang; Dusza, Stephen W.; Haliasos, Helen; Halpern, Allan C.; Hosein, Sharif; Nazir, Zaeem H.; Marghoob, Ashfaq A.; Quigley, Elizabeth A.; Salvador, Trina; Rotemberg, Veronica M.
- Abstract
The use of artificial intelligence (AI) has the potential to improve the assessment of lesions suspicious of melanoma, but few clinical studies have been conducted. We validated the accuracy of an open-source, non-commercial AI algorithm for melanoma diagnosis and assessed its potential impact on dermatologist decision-making. We conducted a prospective, observational clinical study to assess the diagnostic accuracy of the AI algorithm (ADAE) in predicting melanoma from dermoscopy skin lesion images. The primary aim was to assess the reliability of ADAE's sensitivity at a predefined threshold of 95%. Patients who had consented for a skin biopsy to exclude melanoma were eligible. Dermatologists also estimated the probability of melanoma and indicated management choices before and after real-time exposure to ADAE scores. All lesions underwent biopsy. Four hundred thirty-five participants were enrolled and contributed 603 lesions (95 melanomas). Participants had a mean age of 59 years, 54% were female, and 96% were White individuals. At the predetermined 95% sensitivity threshold, ADAE had a sensitivity of 96.8% (95% CI: 91.1–98.9%) and specificity of 37.4% (95% CI: 33.3–41.7%). The dermatologists' ability to assess melanoma risk significantly improved after ADAE exposure (AUC 0.7798 vs. 0.8161, p = 0.042). Post-ADAE dermatologist decisions also had equivalent or higher net benefit compared to biopsying all lesions. We validated the accuracy of an open-source melanoma AI algorithm and showed its theoretical potential for improving dermatology experts' ability to evaluate lesions suspicious of melanoma. Larger randomized trials are needed to fully evaluate the potential of adopting this AI algorithm into clinical workflows.
- Subjects
MELANOMA diagnosis; MELANOMA treatment; DERMATOLOGISTS; COMPUTER software; KERATOSIS; KRUSKAL-Wallis Test; PREDICTIVE tests; SCIENTIFIC observation; BIOPSY; CONFIDENCE intervals; NEVUS; CONFIDENCE; MELANOMA; CALIBRATION; ARTIFICIAL intelligence; RETROSPECTIVE studies; FISHER exact test; ACTINIC keratosis; LENTIGO; COMPARATIVE studies; DERMOSCOPY; RESEARCH funding; DESCRIPTIVE statistics; SYMPTOMS; COMPUTER-aided diagnosis; DECISION making in clinical medicine; SENSITIVITY &; specificity (Statistics); PHYSICIANS; ODDS ratio; DATA analysis software; RECEIVER operating characteristic curves; ALGORITHMS; LONGITUDINAL method; KERATINOCYTES; SQUAMOUS cell carcinoma
- Publication
NPJ Digital Medicine, 2023, Vol 6, Issue 1, p1
- ISSN
2398-6352
- Publication type
Article
- DOI
10.1038/s41746-023-00872-1