We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Artificial intelligence system for identification of false-negative interpretations in chest radiographs.
- Authors
Hwang, Eui Jin; Park, Jongsoo; Hong, Wonju; Lee, Hyun-Ju; Choi, Hyewon; Kim, Hyungjin; Nam, Ju Gang; Goo, Jin Mo; Yoon, Soon Ho; Lee, Chang Hyun; Park, Chang Min
- Abstract
Objectives: To investigate the efficacy of an artificial intelligence (AI) system for the identification of false negatives in chest radiographs that were interpreted as normal by radiologists. Methods: We consecutively collected chest radiographs that were read as normal during 1 month (March 2020) in a single institution. A commercialized AI system was retrospectively applied to these radiographs. Radiographs with abnormal AI results were then re-interpreted by the radiologist who initially read the radiograph ("AI as the advisor" scenario). The reference standards for the true presence of relevant abnormalities in radiographs were defined by majority voting of three thoracic radiologists. The efficacy of the AI system was evaluated by detection yield (proportion of true-positive identification among the entire examination) and false-referral rate (FRR, proportion of false-positive identification among all examinations). Decision curve analyses were performed to evaluate the net benefits of applying the AI system. Results: A total of 4208 radiographs from 3778 patients (M:F = 1542:2236; median age, 56 years) were included. The AI system identified initially overlooked relevant abnormalities with a detection yield and an FRR of 2.4% and 14.0%, respectively. In the "AI as the advisor" scenario, radiologists detected initially overlooked relevant abnormalities with a detection yield and FRR of 1.2% and 0.97%, respectively. In a decision curve analysis, AI as an advisor scenario exhibited a positive net benefit when the cost-to-benefit ratio was below 1:0.8. Conclusion: An AI system could identify relevant abnormalities overlooked by radiologists and could enable radiologists to correct their false-negative interpretations by providing feedback to radiologists. Key Points: • In consecutive chest radiographs with normal interpretations, an artificial intelligence system could identify relevant abnormalities that were initially overlooked by radiologists. • The artificial intelligence system could enable radiologists to correct their initial false-negative interpretations by providing feedback to radiologists when overlooked abnormalities were present.
- Publication
European Radiology, 2022, Vol 32, Issue 7, p4468
- ISSN
0938-7994
- Publication type
Article
- DOI
10.1007/s00330-022-08593-x