We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Online Patient Education in Obstructive Sleep Apnea: ChatGPT versus Google Search.
- Authors
Incerti Parenti, Serena; Bartolucci, Maria Lavinia; Biondi, Elena; Maglioni, Alessandro; Corazza, Giulia; Gracco, Antonio; Alessandri-Bonetti, Giulio
- Abstract
The widespread implementation of artificial intelligence technologies provides an appealing alternative to traditional search engines for online patient healthcare education. This study assessed ChatGPT-3.5's capabilities as a source of obstructive sleep apnea (OSA) information, using Google Search as a comparison. Ten frequently searched questions related to OSA were entered into Google Search and ChatGPT-3.5. The responses were assessed by two independent researchers using the Global Quality Score (GQS), Patient Education Materials Assessment Tool (PEMAT), DISCERN instrument, CLEAR tool, and readability scores (Flesch Reading Ease and Flesch–Kincaid Grade Level). ChatGPT-3.5 significantly outperformed Google Search in terms of GQS (5.00 vs. 2.50, p < 0.0001), DISCERN reliability (35.00 vs. 29.50, p = 0.001), and quality (11.50 vs. 7.00, p = 0.02). The CLEAR tool scores indicated that ChatGPT-3.5 provided excellent content (25.00 vs. 15.50, p < 0.001). PEMAT scores showed higher understandability (60–91% vs. 44–80%) and actionability for ChatGPT-3.5 (0–40% vs. 0%). Readability analysis revealed that Google Search responses were easier to read (FRE: 56.05 vs. 22.00; FKGL: 9.00 vs. 14.00, p < 0.0001). ChatGPT-3.5 delivers higher quality and more comprehensive OSA information compared to Google Search, although its responses are less readable. This suggests that while ChatGPT-3.5 can be a valuable tool for patient education, efforts to improve readability are necessary to ensure accessibility and utility for all patients. Healthcare providers should be aware of the strengths and weaknesses of various healthcare information resources and emphasize the importance of critically evaluating online health information, advising patients on its reliability and relevance.
- Subjects
PATIENT education; GENERATIVE artificial intelligence; HEALTH information services; PROFESSIONAL practice; READABILITY (Literary style); QUESTIONNAIRES; COURSE evaluation (Education); MANN Whitney U Test; CHI-squared test; DESCRIPTIVE statistics; ONLINE education; SLEEP apnea syndromes; SEARCH engines; COMPARATIVE studies; EVIDENCE-based medicine; DATA analysis software; CONFIDENCE intervals; MEDICINE information services
- Publication
Healthcare (2227-9032), 2024, Vol 12, Issue 17, p1781
- ISSN
2227-9032
- Publication type
Article
- DOI
10.3390/healthcare12171781