Keywords
Artificial Intelligence
Bariatric surgery
How to Cite
Copyright © | All rights reserved.
The journal holds the exclusive copyright for the publication of this article under the terms of Brazilian law 9610/98.
Partial reproduction
The use of parts of the texts, figures and questionnaire of the article is free, being mandatory the citation of the authors and journal.
Total reproduction
It is expressly prohibited and must be authorized by the journal.
Abstract
Objective: To assess the quality of the recommendations provided by the artificial intelligence model ChatGPT 4 regarding the management of obese patients in fictional clinical cases. Methods: This is a non-experimental, observational, and cross-sectional study with a quantitative approach, in which bariatric surgeons analyzed the quality of the responses provided by the AI model (ChatGPT 4) concerning the therapeutic plan, surgical indication, and surgical technique when applicable. Results: ChatGPT 4 showed an average agreement rate of 54.2% with expert opinions, with the identification of surgical eligibility being the highest (80% of cases). The surgeons rated the therapeutic plan with an average score of 76.4. However, there was significant disagreement in the choice of surgical technique, particularly in situations requiring complex clinical judgment. Conclusion: This study concludes that while ChatGPT 4 appears promising, its use needs improvement through a collaborative approach integrating human knowledge and technology. ChatGPT 4's responses were classified as "fully adequate" in just over half of the evaluations, suggesting that although AI has promising potential to assist in clinical decision-making, it still requires refinement to achieve a level of reliability compatible with medical practice.
References
ALI A, et al. Performance of ChatGPT and GPT-4 on Neurosurgery Written Board Examinations, Neurosurgery, 2023; 9(6): 1353–1365.
ASKARI A, et al. The surgical management of obesity. Clinical Medicine, 2023; 23(4): 330–336.
CHIESA-ESTOMBA CM, et al. Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support. European archives of oto-rhino-laryngology: official journal of the European Federation of Otorhinolaryngological Societies (EUFOS): affiliated with the German Society for Otorhinolaryngology - Head and Neck Surgery, 2023; 281(4): 2081-2086.
COURCOULAS AP, et al. Long term outcomes of metabolic/bariatric surgery in adults. BMJ, 2023; 383: 71027.
GUMMADI R, et al. Evaluating the accuracy of large language model (ChatGPT) in providing information on metastatic breast cancer, Advanced Pharmaceutical Bulletin, 2024; 14(3): 499–503.
JAZI AHD, et al. Bariatric Evaluation Through AI: a Survey of Expert Opinions Versus ChatGPT-4 (BETA-SEOV), Obesity Surgery, 2023; 33(12): 3971–3980.
LEE Y, et al. Harnessing Artificial Intelligence in Bariatric Surgery: Comparative Analysis of ChatGPT-4, Bing, and Bard in Generating Clinician-Level Bariatric Surgery Recommendations, Surgery for obesity and related diseases, 2024; 20(7): 603-608.
LONG C, et al. Evaluating ChatGPT-4 in otolaryngology–head and neck surgery board examination using the CVSA model. MedRxiv, 2023; 23290758.
LOPES D. The Role of Fundoplication Sleeve Gastrectomy in Obesity Surgery: A Systematic Review and Meta-Analysis. Repositorio-aberto.up.pt, 2024.
LOPEZ-GONZALEZ R, et al. Evaluation of the Impact of ChatGPT on the Selection of Surgical Technique in Bariatric Surgery. Obesity Surgery, 2024.
MUSTAFA A, et al. How does ChatGPT perform on the European Board of Pediatric Surgery examination? A randomized comparative study. Research Square (Research Square), 2023.
NUNES BC, et al. Técnicas Bariátricas: Vantagens, desvantagens e indicações das principais técnicas cirúrgicas. Brazilian Journal of Implantology and Health Sciences, 2024; 6(10): 1737–1749.
OH N, et al. ChatGPT goes to the operating room: evaluating GPT-4 performance and its potential in surgical education and training in the era of large language models. Annals of Surgical Treatment and Research, 2023; 104(5): 269–273.
OZSOY Z e DEMIR E. Which Bariatric Procedure Is the Most Popular in the World? A Bibliometric Comparison. Obesity Surgery, 2018; 28(8): 2339–2352.
PANTELIS A. Current and Potential Applications of Artificial Intelligence in Metabolic Bariatric Surgery. Bariatric Surgery - Past and Present, 2023.
PAULO D, et al. Análise dos fatores que levam mulheres médicas a não optarem por especialidades cirúrgicas. Revista de Medicina, 2020; 99(3): 230–235.
PERDOMO CM, et al. Contemporary medical, device, and surgical therapies for obesity in adults. The Lancet, 2023; 401(10382): 1116-1130.
PREMKUMAR A, et al. Factors Associated With Bariatric Surgery Referral Patterns: A Systematic Review. Journal of Surgical Research, 2022; 276: 54–75.
RAJEEV ND, et al. Patient and the Public’s Perceptions of Bariatric Surgery: A Systematic Review. Journal of Surgical Research, 2023; 283: 385–406.
SCHEFFER M, et al. Demografia Médica no Brasil 2023. São Paulo, SP: FMUSP, AMB, 2023; 344.
SRINIVASAN N, et al. Large language models and bariatric surgery patient education: a comparative readability analysis of GPT-3.5, GPT-4, Bard, and online institutional resources. Surgical Endoscopy, 2024; 38(5): 2522–2532.
TARIQ R e KHANNA S. Artificial Intelligence–Powered Patient Education for Comprehensive and Individualized Understanding for Patients. Clinical Gastroenterology and Hepatology, 2023; 22(7): 1550-1551.
TEMSAH O, et al. Overview of Early ChatGPT’s Presence in Medical Literature: Insights From a Hybrid Literature Review by ChatGPT and Human Experts. Cureus, 2023; 15(4): 37281.