What is it about?
Patients increasingly use artificial intelligence (AI) chatbots such as ChatGPT and Google Gemini to obtain information about breast cancer. However, the accuracy, clarity, and usefulness of AI-generated medical information may vary between systems. In this study, we compared ChatGPT and Gemini responses to 40 frequently asked questions about breast cancer and breast cancer surgery. The questions covered important topics including symptoms, diagnosis, risk factors, imaging, treatment options, prognosis, and treatment-related side effects. Four experienced breast surgeons independently evaluated the AI-generated responses using standardized criteria for scientific accuracy, clarity, and unnecessary detail. Both AI systems generally provided acceptable patient-oriented information. However, ChatGPT received significantly higher scores for scientific accuracy, clarity, and focused content, while Gemini tended to provide longer responses. Our findings suggest that generative AI has potential as a supplementary tool for patient education and access to health information. At the same time, AI-generated medical information should be interpreted carefully and should not replace consultation with healthcare professionals or clinical decision-making. This study highlights both the potential and the limitations of generative AI in breast cancer patient education and provides a standardized comparison of two widely used AI systems in the Turkish language.
Featured Image
Photo by Igor Omilaev on Unsplash
Why is it important?
Patients increasingly use AI chatbots for cancer information, but the accuracy and clarity of AI-generated medical advice can vary. Our study compares ChatGPT and Gemini responses to common breast cancer questions, providing evidence on their potential value and limitations for patient education. The findings highlight the potential of AI as a supplementary information tool while emphasizing the importance of professional oversight.
Perspectives
As a breast surgeon, I found this study particularly meaningful because I see firsthand how often patients turn to online sources and AI tools for answers about breast cancer. I believe AI has great potential to make medical information more accessible and understandable, but it is equally important to recognize its limitations. This research gave me an opportunity to explore the rapidly changing relationship between artificial intelligence and patient education. I hope our findings encourage both healthcare professionals and patients to use AI thoughtfully and responsibly, while keeping expert medical guidance at the center of cancer care. I also see this study as a starting point for further research into how AI can be safely integrated into breast cancer care and patient communication.
Yeliz YILMAZ BOZOK
Izmir Katip Celebi Universitesi
Read the Original
This page is a summary of: Comparative evaluation of ChatGPT and gemini responses to patient-oriented questions on breast cancer, PLOS One, September 2026, PLOS,
DOI: 10.1371/journal.pone.0358325.
You can read the full text:
Contributors
The following have contributed to this page
