Researchllmbreast cancerclinical guidelineschatgpt
LLMs Demonstrate Mixed Performance in Breast Cancer Diagnostics
7.1
A 2026 JMIR Medical Informatics study evaluated nine large language models, including ChatGPT‑4o and Claude 3 Opus, on 50 breast‑cancer guideline questions, comparing yes/no answers and analyses to radiologists (residents, fellows, attendings). Using 2024 NCCN and 2013 ACR BI‑RADS standards, ChatGPT‑4o and Claude models scored highest and outperformed fellow physicians in some metrics (P<.05), yet could not fully replace clinical expertise.
Key Points
- 1Answer 50 guideline questions: ChatGPT‑4o and Claude models achieved top accuracy, confidence, and consistency
- 2Indicate potential clinical support: higher scores than fellows suggest useful augmentation for multidisciplinary decisions
- 3Require caution: LLMs cannot replicate complex clinician judgment and need further validation before deployment
Scoring Rationale
Rigorous peer‑reviewed evaluation with practical clinician comparisons, but limited question set and scope limit generalizability.
Sources
Public references used for this report.
Practice with real Health & Insurance data
90 SQL & Python problems · 15 industry datasets
Used by DS/ML engineers at top companies
250 free problems · No credit card
See all Health & Insurance problems
