Chatbots Provide Inaccurate Guidance For Medical Decisions
In a recent study, researchers tested widely available large language model chatbots with members of the public on common medical scenarios and found striking results. Participants using chatbots were less likely to identify correct conditions and no better at choosing appropriate care settings than controls. The study shows models retain medical knowledge in isolation but fail in real-world human-machine interactions, urging policymakers to require real-world evaluations.
Key Points
- 1Found chatbots reduce user diagnostic accuracy compared with usual information sources in real-world interactions.
- 2Showed models retain medical knowledge yet conversation failures and user omission cause information loss.
- 3Advise policymakers to require real-world evaluations; use AI for documentation rather than frontline diagnosis.
Scoring Rationale
Timely, original study showing significant real-world performance gaps for LLMs in healthcare. High scope and strong actionability for policy and practice increased the score; modestly reduced for limited technical detail and lack of peer-review details.
Sources
Public references used for this report.
Practice with real Health & Insurance data
90 SQL & Python problems · 15 industry datasets
250 free problems · No credit card
See all Health & Insurance problems
