ChatGPT Tested for Medical Triage Accuracy in Structured Clinical Study

Key Findings

The study found that ChatGPT performed with mixed results across different levels of acuity. For the most critical cases — patients presenting with clear life-threatening emergencies such as cardiac arrest, major trauma, or severe respiratory distress — the model generally performed well, correctly identifying the need for immediate intervention in the majority of cases.

However, performance degraded in the middle triage categories, where the distinction between urgent and semi-urgent cases requires more nuanced clinical judgment. These are precisely the cases where triage errors are most common even among experienced clinicians, and where the consequences of misclassification are most clinically significant.

The model also exhibited inconsistency across repeated evaluations of the same cases. When presented with identical clinical vignettes multiple times, ChatGPT sometimes assigned different triage categories, a finding that raises concerns about the reliability of LLM-based clinical tools in real-world settings where consistency is essential.

• ChatGPT performed best on clearly critical cases but struggled with nuanced middle-acuity triage decisions
• The model showed inconsistency when presented with identical cases multiple times
• Reasoning quality varied significantly, with some assessments demonstrating sound clinical logic and others reflecting apparent confabulation
• The study used standardized vignettes and controlled prompting to ensure rigorous evaluation

Implications for Healthcare AI

The findings have significant implications for the growing movement to integrate AI into healthcare workflows. Proponents of medical AI argue that large language models could help alleviate the severe shortage of emergency physicians and triage nurses, particularly in under-resourced healthcare settings and developing countries where access to trained medical professionals is limited.

The study suggests that while ChatGPT may be useful as a supplementary tool — helping clinicians think through differential diagnoses or flagging potentially overlooked considerations — it is not yet reliable enough to serve as an autonomous triage system. The inconsistency in repeated evaluations is particularly concerning, as clinical decision support tools need to produce the same recommendation given the same inputs.

The researchers note that their findings apply specifically to the version of ChatGPT tested and that model capabilities are evolving rapidly. Newer models with enhanced reasoning capabilities and medical fine-tuning may perform significantly better. However, they caution against deploying any AI system in clinical triage without extensive validation against real-world patient outcomes, not just standardized test cases.

The Regulatory Question

The study also highlights the challenge facing regulators as AI tools increasingly find their way into clinical practice. In many countries, medical decision support software is subject to regulatory approval as a medical device. However, the rapid pace of AI model updates — with new versions released every few months — creates a regulatory challenge, as each update could potentially alter the system's clinical performance.

The U.S. Food and Drug Administration has been developing a framework for regulating AI-based medical devices, including provisions for continuous learning systems that evolve over time. But the framework remains a work in progress, and the gap between the speed of AI development and the pace of regulatory adaptation continues to widen.

Looking Forward

The Nature Medicine study contributes to a growing body of evidence suggesting that large language models show genuine promise in medical applications but are not yet ready for autonomous clinical deployment. The path forward likely involves carefully designed human-AI collaboration systems where the model's recommendations are always subject to human review, combined with ongoing monitoring of clinical outcomes to ensure that AI assistance is actually improving patient care rather than introducing new risks.

For emergency departments already struggling with overcrowding and staffing shortages, even an imperfect AI tool that catches some missed critical cases could save lives. But deploying such a tool responsibly requires the kind of rigorous, structured evaluation exemplified by this study — not just demonstrations of impressive performance on cherry-picked examples.

This article is based on reporting by Nature Medicine. Read the original article.