EHRBench: leaderboard

Clinical decision-making (CDM) is central to real-world clinical workflows, where clinicians infer diagnoses, select treatments, or anticipate future health outcomes under incomplete evidence. LLMs are increasingly used to support these decisions due to strong language capabilities, broad biomedical knowledge, and efficiency, yet the reliability of LLMs on real-world clinical decision tasks remain

Metric: Overall Acc (%) (self-reported). Source: benchmarklist.com. Saturation forecast: Around January 2027. 31 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.270.91#110
2GPT-4.169.43#248
3GPT-569.06#98
4Llama 3.3 70B67.28#579
5GPT-4.1 Mini66.79#355
6Qwen 3 32B66.78#443
7GPT-5 Mini66.12#186
8GLM-4 32B66.12#459
9Qwen 2.5 32B64.97#546
10Llama 3 70B63.35#631
11Qwen 3 8B60.87#674
12Qwen 3 4B60.63#829
13GPT-4.1 Nano60.48#731
14glm-4-9B59.62#889
15Yi 1.5 34B58.94#807

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=ehrbench · How It Works · Data refreshed daily, snapshot 2026-10-20.