CURE (Clinical Diagnosis, History Only): leaderboard

Metric: Open-ended diagnosis, Hit@1 in percent: share of cases whose reference diagnosis is among the model's top 1 ranked diagnoses (matched by a DeepSeek-V3.1 judge, kappa 0.86 against a physician on 50 cases), on CURE's 500 test cases (Eurorad 2025 radiology cases: clinical history, a mean of 8 images, radiologist findings with diagnostic statements removed), zero-shot, given the clinical history only; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro (Preview)19#64
2GPT-5.216.4#105
3Kimi K2.511.6#139
4Qwen 3 VL 32B (Thinking)10.6#287 (Qwen 3 VL 32B)
5MedGemma-4B-IT9.8#842
6Gemma 3 12B (IT)9#655
7Qwen 3 VL 235B A22B (Thinking)9#228 (Qwen 3 VL 235B A22B)
8GLM-4.6V8.6#309
9Qwen 3 VL 235B A22B Instruct8.4#264
10Qwen 3 VL 8B (Thinking)8.4
11Qwen 3 VL 32B Instruct7.6#276
12Qwen 3 VL 30B A3B Instruct7#365
13Gemma 3 4B (IT)6.8#971
14Qwen 3 VL 30B A3B (Thinking)6.6#338 (Qwen 3 VL 30B A3B)
15Qwen 3 VL 8B Instruct4.4#401

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=cure-clinical-diagnosis-history-only · How It Works · Data refreshed daily, snapshot 2026-10-11.