CURE (Clinical Diagnosis, History and Findings) - Top-3: leaderboard

Metric: Open-ended diagnosis, Hit@3 in percent: share of cases whose reference diagnosis is among the model's top 3 ranked diagnoses (matched by a DeepSeek-V3.1 judge, kappa 0.86 against a physician on 50 cases), on CURE's 500 test cases (Eurorad 2025 radiology cases: clinical history, a mean of 8 images, radiologist findings with diagnostic statements removed), zero-shot, given the clinical history and the radiologist's written findings; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 16 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.264.6#105
2Kimi K2.564.2#139
3Qwen 3 VL 235B A22B Instruct60.4#264
4Gemma 3 12B (IT)59#655
5Gemini 3 Pro (Preview)58.6#64
6Gemma 3 4B (IT)58.2#971
7Qwen 3 VL 235B A22B (Thinking)56#228 (Qwen 3 VL 235B A22B)
8Qwen 3 VL 30B A3B Instruct54.8#365
9GLM-4.6V54.8#309
10Qwen 3 VL 32B Instruct54.6#276
11Qwen 3 VL 8B Instruct52#401
12MedGemma-4B-IT51#842
13Qwen 3 VL 32B (Thinking)49#287 (Qwen 3 VL 32B)
14Qwen 3 VL 30B A3B (Thinking)48.6#338 (Qwen 3 VL 30B A3B)
15Qwen 3 VL 8B (Thinking)44

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=cure-clinical-diagnosis-history-and-findings-top-3 · How It Works · Data refreshed daily, snapshot 2026-10-11.