CURE (Clinical Diagnosis, History and Findings): leaderboard

Metric: Open-ended diagnosis, Hit@1 in percent: share of cases whose reference diagnosis is among the model's top 1 ranked diagnoses (matched by a DeepSeek-V3.1 judge, kappa 0.86 against a physician on 50 cases), on CURE's 500 test cases (Eurorad 2025 radiology cases: clinical history, a mean of 8 images, radiologist findings with diagnostic statements removed), zero-shot, given the clinical history and the radiologist's written findings; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 16 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.254.2#105
2Kimi K2.551.6#139
3Gemini 3 Pro (Preview)51.6#64
4Qwen 3 VL 235B A22B Instruct46.2#264
5Gemma 3 12B (IT)43.4#655
6Qwen 3 VL 32B Instruct43#276
7Qwen 3 VL 235B A22B (Thinking)43#228 (Qwen 3 VL 235B A22B)
8GLM-4.6V41.8#309
9Gemma 3 4B (IT)41.2#971
10Qwen 3 VL 30B A3B Instruct40.6#365
11Qwen 3 VL 8B Instruct39.8#401
12Qwen 3 VL 32B (Thinking)38#287 (Qwen 3 VL 32B)
13Qwen 3 VL 30B A3B (Thinking)36#338 (Qwen 3 VL 30B A3B)
14MedGemma-4B-IT35.8#842
15Qwen 3 VL 8B (Thinking)34.6

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=cure-clinical-diagnosis-history-and-findings · How It Works · Data refreshed daily, snapshot 2026-10-11.