CURE (Clinical Diagnosis, Physician References) - Multiple Choice: leaderboard

Metric: Differential-diagnosis accuracy in percent choosing the diagnosis among 4 to 5 candidates (terminology standardized and distractors generated where needed by GPT-5.2, physician-checked on 50 cases), on CURE's 500 test cases (Eurorad 2025 radiology cases: clinical history, a mean of 8 images, radiologist findings with diagnostic statements removed), zero-shot, given the clinical history, images and the abstracts of the physician-cited references; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro (Preview)88#64
2GPT-5.286.8#105
3Kimi K2.585#139
4Qwen 3 VL 235B A22B (Thinking)80.6#228 (Qwen 3 VL 235B A22B)
5Qwen 3 VL 235B A22B Instruct79.8#264
6GLM-4.6V78.8#309
7Qwen 3 VL 32B (Thinking)78.4#287 (Qwen 3 VL 32B)
8Qwen 3 VL 30B A3B (Thinking)77#338 (Qwen 3 VL 30B A3B)
9Qwen 3 VL 30B A3B Instruct76#365
10Qwen 3 VL 32B Instruct74#276
11Qwen 3 VL 8B Instruct71.6#401
12Qwen 3 VL 8B (Thinking)70.8
13Gemma 3 12B (IT)65.2#655
14MedGemma-4B-IT62#842
15Gemma 3 4B (IT)54.6#971

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=cure-clinical-diagnosis-physician-references-multiple-choice · How It Works · Data refreshed daily, snapshot 2026-10-11.