CURE (Clinical Diagnosis, RAG) - Multiple Choice: leaderboard

Metric: Differential-diagnosis accuracy in percent choosing the diagnosis among 4 to 5 candidates (terminology standardized and distractors generated where needed by GPT-5.2, physician-checked on 50 cases), on CURE's 500 test cases (Eurorad 2025 radiology cases: clinical history, a mean of 8 images, radiologist findings with diagnostic statements removed), zero-shot, given the clinical history, images and the top PubMed abstracts retrieved by a fixed bge-large-en-v1.5 plus MedCPT pipeline; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro (Preview)88#64
2GPT-5.285.6#105
3Kimi K2.583.4#139
4Qwen 3 VL 235B A22B (Thinking)79.8#228 (Qwen 3 VL 235B A22B)
5Qwen 3 VL 235B A22B Instruct77.6#264
6GLM-4.6V77.4#309
7Qwen 3 VL 32B Instruct76.2#276
8Qwen 3 VL 30B A3B Instruct75.6#365
9Qwen 3 VL 32B (Thinking)73.8#287 (Qwen 3 VL 32B)
10Qwen 3 VL 30B A3B (Thinking)73#338 (Qwen 3 VL 30B A3B)
11Qwen 3 VL 8B Instruct69.2#401
12Qwen 3 VL 8B (Thinking)67.6
13Gemma 3 12B (IT)63.6#655
14MedGemma-4B-IT58.2#842
15Gemma 3 4B (IT)47.8#971

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=cure-clinical-diagnosis-rag-multiple-choice · How It Works · Data refreshed daily, snapshot 2026-10-11.