MedRoundsQA - Single-Turn Diagnosis: leaderboard
MedRoundsQA diagnosis accuracy in percent, preserving the source doctor-agent checkpoint identifiers in Appendix Table 9. Single-turn uses standardized record-style input; multi-turn scores the interactive diagnostic consultation. Reported means retain separate model identities.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Kimi K2.5 | 72 | #152 |
| 2 | GPT-4o (2024-08-06) | 67.47 | #343 |
| 3 | DeepSeek V3 | 66.1 | #329 |
| 4 | Gemini 2.5 Flash (Preview 05-20) | 65.75 | #229 |
| 5 | GLM-5 | 64.73 | #149 |
| 6 | Qwen 3 VL 32B Instruct | 63 | #290 |
| 7 | MiniMax-M2.5 | 60.27 | #316 |
| 8 | Llama 3 8B UltraMedical | 50 | #1186 |
| 9 | Ministral-3-8B-Instruct-2512 | 36.3 | #663 |
| 10 | Phi-4 | 33.22 | #707 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=medroundsqa-single-turn-diagnosis · How It Works · Data refreshed daily, snapshot 2026-11-05.