KorMedMCQA-V - Ultrasound: leaderboard

Metric: Accuracy (%) on the questions carrying the 138 ultrasound images (KorMedMCQA-V: image-based five-option questions from the Korean Medical Licensing Examination 2012-2023 (doctor track, R-type items excluded), each with one or more clinical images; zero-shot, closed-book, answer label parsed from JSON; open-source models averaged over three seeds); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 51 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.298.1#105
2GPT-597.2#91
3Gemini 3 Pro97.2#77
4Gemini 3 Flash96.2#93
5GPT-5 Mini (2025-08-07)90.6#165
6Qwen 3 VL 30B A3B (Thinking)81.1#338 (Qwen 3 VL 30B A3B)
7Qwen 3 VL 32B (Thinking)81.1#287 (Qwen 3 VL 32B)
8Qwen 3 VL 32B Instruct77#276
9Qwen 3 VL 8B (Thinking)76.7
10Ministral-3-14B-Reasoning-251273.6#519
11GLM-4.6V72#309
12Qwen 3 VL 30B A3B Instruct70.1#365
13Qwen 3 VL 4B (Thinking)68.2#471 (Qwen 3 VL 4B)
14Ministral-3-8B-Reasoning-251266.4#694
15Qwen 2.5 VL 32B Instruct64.5#443

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=kormedmcqa-v-ultrasound · How It Works · Data refreshed daily, snapshot 2026-10-11.