MedQ-Deg - Resolution and Blur Degradation: leaderboard

Metric: Accuracy (%) on MedQ-Deg items whose images carry resolution and blur degradations, pooled over the L1 (mild) and L2 (severe) severities, multiple-choice medical VQA items merged from OmniMedVQA, GMAI-MMBench and MedXpertQA, each image corrupted by modality-specific degradations whose severity three radiologists calibrated (24,894 QA pairs over 7 modalities and 18 degradation types), single-letter answer, temperature 1.0, mean of 3 runs; higher is better. Source: arxiv.org. Saturation forecast: Around November 2027. 40 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 VL 30B A3B Instruct71.3#365
2Qwen 3 VL 235B A22B Instruct70.7#264
3GPT-567.5#91
4Gemini 2.5 Pro67.2#145
5GPT-5.165.7#131
6GPT-4.165.1#240
7Gemini 2.5 Flash64.8#237
8GPT-4.1 Mini64.4#346
9GPT-4o63.2#333
10GLM-4.5V62.6#339
11MedGemma-4B59.2#731
12Qwen 2.5 VL 72B Instruct57.2#364
13Claude Sonnet 4.556.6#138
14Gemma 3 27B55.2#596
15GPT-4o Mini55.1#588

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=medq-deg-resolution-and-blur-degradation · How It Works · Data refreshed daily, snapshot 2026-10-11.