CareQA-Vision - Open-Ended - Medicine: leaderboard
Metric: Judge score (%; 108 open-ended image-based questions from MIR medicine exams, majority of three LLM judges scoring 0, 0.5 or 1). Source: arxiv.org. Saturation forecast: Around December 2026. 18 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GLM-4.5V | 68.06 |
| 2 | Qwen 3 VL 30B A3B Instruct | 49.07 |
| 3 | Qwen 2 VL 72B Instruct | 49.07 |
| 4 | HuluMed-7B | 48.61 |
| 5 | Qwen 3 VL 8B Instruct | 41.2 |
| 6 | Lingshu-7B | 34.72 |
| 7 | Qwen 2 VL 7B Instruct | 29.17 |
Interactive version: theaggregate.ai/benchmark?slug=careqa-vision-open-ended-medicine · How It Works · Data refreshed daily, snapshot 2026-09-25.