SArena-Icon - Understanding: leaderboard
Each model reads only the SVG code of an icon and answers 6,012 four-option multiple-choice questions about its colour, geometry, quantity and meaning, replying with the answer letter alone; the score is overall accuracy. Unlike SGP-Bench, the questions were written by GPT-4o from the rendered icons and checked by people, and the board covers only SArena's understanding task, not its editing or generation tasks.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | InternSVG-8B | 85.1 | |
| 2 | Claude Sonnet 4 (20250514) | 77.1 | #405 |
| 3 | Qwen 2.5 VL 32B Instruct | 65.5 | #1074 |
| 4 | InternVL3-78B | 65.3 | #755 |
| 5 | Qwen 2.5 VL 72B Instruct | 63.4 | #849 |
| 6 | InternVL3-8B | 59.5 | #1756 |
| 7 | Qwen 2.5 VL 7B Instruct | 52.8 | #1893 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=sarena-icon-understanding · How It Works · Data refreshed daily, snapshot 2026-11-17.