MMBench-Live - Coarse Perception: leaderboard

Coarse perception questions on image topic, quality, emotion, scene and style from MMBench-Live (2026). Accuracy in percent, higher is better.

Metric: Accuracy (%; coarse perception questions; 5.9K newly generated evaluation instances aligned with the MMBench task hierarchy; temperature 0). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 VL 7B Instruct81.54#1833
2Qwen 3 VL 8B Instruct80.36#981

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=mmbench-live-coarse-perception · How It Works · Data refreshed daily, snapshot 2026-11-13.