MCSBench - L1: leaderboard

Measures multimodal conceptual-structure alignment on MCSBench, a diagnostic multiple-choice benchmark of 661 base visual question-answering items over fine-grained visual and taxonomy-like categories. L1 is the perceptual grounding level: attribute-concept binding in fine-grained visual categories. These are base-VQA accuracies from the released results table; the reasoning-chain integrity overlay, which carries the fourth metacognitive-verification level, is scored separately and is not part of this series. Five API models also have a run with web search enabled in that table; those runs are not part of this series either. This series reports MCSBench - L1 using Accuracy (%).

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 77 models tracked.

Top models

#ModelScoreOverall rank
1GPT-587.36#105
2Gemini 3 Pro (Preview)87.36#71
3Claude Opus 4.686.21#67
4Gemini 2.5 Pro85.06#159
5Gemini 3 Flash (Preview)85.06#90
6Claude Sonnet 4.583.91#148
7Qwen 3 VL 235B A22B Instruct80.46#280
8Gemini 2.5 Flash77.01#255
9Qwen 2.5 VL 72B Instruct77.01#383
10GPT-5.274.71#115
11O4 Mini73.56#185
12Qwen 3 VL 235B A22B (Thinking)73.56#236
13Qwen 3 VL 30B A3B (Thinking)73.56#348
14Qwen 2.5 VL 32B Instruct72.41#463
15Qwen 3 VL 8B Instruct71.26#419

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mcsbench-l1 · How It Works · Data refreshed daily, snapshot 2026-11-05.