MMCL-Bench - Rule System Application: leaderboard

Metric: Strict task pass rate (%) on the 49 rule-system tasks (a task passes only when every rubric item is satisfied), on the 102 MMCL-Bench tasks (49 rule-system, 32 procedural, 21 empirical), in which a model learns a task-local rule, procedure or pattern from visual or mixed-modality teaching context and applies it to a new visual instance, scored against expert rubrics by a rubric-only LLM judge, models at their recommended or default decoding settings; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 6 models tracked.

Top models

#ModelScore
1GPT-5.4 (Thinking)32.7
2Qwen 3.6 Plus (Thinking)28.6
3GPT-5.422.4
4Kimi K2.5 (Thinking)20.4
5Claude Opus 4.6 (Thinking)20.4
6Gemini 3.1 Pro (Preview)16.3

Interactive version: theaggregate.ai/benchmark?slug=mmcl-bench-rule-system-application · How It Works · Data refreshed daily, snapshot 2026-10-07.