MLS-Bench (Agent) - Structured and Causal Reasoning: leaderboard

Metric: Mean normalized task score (0-100): each metric is anchored so the worst reproduced human baseline scores 0 and the best 50 (a metric's theoretical optimum maps to 100), metrics are averaged with human weights within a setting and by geometric mean across at least three generalization settings, over the 10 MLS-Bench tasks of the Structured and Causal Reasoning area; Agent protocol: the model's final submission after at most 20 actions including 3 test calls; high reasoning effort with a 10,000-token thinking budget, web search disabled, fixed seeds; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 5 models tracked.

Top models

#ModelScore
1Claude Opus 4.6 (Thinking)39.9
2DeepSeek V3.2 (Thinking)32.5
3GPT-5.4 (High)28.4
4Gemini 3.1 Pro (Preview) (High)25.8
5Qwen 3.6 Plus (Thinking)16.2

Interactive version: theaggregate.ai/benchmark?slug=mls-bench-agent-structured-and-causal-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-07.