SABench - Goal Satisfaction: leaderboard

SABench measures satisfaction of deterministic goals in stateful tool tasks. Its 201-task set includes 45 ambiguous tasks with no stated goals, which receive goal credit automatically. Deterministic goal-satisfaction rate on 201 tasks (%).

Metric: Deterministic goal-satisfaction rate on201 tasks (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash95.5#103
2Claude Sonnet 4.692#96
3Qwen 3.5 Plus90.5#131
4Kimi K2.590#148
5GPT-5.4 Mini89.5#213
6GLM-589#145
7GPT-5.488.1#83
8Claude Opus 4.687.6#65
9DeepSeek V3.287.6#205
10Gemini 3.1 Pro (Preview)85.6#61
11MiniMax-M2.585.6#303

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=sabench-goal-satisfaction · How It Works · Data refreshed daily, snapshot 2026-10-29.