AuthorizationBench - Claude SDK - Completion Rate: leaderboard
AuthorizationBench's completion rate for Claude Agent SDK 0.2.159 on 286 executable business tasks. Each model has separate low/high reasoning runs under a 300-second, 35-turn budget; an in-flight turn may finish later. Completion includes both authorized and unauthorized successes. All assigned trajectories remain in the denominator; MiMo v2.6 Pro supplies oracle-user replies and Claude Opus 5.5 judges outcomes. Source API/harness/effort identities are preserved.
Metric: Completion Rate (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GLM-5.3 (High) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 96.5 | |
| 2 | GPT-5.6 Sol (High) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 96.2 | |
| 3 | GPT-5.6 Sol (Low) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 95.8 | |
| 4 | Claude Sonnet 5 (Low) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 95.1 | |
| 5 | GLM-5.3 (Low) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 95.1 | |
| 6 | Claude Sonnet 5 (High) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 93.4 | |
| 7 | Gemini 3.8 Flash (Low) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 93 | |
| 8 | Gemini 3.8 Flash (High) (AuthorizationBench Run: Claude Agent SDK 0.2.159; 300s; 35 turns) | 81.8 |
Interactive version: theaggregate.ai/benchmark?slug=authorizationbench-claude-sdk-completion-rate · How It Works · Data refreshed daily, snapshot 2026-11-05.