AuthorizationBench - OpenAI SDK - Completion Rate: leaderboard

AuthorizationBench's completion rate for OpenAI Agents SDK 0.20.0 on 286 executable business tasks. Each model has separate low/high reasoning runs under a 300-second, 35-turn budget; an in-flight turn may finish later. Completion includes both authorized and unauthorized successes. All assigned trajectories remain in the denominator; MiMo v2.6 Pro supplies oracle-user replies and Claude Opus 5.5 judges outcomes. Source API/harness/effort identities are preserved.

Metric: Completion Rate (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 5 (Low) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)96.2
2GPT-5.6 Sol (High) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)95.5
3Claude Sonnet 5 (High) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)95.5
4GPT-5.6 Sol (Low) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)95.1
5GLM-5.3 (Low) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)94.8
6GLM-5.3 (High) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)93
7Gemini 3.8 Flash (Low) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)85.7
8Gemini 3.8 Flash (High) (AuthorizationBench Run: OpenAI Agents SDK 0.20.0; 300s; 35 turns)85

Interactive version: theaggregate.ai/benchmark?slug=authorizationbench-openai-sdk-completion-rate · How It Works · Data refreshed daily, snapshot 2026-11-05.