GTA-Workflow - Tool Success Rate: leaderboard
Tool call validity on GTA-Workflow, the open-ended tier of GTA-2 (2026): 132 long-horizon productivity workflows from real user queries with deployed tools and multimodal inputs, run end to end in a ReAct agent framework and judged by GPT-5.2 against recursive checkpoint rubrics: the share of tool invocations without system errors or syntax violations. Percent; higher is better.
Metric: Tool success rate (%): share of tool invocations without system errors or syntax violations on GTA-Workflow, the open-ended long-horizon workflow tier of GTA-2 (132 real-user tasks with deployed tools and multimodal inputs), run end to end in the default Lagent ReAct framework; deliverables judged by GPT-5.2 against recursive checkpoint rubrics; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 91.2 | #280 |
| 2 | Kimi K2 | 89.85 | #448 |
| 3 | Qwen 3 235B A22B | 88.98 | #633 |
| 4 | DeepSeek V3.2 | 88.81 | #425 |
| 5 | Claude Sonnet 4.5 | 88.02 | #267 |
| 6 | Llama 4 Scout | 87.74 | #1825 |
| 7 | Grok 4 | 87.47 | #321 |
| 8 | GPT-5 | 87.31 | #185 |
| 9 | Llama 3.1 70B Instruct | 28.71 | #1579 |
| 10 | Qwen 3 8B | 16.97 | #1890 |
| 11 | Llama 3.1 8B Instruct | 13.44 | #4655 |
| 12 | Qwen 3 30B A3B | 1.94 | #1165 |
| 13 | Llama 3.2 3B Instruct | 0.1 | #7311 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=gta-workflow-tool-success-rate · How It Works · Data refreshed daily, snapshot 2026-11-22.