GTA-Workflow - Tool Success Rate: leaderboard
Metric: Tool success rate (%): share of tool invocations without system errors or syntax violations on GTA-Workflow, the open-ended long-horizon workflow tier of GTA-2 (132 real-user tasks with deployed tools and multimodal inputs), run end to end in the default Lagent ReAct framework; deliverables judged by GPT-5.2 against recursive checkpoint rubrics; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro | 91.2 |
| 2 | Kimi K2 | 89.85 |
| 3 | Qwen 3 235B A22B | 88.98 |
| 4 | DeepSeek V3.2 | 88.81 |
| 5 | Claude Sonnet 4.5 | 88.02 |
| 6 | Llama 4 Scout | 87.74 |
| 7 | Grok 4 | 87.47 |
| 8 | GPT-5 | 87.31 |
| 9 | Llama 3.1 70B Instruct | 28.71 |
| 10 | Qwen 3 8B | 16.97 |
| 11 | Llama 3.1 8B Instruct | 13.44 |
| 12 | Qwen 3 30B A3B | 1.94 |
| 13 | Llama 3.2 3B Instruct | 0.1 |
Interactive version: theaggregate.ai/benchmark?slug=gta-workflow-tool-success-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.