GTA-Workflow - Operation: leaderboard
Metric: Root success rate (%) on the tasks that require operation tools on GTA-Workflow, the open-ended long-horizon workflow tier of GTA-2 (132 real-user tasks with deployed tools and multimodal inputs), run end to end in the default Lagent ReAct framework; deliverables judged by GPT-5.2 against recursive checkpoint rubrics; higher is better. Source: arxiv.org. Saturation forecast: Around September 2028. 13 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro | 13.1 |
| 2 | GPT-5 | 10.71 |
| 3 | Grok 4 | 10.71 |
| 4 | Qwen 3 235B A22B | 9.52 |
| 5 | Llama 4 Scout | 9.52 |
| 6 | Claude Sonnet 4.5 | 8.33 |
| 7 | DeepSeek V3.2 | 7.14 |
| 8 | Kimi K2 | 5.95 |
| 9 | Llama 3.1 70B Instruct | 1.19 |
| 10 | Llama 3.2 3B Instruct | 1.19 |
| 11 | Qwen 3 30B A3B | 1.19 |
| 12 | Llama 3.1 8B Instruct | 0 |
| 13 | Qwen 3 8B | 0 |
Interactive version: theaggregate.ai/benchmark?slug=gta-workflow-operation · How It Works · Data refreshed daily, snapshot 2026-10-07.