GTA-Workflow - Operation: leaderboard
Root success on the GTA-Workflow tasks that require operation tools, part of GTA-Workflow, the open-ended tier of GTA-2 (2026): 132 long-horizon productivity workflows from real user queries with deployed tools and multimodal inputs, run end to end in a ReAct agent framework and judged by GPT-5.2 against recursive checkpoint rubrics. Percent; higher is better.
Metric: Root success rate (%) on the tasks that require operation tools on GTA-Workflow, the open-ended long-horizon workflow tier of GTA-2 (132 real-user tasks with deployed tools and multimodal inputs), run end to end in the default Lagent ReAct framework; deliverables judged by GPT-5.2 against recursive checkpoint rubrics; higher is better. Source: arxiv.org. Saturation forecast: Around January 2028. 13 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 13.1 | #276 |
| 2 | GPT-5 | 10.71 | #178 |
| 3 | Grok 4 | 10.71 | #319 |
| 4 | Qwen 3 235B A22B | 9.52 | #628 |
| 5 | Llama 4 Scout | 9.52 | #1818 |
| 6 | Claude Sonnet 4.5 | 8.33 | #261 |
| 7 | DeepSeek V3.2 | 7.14 | #419 |
| 8 | Kimi K2 | 5.95 | #443 |
| 9 | Llama 3.1 70B Instruct | 1.19 | #1571 |
| 10 | Llama 3.2 3B Instruct | 1.19 | #7241 |
| 11 | Qwen 3 30B A3B | 1.19 | #1156 |
| 12 | Llama 3.1 8B Instruct | 0 | #4600 |
| 13 | Qwen 3 8B | 0 | #1873 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=gta-workflow-operation · How It Works · Data refreshed daily, snapshot 2026-11-21.