Drift-Bench (Service-Oriented, No Clarification) - Intention: leaderboard
Metric: Success rate (%; 150 StableToolBench G1 API tasks with an intention fault (the stated goal changed), no clarification tools, mean of 3 trials). Source: arxiv.org. Saturation forecast: Around December 2026. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GLM-4.7 | 69.89 |
| 2 | DeepSeek V3.2 | 64.44 |
| 3 | Qwen 3 235B A22B 2507 Instruct | 57.22 |
| 4 | Llama 4 Maverick | 55.67 |
| 5 | GPT-5.2 | 54.33 |
| 6 | Gemini 2.5 Flash | 51 |
| 7 | GPT-OSS-120B | 42.56 |
Interactive version: theaggregate.ai/benchmark?slug=drift-bench-service-oriented-no-clarification-intention · How It Works · Data refreshed daily, snapshot 2026-09-25.