Drift-Bench (Service-Oriented, No Clarification) - Expression: leaderboard
Drift-Bench (Bao et al., University of Notre Dame, 2026) service-oriented set: 150 StableToolBench single-tool API tasks that at least two of three reference models solve with the clean instruction, rewritten so the instruction carries an expression fault (ambiguous or unclear wording). The agent must act without being able to ask the user. Success rate in percent, mean of three trials; higher is better.
Metric: Success rate (%; 150 StableToolBench G1 API tasks with an expression fault (ambiguous wording), no clarification tools, mean of 3 trials). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3 235B A22B 2507 Instruct | 75.33 | #619 |
| 2 | GLM-4.7 | 72.67 | #365 |
| 3 | DeepSeek V3.2 | 72.44 | #403 |
| 4 | Llama 4 Maverick | 68.22 | #1105 |
| 5 | Gemini 2.5 Flash | 64.33 | #452 |
| 6 | GPT-5.2 | 49.22 | #172 |
| 7 | GPT-OSS-120B | 45.67 | #699 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=drift-bench-service-oriented-no-clarification-expression · How It Works · Data refreshed daily, snapshot 2026-11-12.