Drift-Bench (State-Oriented, No Clarification) - Expression: leaderboard

Drift-Bench (Bao et al., University of Notre Dame, 2026) state-oriented set: 200 AgentBench operating-system and database tasks that at least two of three reference models solve with the clean instruction, rewritten so the instruction carries an expression fault (ambiguous or unclear wording). The agent must act without being able to ask the user. Success rate in percent, mean of three trials; higher is better.

Metric: Success rate (%; 200 AgentBench operating-system and database tasks with an expression fault (ambiguous wording), no clarification tools, mean of 3 trials). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.

Top models

#ModelScoreOverall rank
1GLM-4.750#365
2GPT-5.249.01#172
3Qwen 3 235B A22B 2507 Instruct48.84#619
4DeepSeek V3.248.66#403
5Gemini 2.5 Flash47.33#452
6GPT-OSS-120B45.67#699
7Llama 4 Maverick31.34#1105

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=drift-bench-state-oriented-no-clarification-expression · How It Works · Data refreshed daily, snapshot 2026-11-12.