ToolRobustBench - User Intent: leaderboard
ToolRobustBench (Jilin University, 2026) is a stage-wise diagnostic benchmark for tool-calling agents, with perturbation families aligned to tool selection, argument binding, output handling and runtime feedback. The success rate is the share of instances with a fully correct tool call on a native 0 to 1 scale, higher is better, under indirect, underspecified, distracting or conflicting request phrasing.
Metric: Success rate (0-1, native; indirect, underspecified, distracting or conflicting request phrasing; over ToolRobustBench single-family perturbation instances (clean, light, medium, heavy); binary per-instance tool-call success). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DeepSeek V4 Pro | 0.81 | #181 |
| 2 | Qwen Plus | 0.8 | #788 |
| 3 | Claude Sonnet 4.6 | 0.79 | #158 |
| 4 | DeepSeek V4 Flash | 0.78 | #254 |
| 5 | GPT-5.4 Mini | 0.78 | #389 |
| 6 | Gemini 2.5 Pro | 0.75 | #262 |
| 7 | Gemini 2.5 Flash | 0.7 | #452 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=toolrobustbench-user-intent · How It Works · Data refreshed daily, snapshot 2026-11-12.