ToolRobustBench - Tool Output: leaderboard
ToolRobustBench (Jilin University, 2026) is a stage-wise diagnostic benchmark for tool-calling agents, with perturbation families aligned to tool selection, argument binding, output handling and runtime feedback. The success rate is the share of instances with a fully correct tool call on a native 0 to 1 scale, higher is better, under noisy, missing or conflicting returned evidence after the call.
Metric: Success rate (0-1, native; noisy, missing or conflicting returned evidence after the call; over ToolRobustBench single-family perturbation instances (clean, light, medium, heavy); binary per-instance tool-call success). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.6 | 0.57 | #158 |
| 2 | DeepSeek V4 Pro | 0.51 | #181 |
| 3 | GPT-5.4 Mini | 0.5 | #389 |
| 4 | Gemini 2.5 Pro | 0.48 | #262 |
| 5 | Gemini 2.5 Flash | 0.42 | #452 |
| 6 | Qwen Plus | 0.38 | #788 |
| 7 | DeepSeek V4 Flash | 0.32 | #254 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=toolrobustbench-tool-output · How It Works · Data refreshed daily, snapshot 2026-11-12.