ToolRobustBench - Runtime Environment: leaderboard
ToolRobustBench (Jilin University, 2026) is a stage-wise diagnostic benchmark for tool-calling agents, with perturbation families aligned to tool selection, argument binding, output handling and runtime feedback. The success rate is the share of instances with a fully correct tool call on a native 0 to 1 scale, higher is better, under perturbed runtime status and feedback during execution.
Metric: Success rate (0-1, native; perturbed runtime status and feedback during execution; over ToolRobustBench single-family perturbation instances (clean, light, medium, heavy); binary per-instance tool-call success). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DeepSeek V4 Pro | 0.75 | #181 |
| 2 | Claude Sonnet 4.6 | 0.75 | #158 |
| 3 | Qwen Plus | 0.71 | #788 |
| 4 | GPT-5.4 Mini | 0.71 | #389 |
| 5 | Gemini 2.5 Flash | 0.65 | #452 |
| 6 | Gemini 2.5 Pro | 0.64 | #262 |
| 7 | DeepSeek V4 Flash | 0.62 | #254 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=toolrobustbench-runtime-environment · How It Works · Data refreshed daily, snapshot 2026-11-12.