WildToolBench - Clarification Tasks: leaderboard
WildToolBench (2026) evaluates LLM tool use under realistic user behavior: 256 multi-turn scenarios over about 1,600 public APIs mix compositional tool orchestration, intentions hidden in earlier turns and switches between tool, chat and clarification requests. This board is accuracy in percent on tasks where the correct response is to ask the user for missing information; higher is better.
Metric: Accuracy (%) on tasks where the correct response is to ask the user for missing information, on WildToolBench (256 multi-turn scenarios, four user tasks each, 1,024 tasks, built from real user-log patterns with expert-annotated tool calls), each model through its native function-call format with default decoding; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 50 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 2.0 Flash (Thinking) | 52.34 | ||
| 2 | O1 | 48.05 | #407 | |
| 3 | Gemini 2.5 Pro | 46.88 | #280 | |
| 4 | O3 | 44.92 | #242 | |
| 5 | GLM-4.5 | 44.53 | #540 | |
| 6 | DeepSeek R1 | 43.75 | #484 | |
| 7 | Claude Sonnet 4 | 41.8 | #414 | |
| 8 | Claude Opus 4.1 | 41.8 | #284 | |
| 9 | Claude 3.7 Sonnet | 41.41 | #455 | |
| 10 | Qwen 3 30B A3B | Non-reasoning | 41.41 | #1165 |
| 11 | Kimi K2 | 39.84 | #448 | |
| 12 | Qwen 3 32B | Non-reasoning | 39.84 | #983 |
| 13 | Qwen 3 8B | Thinking | 39.84 | #1890 |
| 14 | Qwen 3 14B | Non-reasoning | 39.84 | #1284 |
| 15 | GPT-4o | 39.45 | #754 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=wildtoolbench-clarification-tasks · How It Works · Data refreshed daily, snapshot 2026-11-22.