When2Call (Call/No-Call Accuracy): leaderboard
Metric: Accuracy (%; call or no-call decision of the unmodified model over 2,357 held-out When2Call contexts, LLM-judged). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3.5 9B | 69.88 |
| 2 | Qwen 3.5 4B | 69.75 |
| 3 | Ministral-3-8B-Instruct-2512 | 69.33 |
| 4 | Ministral-3-3B-Instruct-2512 | 65.97 |
| 5 | Gemma 3 4B (IT) | 57.11 |
| 6 | Gemma 3 1B (IT) | 55.2 |
Interactive version: theaggregate.ai/benchmark?slug=when2call-call-no-call-accuracy · How It Works · Data refreshed daily, snapshot 2026-09-25.