When2Call (Voice): leaderboard
Metric: F1 (%; tool call versus no tool call, parsed from the response; 300 spoken non-multiple-choice When2Call queries, mean over six TTS voice configurations). Source: arxiv.org. Saturation forecast: Around December 2026. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen3 Omni 30B A3B Instruct | 60.4 |
| 2 | Phi-4 Multimodal Instruct | 53.6 |
Interactive version: theaggregate.ai/benchmark?slug=when2call-voice · How It Works · Data refreshed daily, snapshot 2026-09-26.