tau-Voice (Clean): leaderboard
Metric: pass@1 (%): share of tasks whose final database state matches the goal (agent communications checked by an LLM evaluator), full-duplex voice agent talking to a GPT-4.1 voice user simulator (ElevenLabs v3 speech) under the Clean condition (clear American-accented speech, G.711 telephony, no noise or interruptions), on all 278 tau2-bench tasks (114 retail, 50 airline, 114 telecom); higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Grok Voice Agent | 51 | |
| 2 | GPT Realtime 1.5 | 49 | |
| 3 | Gemini Live 2.5 Flash Native Audio | 31 |
Interactive version: theaggregate.ai/benchmark?slug=tau-voice-clean · How It Works · Data refreshed daily, snapshot 2026-10-11.