AA Speech to Speech - Tau-Voice 2.0 - Telecom: leaderboard
Sierra tau-bench v2.0.0 voice: 50 English tasks each in airline, retail and telecom; three trials; GPT5.5 low simulated caller speaking ElevenLabs eleven_v3; common prompt/tools/policy, 2400-second call limit. State/action/output checks; infrastructure errors excluded and rerun. Overall is equal domain mean. GPT-Live's source-declared backend prompt differs. Separate from V1; no cross-edition score replacement. Metric: Pass@1 (%), mean of three trials. Source: https://artificialanalysis.ai/speech-to-speech
Metric: Pass@1 (%), mean of three trials. Source: artificialanalysis.ai. Saturation forecast: Rough model projection: around 2026. 11 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Phonic 1 | High | 95.33 | |
| 2 | GPT-Live 1 (Astra, medium) | 86 | ||
| 3 | Gemini 3.8 Live (Extended Thinking) | High | 82.67 | |
| 4 | Grok Voice 3.0 | 75.33 | ||
| 5 | Eleven Realtime v1 Max | 70.67 | ||
| 6 | Eleven Realtime v1 Mini | 70 | ||
| 7 | GPT-Live 1 (Sol, low) | 68 | ||
| 8 | Qwen Audio 3.0 Realtime Plus | 59.33 | ||
| 9 | Gemini 3.1 Flash Live High | 24.67 | ||
| 10 | GPT Realtime 2.1 | High | 16 | |
| 11 | Gemini 3.8 Live | 14.67 |
Interactive version: theaggregate.ai/benchmark?slug=aa-speech-to-speech-tau-voice-2-0-telecom · How It Works · Data refreshed daily, snapshot 2026-11-17.