Qwen-Audio-3.1-Realtime Report - Big Bench Audio: leaderboard
Big Bench Audio spoken reasoning questions, accuracy (%) from the Qwen team's own run rather than Artificial Analysis's. Higher is better. Qwen-Audio-3.1-Realtime technical report (Qwen team, arXiv 2609.25176, September 2026): the Qwen team's runs of Qwen-Audio-3.1-Realtime, Qwen-Audio-3.0-Realtime (Plus or Flash not stated), GPT-Realtime-2 (effort not stated) and ByteDance's SeedDuplex 1.2.6.1; the two unspecified comparators carry report-scoped labels.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen-Audio-3.1-Realtime Report Qwen-Audio-3.0-Realtime (Plus or Flash unspecified) | 98.8 | |
| 2 | Qwen-Audio-3.1-Realtime | 98.5 | |
| 3 | Qwen-Audio-3.1-Realtime Report GPT-Realtime-2 (effort unspecified) | 93.3 | |
| 4 | SeedDuplex 1.2.6.1 | 80.5 |
Interactive version: theaggregate.ai/benchmark?slug=qwen-audio-3-1-realtime-report-big-bench-audio · How It Works · Data refreshed daily, snapshot 2026-11-05.