ParaIntent - Response Quality: leaderboard
Metric: Response quality score (%; held-out DeepSeek-V4-Pro judge of content, tone appropriateness and naturalness; over the ParaIntent synthetic test set (14 Chinese spoken-emotional-dialogue intent categories, balanced explicit and implicit samples); single-turn spoken response). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen3-Omni | 58.65 |
| 2 | MiMo-Audio | 52.91 |
| 3 | Step-Audio-2-mini | 45.87 |
| 4 | GLM-4-Voice | 45.18 |
| 5 | Qwen2.5-Omni | 35.68 |
Interactive version: theaggregate.ai/benchmark?slug=paraintent-response-quality · How It Works · Data refreshed daily, snapshot 2026-09-26.