ParaIntent - Intent Fulfillment: leaderboard
ParaIntent (2026) is a Chinese spoken emotional dialogue benchmark of 14 intent categories with balanced explicit and implicit samples, where a model hears a user utterance and returns a spoken response. Intent fulfillment is scored on the synthetic test set where a GLM-5 judge scores whether the spoken response addresses the intended communicative goal, in percent, higher is better.
Metric: Intent fulfillment score (%; GLM-5 judge of whether the spoken response addresses the user's intent; over the ParaIntent synthetic test set (14 Chinese spoken-emotional-dialogue intent categories, balanced explicit and implicit samples); single-turn spoken response). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen3-Omni | 52.27 | #999 |
| 2 | MiMo-Audio | 47.95 | #893 |
| 3 | Step-Audio-2-mini | 41.48 | |
| 4 | GLM-4-Voice | 33.44 | |
| 5 | Qwen2.5-Omni | 32.78 | #1499 |
Interactive version: theaggregate.ai/benchmark?slug=paraintent-intent-fulfillment · How It Works · Data refreshed daily, snapshot 2026-11-12.