HumDial-EIBench - Text Empathy (Chinese, Qwen3-Omni Judge): leaderboard
Metric: Text empathy and insight score (1-5) of the model's empathetic spoken reply in Task 3 (Chinese multi-turn dialogues from real human-recorded dialogues from the ICASSP 2026 HumDial Challenge test set, audio language models answer from the audio), rated by a Qwen3-Omni judge with the HumDial-EIBench rubric; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash | 3.68 |
Interactive version: theaggregate.ai/benchmark?slug=humdial-eibench-text-empathy-chinese-qwen3-omni-judge · How It Works · Data refreshed daily, snapshot 2026-10-07.