AudioBench - IMDA Part 3 Dialogue Summarization: leaderboard
AudioBench IMDA Part 3 Dialogue Summarization slice measuring summarization quality for spoken dialogue transcripts and audio-derived conversations.
Metric: Mean Score (%). Source: github.com. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | cascade_whisper_large_v2_gemma2_9b_cpt_sea_lionv3_instruct | 48.34 | |
| 2 | cascade_whisper_large_v3_llama_3_8b_instruct | 47.35 | |
| 3 | WavLLM_fairseq | 36.5 | |
| 4 | Qwen2-Audio-7B-Instruct | 35.54 | #880 |
| 5 | Qwen-Audio-Chat | 25.22 | #1244 |
| 6 | SALMONN_7B | 12.82 |
Interactive version: theaggregate.ai/benchmark?slug=audiobench-imda-part-3-dialogue-summarization · How It Works · Data refreshed daily, snapshot 2026-10-20.