AudioBench - IMDA Part 5 Dialogue Summarization: leaderboard
AudioBench IMDA Part 5 Dialogue Summarization slice measuring summarization quality for spoken dialogue transcripts and audio-derived conversations.
Metric: Mean Score (%). Source: github.com. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | cascade_whisper_large_v2_gemma2_9b_cpt_sea_lionv3_instruct | 61.48 | |
| 2 | cascade_whisper_large_v3_llama_3_8b_instruct | 59.03 | |
| 3 | Qwen2-Audio-7B-Instruct | 45.38 | #880 |
| 4 | Qwen-Audio-Chat | 39.14 | #1244 |
| 5 | SALMONN_7B | 24.34 |
Interactive version: theaggregate.ai/benchmark?slug=audiobench-imda-part-5-dialogue-summarization · How It Works · Data refreshed daily, snapshot 2026-10-20.