AudioBench - IMDA Part 6 Dialogue Summarization: leaderboard
AudioBench IMDA Part 6 Dialogue Summarization slice measuring summarization quality for spoken dialogue transcripts and audio-derived conversations.
Metric: Mean Score (%). Source: github.com. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | cascade_whisper_large_v2_gemma2_9b_cpt_sea_lionv3_instruct | 65.6 | |
| 2 | cascade_whisper_large_v3_llama_3_8b_instruct | 63.39 | |
| 3 | Qwen2-Audio-7B-Instruct | 48.38 | #880 |
| 4 | Qwen-Audio-Chat | 43.84 | #1244 |
| 5 | SALMONN_7B | 27.12 |
Interactive version: theaggregate.ai/benchmark?slug=audiobench-imda-part-6-dialogue-summarization · How It Works · Data refreshed daily, snapshot 2026-10-20.