AudioBench - IMDA Part 4 Dialogue Summarization: leaderboard
AudioBench IMDA Part 4 Dialogue Summarization slice measuring summarization quality for spoken dialogue transcripts and audio-derived conversations.
Metric: Mean Score (%). Source: github.com. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | cascade_whisper_large_v2_gemma2_9b_cpt_sea_lionv3_instruct | 43.4 | |
| 2 | cascade_whisper_large_v3_llama_3_8b_instruct | 42.81 | |
| 3 | Qwen2-Audio-7B-Instruct | 25.02 | #880 |
| 4 | Qwen-Audio-Chat | 18.06 | #1244 |
| 5 | SALMONN_7B | 9.4 |
Interactive version: theaggregate.ai/benchmark?slug=audiobench-imda-part-4-dialogue-summarization · How It Works · Data refreshed daily, snapshot 2026-10-20.