MMAU-Pro - Speech: leaderboard
Audio-language models answer human-written questions about real-world speech, sound and music clips of up to 10 minutes; the score is accuracy on the 891 speech questions, from the authors' runs. Unlike the original MMAU, clips are long, can be mixed or multiple, and include spatial audio, voice chat and open-ended questions.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 18 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Audio Flamingo 3 | 58.8 | |
| 2 | Qwen2.5-Omni-7B | 57.4 | #1883 |
| 3 | Qwen2.5-Omni-3B | 53.9 | #3596 |
| 4 | DeSTA2.5-Audio | 49.9 | #2076 |
| 5 | Ming-Lite-Omni-1.5 | 49.1 | #2348 |
| 6 | Phi-4 Multimodal Instruct | 47.6 | #4209 |
| 7 | DeSTA2-8B-beta | 46.5 | |
| 8 | Gemma 3n E4B (IT) | 44.9 | #2432 |
| 9 | Audio Reasoner | 44 | #3028 |
| 10 | Audio Flamingo 2 | 43 | |
| 11 | Gemma 3n E2B (IT) | 41.3 | #4283 |
| 12 | SALMONN-7B | 38.3 | |
| 13 | SALMONN-13B | 37.3 | |
| 14 | Baichuan-Omni-1.5 | 36.5 | #3064 |
| 15 | R1-AQA | 33.7 | #5707 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=mmau-pro-speech · How It Works · Data refreshed daily, snapshot 2026-11-17.