MMAU-Pro - Music: leaderboard

Audio-language models answer human-written questions about real-world speech, sound and music clips of up to 10 minutes; the score is accuracy on the 1,618 music questions, from the authors' runs. Unlike the original MMAU, clips are long, can be mixed or multiple, and include spatial audio, voice chat and open-ended questions.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 18 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1Audio Flamingo 361.7
2Qwen2.5-Omni-7B61.5#1883
3Qwen2.5-Omni-3B60.3#3596
4Ming-Lite-Omni-1.556.2#2348
5Audio Flamingo 255.7
6Audio Reasoner50.1#3028
7DeSTA2.5-Audio48.2#2076
8Phi-4 Multimodal Instruct47.8#4209
9SALMONN-13B47.2
10Gemma 3n E4B (IT)46.4#2432
11SALMONN-7B44.9
12Gemma 3n E2B (IT)44.1#4283
13DeSTA2-8B-beta43.3
14GAMA41.2#8292
15Mellow32.9

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=mmau-pro-music · How It Works · Data refreshed daily, snapshot 2026-11-17.