HalluAudio - Music: leaderboard

Hallucination detection in the music domain of HalluAudio (2026): human-verified audio question-answer pairs with adversarial prompts, mixed audio and unanswerable questions probe whether an audio-language model reports sounds or content that are not there. Unweighted mean accuracy over nine task types, in percent; higher is better.

Metric: Average classification accuracy (%) over the nine music task types of HalluAudio (human-verified audio question-answer pairs with adversarial, mixed-audio and unanswerable prompts; zero-shot; outputs normalized to labels, refusals counted wrong); unweighted mean of the task accuracies; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1MiMo-Audio-7B-Instruct75.79#1328
2GPT-4o Audio (Preview)58.15#896
3Audio Flamingo 358.1
4Step-Audio-2-mini58.1
5Music Flamingo56.3#865
6Qwen2.5-Omni-7B50.96#1888
7Kimi-Audio-7B45.38
8Gemini 2.5 Flash31.51#466
9Pengi28.38
10Qwen2-Audio-7B27.56

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=halluaudio-music · How It Works · Data refreshed daily, snapshot 2026-11-22.