HalluAudio - Environmental Sound: leaderboard

Hallucination detection in the environmental sound domain of HalluAudio (2026): human-verified audio question-answer pairs with adversarial prompts, mixed audio and unanswerable questions probe whether an audio-language model reports sounds or content that are not there. Unweighted mean accuracy over seven task types, in percent; higher is better.

Metric: Average classification accuracy (%) over the seven environmental sound task types of HalluAudio (human-verified audio question-answer pairs with adversarial, mixed-audio and unanswerable prompts; zero-shot; outputs normalized to labels, refusals counted wrong); unweighted mean of the task accuracies; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen2.5-Omni-7B84.69#1884
2MiMo-Audio-7B-Instruct82.52#1336
3Step-Audio-2-mini72.64
4GPT-4o Audio (Preview)71#793
5Qwen2-Audio-7B67.36
6Audio Flamingo 364.79
7Gemini 2.5 Flash39.35#463
8Kimi-Audio-7B38.76
9Pengi24.69

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=halluaudio-environmental-sound · How It Works · Data refreshed daily, snapshot 2026-11-21.