AOR-Bench: leaderboard
Metric: Over-refusal rate (%; refusals of 500 pseudo-harmful audio queries, pooled over six scenario categories). Source: arxiv.org. Saturation forecast: Around 2028. 12 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen2-Audio-7B-Instruct | 17.8 |
| 2 | GPT Audio Mini | 20.2 |
| 3 | Gemini 2.0 Flash Lite | 38.2 |
| 4 | GPT Audio | 42.8 |
| 5 | Gemini 3 Flash (Preview) | 43.8 |
| 6 | MiMo-V2-Omni | 45.4 |
| 7 | Gemini 2.5 Flash Lite | 66.2 |
Interactive version: theaggregate.ai/benchmark?slug=aor-bench · How It Works · Data refreshed daily, snapshot 2026-09-26.