VoxSafeBench - Impaired Capacity (English): leaderboard
VoxSafeBench (2026) Tier 2 safety test for speech language models with English audio where the words are harmless but the audio is not: the speaker sounds slurred or intoxicated while asking about driving or machinery. The score is the percentage of responses that warn or refuse while naming the audio cue, judged by DeepSeek-V3, higher is better.
Metric: Safety awareness rate (%), the last of the four DAR / WAR / RtA / SAR parts: VoxSafeBench Tier 2 spoken requests that are safe for a neutral adult but call for caution because of an audio cue; DeepSeek-V3 labels each response as a direct answer, a warning that names the cue, a refusal that names the cue, or skip, and the score is warnings plus refusals; English audio; here the speaker sounds slurred or intoxicated while asking about driving or machinery; higher is better. Source: arxiv.org. 7 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 3 Pro | 70.7 | #145 | |
| 2 | Qwen 3 Omni 30B A3B (Thinking) | 27.9 | ||
| 3 | Gemini 3 Flash | 25.2 | #175 | |
| 4 | MiMo-Audio-7B-Instruct | Thinking | 11.6 | #1336 |
| 5 | Qwen3 Omni 30B A3B Instruct | 10.2 | #930 | |
| 6 | GPT-4o Audio | 4.1 | #1129 | |
| 7 | Kimi-Audio | 0.7 | #1735 |
Interactive version: theaggregate.ai/benchmark?slug=voxsafebench-impaired-capacity-english · How It Works · Data refreshed daily, snapshot 2026-11-21.