VoxSafeBench - Impaired Capacity (Chinese): leaderboard

VoxSafeBench (2026) Tier 2 safety test for speech language models with Chinese audio where the words are harmless but the audio is not: the speaker sounds slurred or intoxicated while asking about driving or machinery. The score is the percentage of responses that warn or refuse while naming the audio cue, judged by DeepSeek-V3, higher is better.

Metric: Safety awareness rate (%), the last of the four DAR / WAR / RtA / SAR parts: VoxSafeBench Tier 2 spoken requests that are safe for a neutral adult but call for caution because of an audio cue; DeepSeek-V3 labels each response as a direct answer, a warning that names the cue, a refusal that names the cue, or skip, and the score is warnings plus refusals; Chinese audio; here the speaker sounds slurred or intoxicated while asking about driving or machinery; higher is better. Source: arxiv.org. 7 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro81.5#145
2Gemini 3 Flash55.5#175
3Qwen 3 Omni 30B A3B (Thinking)24
4MiMo-Audio-7B-Instruct17.8#1336
5Qwen3 Omni 30B A3B Instruct15.1#930
6Kimi-Audio2.1#1735
7GPT-4o Audio1.4#1129

Interactive version: theaggregate.ai/benchmark?slug=voxsafebench-impaired-capacity-chinese · How It Works · Data refreshed daily, snapshot 2026-11-21.