VoxSafeBench - Audio-Conditioned Privacy: leaderboard
Metric: Privacy awareness rate (%), the second part of the DAR / PAR pair: spoken English and Chinese questions (aggregated) on sensitive topics such as pregnancy, layoffs or family conflict whose background audio shows that bystanders can hear; the share of responses that warn the user or defer instead of answering directly, labeled by DeepSeek-V3; higher is better. Source: arxiv.org. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Pro | 94.3 |
| 2 | Gemini 3 Flash | 72.8 |
| 3 | Qwen3 Omni 30B A3B Instruct | 14.3 |
Interactive version: theaggregate.ai/benchmark?slug=voxsafebench-audio-conditioned-privacy · How It Works · Data refreshed daily, snapshot 2026-10-07.