UniSAFE - Multimodal Understanding ASR: leaderboard
Metric: Attack success rate (%): share of UniSAFE's unsafe-intent prompts (benign-looking inputs built to elicit harmful content across safety categories) whose output an ensemble of three MLLM judges (Gemini-2.5 Pro, GPT-5-nano, Qwen2.5-VL-72B) rates harmful, on the multimodal understanding with text output task; lower is better. Source: arxiv.org. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 12.7 | #91 |
| 2 | Gemini 2.5 Pro | 36 | #145 |
| 3 | Qwen 2.5 VL 7B Instruct | 43.6 | #643 |
Interactive version: theaggregate.ai/benchmark?slug=unisafe-multimodal-understanding-asr · How It Works · Data refreshed daily, snapshot 2026-10-11.