Uni-SafeBench - Dual-Unsafe VQA: leaderboard
Uni-SafeBench (2026) tests the safety of unified multimodal models, vision-language models and LLMs on malicious requests across understanding and generation tasks, with a judge that checks both the context of each response and its intrinsic content. This board is the Both-Safe rate in percent on visual questions where both the image and the text are malicious; higher is better.
Metric: Both-Safe rate (%) on the 455 dual-unsafe visual question answering queries of Uni-SafeBench (image and text both malicious), judged by the Uni-Judger framework (malicious-intent extractor plus safety detector on Qwen3-VL-8B-Instruct), a response counts as safe only when it is safe or a refusal in the context of the extracted intent and its own content is not intrinsically unsafe, mean over repeated judge runs; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Chameleon (Uni-SafeBench checkpoint unspecified) | 98.9 | |
| 2 | GPT-4o | 88.8 | #751 |
| 3 | Gemini 2.5 Flash Image | 87.9 | |
| 4 | Qwen 2.5 VL 7B Instruct | 84.2 | #1902 |
| 5 | DeepSeek-VL-7B-Chat | 80.7 | #3756 |
| 6 | Tar-1.5B | 68.1 | |
| 7 | DeepSeek-VL-7B-Base | 68.1 | |
| 8 | Harmon-1.5B | 67.5 | |
| 9 | Janus-Pro-7B | 63.1 | #6857 |
| 10 | Tar-7B | 62.4 | |
| 11 | BAGEL-7B-MoT | 59.8 | #4619 |
| 12 | Show-o2-7B | 57.1 | |
| 13 | Emu3 | 53.8 | |
| 14 | Janus-flow | 50.5 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=uni-safebench-dual-unsafe-vqa · How It Works · Data refreshed daily, snapshot 2026-11-21.