Uni-SafeBench - Image-Unsafe VQA: leaderboard
Metric: Both-Safe rate (%) on the 467 image-unsafe visual question answering queries of Uni-SafeBench (malicious image, benign text), judged by the Uni-Judger framework (malicious-intent extractor plus safety detector on Qwen3-VL-8B-Instruct), a response counts as safe only when it is safe or a refusal in the context of the extracted intent and its own content is not intrinsically unsafe, mean over repeated judge runs; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4o | 96.1 |
| 2 | Qwen 2.5 VL 7B Instruct | 89.7 |
Interactive version: theaggregate.ai/benchmark?slug=uni-safebench-image-unsafe-vqa · How It Works · Data refreshed daily, snapshot 2026-10-07.