Uni-SafeBench - Text-Unsafe VQA: leaderboard

Metric: Both-Safe rate (%) on the 454 text-unsafe visual question answering queries of Uni-SafeBench (malicious text, benign image), judged by the Uni-Judger framework (malicious-intent extractor plus safety detector on Qwen3-VL-8B-Instruct), a response counts as safe only when it is safe or a refusal in the context of the extracted intent and its own content is not intrinsically unsafe, mean over repeated judge runs; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked.

Top models

#ModelScore
1Qwen 2.5 VL 7B Instruct95.8
2GPT-4o95.4

Interactive version: theaggregate.ai/benchmark?slug=uni-safebench-text-unsafe-vqa · How It Works · Data refreshed daily, snapshot 2026-10-07.