MMJailBench - Academic Framing: leaderboard
MMJailBench (Wang et al., 2026) is a factorized multimodal jailbreak benchmark: 272 harmful intents crossed with six prompt framings, five task-relevant visual contexts and text or in-image instructions, 16,320 instances per model. This board covers one prompt framing, in which the request is posed as an academic analysis, over all 272 intents. Attack success rate in percent, the share of responses a GPT-5 judge scores 4 or 5 on a 1-5 harmfulness rubric; lower is better.
Metric: Attack success rate (%; share of responses a GPT-5 judge scores 4 or 5 on a 1-5 harmfulness rubric; academic-analysis framing, all 272 intents, visual contexts and carriers). Source: arxiv.org. Saturation forecast: Estimated already saturated. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 0.74 | #163 |
| 2 | Claude Sonnet 4.5 | 5.4 | #244 |
| 3 | Gemini 3 Flash | 34.96 | #159 |
| 4 | Kimi K2.5 | 59.45 | #252 |
| 5 | Seed 2.0 Lite | 63.27 | #286 |
| 6 | Grok 4 Fast | 66.4 | #438 |
| 7 | InternVL3-8B | 74.41 | #1695 |
| 8 | Ministral 3 8B | 82.72 | #2036 |
| 9 | GLM-4.6V | 84.67 | #698 |
| 10 | Gemma 3 12B | 86.4 | #2013 |
| 11 | Qwen 2.5 VL 7B Instruct | 91.43 | #1842 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mmjailbench-academic-framing · How It Works · Data refreshed daily, snapshot 2026-11-12.