R3-Bench: leaderboard

R3-Bench (2026) evaluates reflective visual generation: given a prompt and an image, a model judges whether they match and explains the discrepancy. Reflective Verdict Score in percent over 670 expert-annotated pairs in eight error categories, a misaligned pair counting only when the explanation matches the expert diagnosis according to an LLM judge; higher is better.

Metric: Reflective Verdict Score times 100 (%) averaged over eight error categories: an aligned image-prompt pair counts when the model says it matches; a misaligned one counts only when the model rejects it and an LLM judge finds its explanation equivalent to the expert diagnosis; 670 expert-annotated pairs; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro87#145
2Nano Banana84
3GPT-5.280#185
4Qwen 3 VL 8B80#917
5GPT Image 179
6GPT-4o76#751
7Qwen 2.5 VL 7B Instruct72#1902
8BAGEL-7B-MoT56#4619
9OmniGen251#4579

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=r3-bench · How It Works · Data refreshed daily, snapshot 2026-11-21.