GapEval - Instruction Following (Understanding): leaderboard

GapEval (Wang et al., 2026) poses bidirectional multimodal questions that a model can answer in text or with a generated image; these boards score the text answers. Instruction following: describe the result of explicit and rule-based edits to regions of an image. Accuracy in percent, judged correct or incorrect by GPT-5-mini against a reference answer and averaged over ten sampled runs; higher is better.

Metric: Accuracy (%; describe the result of explicit and implicit image-region edits; text answers to GapEval's bidirectional questions, judged correct or incorrect by GPT-5-mini against reference answers, mean of ten sampled runs). Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked.

Top models

#ModelScoreOverall rank
1GPT-595.45#163
2GPT-5 Mini93.6#349
3Gemini 2.5 Flash85.11#452
4Qwen 3 VL 235B A22B85.11#477

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=gapeval-instruction-following-understanding · How It Works · Data refreshed daily, snapshot 2026-11-12.