PRISM-VLM - Instruction Following: leaderboard

The instruction-following axis of PRISM-VLM (NAVER, 2026): each recycled visual question carries one to three verifiable formatting constraints adapted from IFEval, such as length, casing, keywords or output format. Mean share of constraints satisfied, in percent; higher is better.

Metric: Per-axis mean score (%; mean compliance with 1-3 verifiable IFEval-style formatting constraints appended to each item; over PRISM-VLM's 6,238 items recycled from 15 public VLM benchmarks (five seeds of 100 items per benchmark); GPT-5 (low effort) synthesizes the perturbations and grades the open-ended axes; each model at the lowest reasoning effort its provider exposes, temperature 0). Source: arxiv.org. Saturation forecast: Around February 2027. 42 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5 Mini (Minimal)87.5#349 (GPT-5 Mini)
2GPT-5.4 Mini87.1#389
3GPT-5.4 Nano86#633
4GPT-4o Mini84.3#1627
5GPT-5 Nano (Minimal)83.7#888 (GPT-5 Nano)
6Gemini 3.1 Flash Lite (Minimal)83.6#363 (Gemini 3.1 Flash Lite)
7Qwen 3 VL 8B Instruct82.3#982
8GPT-4.1 Nano81.7#1992
9Gemini 2.5 Flash (Non-reasoning)81.4#452 (Gemini 2.5 Flash)
10Gemini 3 Flash (Minimal)81#159 (Gemini 3 Flash)
11GPT-4.1 Mini80.5#775
12Molmo2-8B79.8#1488
13Gemini 2.0 Flash79.1#702
14Qwen 3 VL 4B Instruct78.9#1281
15Claude 3 Haiku77.8#2629

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=prism-vlm-instruction-following · How It Works · Data refreshed daily, snapshot 2026-11-12.