MM-IFEval-Pro: leaderboard
MM-IFEval-Pro (Xiao et al., 2026) is a bilingual Chinese and English multimodal instruction-following benchmark: image-grounded tasks carry several constraints on length, keywords, numbers, format and content, each checked by a deterministic rule-based verifier, and a visual instruction-hijacking subset renders a competing task into the image while the user only asks for a transcription. Mean per-sample constraint-satisfaction rate in percent with the hijacking cases included; higher is better.
Metric: Accuracy (%; mean per-sample constraint-satisfaction rate x 100 over the bilingual Chinese and English test set, each constraint checked by a deterministic rule-based verifier (about 3 constraints per sample); test set with the visual instruction-hijacking cases included, the setting Table 1 reports). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3 VL 8B Instruct | 78.73 | #982 |
| 2 | Qwen 3.5 35B A3B | 74.5 | #480 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mm-ifeval-pro · How It Works · Data refreshed daily, snapshot 2026-11-12.