MIOH - Position: leaderboard

The position task of MIOH (2026), a multi-image object hallucination benchmark for multimodal LLMs: questions about object positions across several images, averaged over easy, hard-negative, hard-positive and eight-image conditions. Accuracy in percent; higher is better.

Metric: Accuracy (%; position questions about object positions across several images; multi-image questions built from COCO-ReM, PACO and Visual Genome scenes in three reasoning patterns (comprehensive, comparative, selective), averaged over the easy, hard-negative, hard-positive and eight-image conditions). Source: arxiv.org. Saturation forecast: Around February 2027. 29 models tracked.

Top models

#ModelScoreOverall rank
1GPT-567.1#167
2Gemini 2.5 Pro66.6#266
3Qwen 2 VL 7B61.1#2261
4MiniCPM-V-2.659#3063
5Qwen 2.5 VL 7B52.6#1787
6Qwen 2 VL 2B45.3#6284
7Phi-4 Multimodal Instruct35.8#3882

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=mioh-position · How It Works · Data refreshed daily, snapshot 2026-11-13.