MultiHaystack - Visual Parsing and Positioning: leaderboard

Metric: Answer accuracy (%) on the visual parsing and positioning questions (33 of 747), where the model answers from the top-5 items that the E5-V retriever returns from MultiHaystack's 46,260-item mixed corpus of images, videos and documents, graded correct or incorrect by a GPT-4o-mini judge; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.

Top models

#ModelScoreOverall rank
1GPT-557.58#91
2Gemini 2.5 Flash54.55#237
3InternVL3-8B42.42#606
4Qwen 2 VL 7B18.18#741

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=multihaystack-visual-parsing-and-positioning · How It Works · Data refreshed daily, snapshot 2026-10-11.