LogiScope-VQA - Spatial Relation: leaderboard

LogiScope-VQA Warehouse Knowledge Understanding task on spatial relations (SR), asked over real logistics-park images and videos with human-validated answers (LogiScope-VQA, arXiv 2609.09790v1, Table 1). Micro-averaged accuracy converted from fractions to percent; higher is better; the paper's random-choice baseline scores 15.

Metric: Micro-averaged accuracy (%). Source: arxiv.org. Saturation forecast: Around February 2027. 20 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)66#64
2Qwen 3.5 Plus61#133
3Claude Opus 4.760#51
4GPT-5.459#83
5GPT-5.559#33
6Claude Sonnet 4.658#94
7Qwen 3.7 Plus56#98
8Qwen 3 VL 235B A22B55#251
9Kimi K2.645#113
10GLM-5.220#80
11GLM-4.720#202
12MiniMax-M2.119#299
13Kimi K2 (Thinking)18#252 (Kimi K2)
14MiniMax-M2.518#316

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=logiscope-vqa-spatial-relation · How It Works · Data refreshed daily, snapshot 2026-11-05.