LogiScope-VQA - Equipment Operation Compliance: leaderboard

LogiScope-VQA Potential Risk Reasoning task on equipment operation compliance (EOC), asked over real logistics-park images and videos with human-validated answers (LogiScope-VQA, arXiv 2609.09790v1, Table 1). Micro-averaged accuracy converted from fractions to percent; higher is better; the paper's random-choice baseline scores 47.

Metric: Micro-averaged accuracy (%). Source: arxiv.org. Saturation forecast: Around February 2027. 20 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.581#33
2Claude Opus 4.779#51
3GPT-5.478#83
4Qwen 3.5 Plus77#133
5Qwen 3.7 Plus69#98
6Qwen 3 VL 235B A22B67#251
7Kimi K2.666#113
8Claude Sonnet 4.662#94
9Gemini 3.1 Pro (Preview)61#64
10MiniMax-M2.160#299
11MiniMax-M2.559#316
12GLM-5.238#80
13GLM-4.716#202
14Kimi K2 (Thinking)14#252 (Kimi K2)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=logiscope-vqa-equipment-operation-compliance · How It Works · Data refreshed daily, snapshot 2026-11-05.