OmniCoT: leaderboard

OmniCoT (2026) is a panoramic spatial reasoning benchmark for multimodal models with multi-hop questions over full 360-degree images in three dimensions: See (viewpoint transformation), Locate (inter-object relations) and Move (embodied action simulation). This board is overall accuracy in percent on the synthetic OmniCoT-B panoramas with chain-of-thought prompting; higher is better.

Metric: Overall accuracy (%), question-weighted over the See, Locate and Move dimensions, with chain-of-thought prompting on OmniCoT-B (synthetic 360-degree equirectangular panoramas with three anchor objects given by coordinates and orientation); answers are object identities, visibility, directions or the closest angle option, exact match after normalization. Source: arxiv.org. Saturation forecast: Around 2029. 21 models tracked.

Top models

#ModelScoreOverall rank
1GPT-539.72#167
2Seed 1.838.9#242
3Qwen 2.5 VL 72B Instruct35.26#846
4Grok 434.99#307
5Qwen 2.5 VL 32B Instruct32.39#1053
6ChatGPT 4o31.58#610
7GLM-4.5V29.95#744
8Gemini 3 Flash28.43#164
9Qwen 3 VL 8B Instruct27.56#981
10Qwen 2.5 VL 7B Instruct23.53#1833

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=omnicot · How It Works · Data refreshed daily, snapshot 2026-11-13.