MVX-Bench - Spatial Relation: leaderboard

Metric: Accuracy (%) on the 150 Spatial Relation questions (pick the candidate sharing a camera-motion trend with the reference), MVX-Bench's multi-video multiple-choice questions (each pairs a question with several videos; 1,442 questions over 4,255 videos repurposed from 11 annotated video datasets), end-to-end inference at temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around 2033. 21 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.6 27B (Thinking)29.3#163 (Qwen 3.6 27B)
2GPT-5.228.7#105
3Gemma 3 27B (IT)27.3#509
4Qwen 2.5 VL 32B Instruct27.3#443
5GPT-4o26.7#333
6Pixtral-12B25.3#795
7Gemma 3 4B (IT)24#971
8Phi-4 Multimodal Instruct22.7#896
9Gemma 3 12B (IT)22#655
10Qwen 2.5 VL 7B Instruct20#643
11Qwen 3.6 27B (Non-reasoning)19.3#163 (Qwen 3.6 27B)

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=mvx-bench-spatial-relation · How It Works · Data refreshed daily, snapshot 2026-10-11.