IKEA-Bench (Text Only) - Next-Step Prediction: leaderboard

Next-Step Prediction on IKEA-Bench (2026), which pairs wordless IKEA assembly manual diagrams with real assembly video from 29 products: the model picks, from four diagrams, the step that follows the one shown in video, with the diagram images replaced by LLM-written text descriptions. Zero-shot accuracy in percent; higher is better.

Metric: Accuracy (%) of next-step prediction (pick the diagram of the step after the one shown in video from four diagrams; 204 questions; chance 25) on IKEA-Bench, wordless IKEA manual diagrams against real assembly video from 29 products, Text Only setting (diagram images replaced by text descriptions), zero-shot greedy decoding, unparsed answers counted wrong; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen 3.5 27B42.2#380
2InternVL3.5-38B37.3#1026
3MiniCPM-V-4.535.3#1451
4Qwen 3.5 9B34.3#838
5InternVL3.5-2B34.3#3313
6InternVL3.5-8B33.3#1618
7Qwen 3 VL 30B A3B32.8#791
8LLaVA-OV-8B (IKEA-Bench checkpoint unspecified)30.9
9Qwen 3 VL 8B30.4#927
10Qwen 2.5 VL 7B29.9#1878
11GLM-4.1V-9B (Thinking)29.9
12Qwen 3 VL 2B29.4#2156
13Gemma 3 27B28.9#1672
14Gemma 3 12B28.9#2091
15Gemma 3 4B28.4#5347

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=ikea-bench-text-only-next-step-prediction · How It Works · Data refreshed daily, snapshot 2026-11-22.