IKEA-Bench (Visual+Text) - Step Recognition: leaderboard

Step Recognition on IKEA-Bench (2026), which pairs wordless IKEA assembly manual diagrams with real assembly video from 29 products: the model sees video frames of one assembly step and picks the matching wordless manual diagram from four options drawn from adjacent steps, with each diagram image followed by an LLM-written text description of it. Zero-shot accuracy in percent; higher is better.

Metric: Accuracy (%) of four-way multiple-choice step recognition (match the video frames of one assembly step to one of four wordless manual diagrams, distractors from adjacent steps; 320 questions; chance 25) on IKEA-Bench, wordless IKEA manual diagrams against real assembly video from 29 products, Visual+Text setting (each diagram image followed by a text description of it), zero-shot greedy decoding, unparsed answers counted wrong; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen 3.5 27B59.4#380
2Qwen 3.5 9B54.1#838
3InternVL3.5-38B53.4#1026
4Qwen 3 VL 30B A3B49.1#791
5Qwen 3 VL 8B45#927
6GLM-4.1V-9B (Thinking)42.8
7Gemma 3 27B42.5#1672
8Qwen 2.5 VL 7B42.2#1878
9InternVL3.5-8B42.2#1618
10Qwen 2.5 VL 3B41.9#2664
11MiniCPM-V-4.540.6#1451
12Gemma 3 12B38.4#2091
13Qwen 3.5 2B36.6#5380
14LLaVA-OV-8B (IKEA-Bench checkpoint unspecified)35
15Qwen 3 VL 2B34.4#2156

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=ikea-bench-visual-plustext-step-recognition · How It Works · Data refreshed daily, snapshot 2026-11-22.