IKEA-Bench (Visual+Text) - Step Recognition: leaderboard
Step Recognition on IKEA-Bench (2026), which pairs wordless IKEA assembly manual diagrams with real assembly video from 29 products: the model sees video frames of one assembly step and picks the matching wordless manual diagram from four options drawn from adjacent steps, with each diagram image followed by an LLM-written text description of it. Zero-shot accuracy in percent; higher is better.
Metric: Accuracy (%) of four-way multiple-choice step recognition (match the video frames of one assembly step to one of four wordless manual diagrams, distractors from adjacent steps; 320 questions; chance 25) on IKEA-Bench, wordless IKEA manual diagrams against real assembly video from 29 products, Visual+Text setting (each diagram image followed by a text description of it), zero-shot greedy decoding, unparsed answers counted wrong; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.5 27B | 59.4 | #380 |
| 2 | Qwen 3.5 9B | 54.1 | #838 |
| 3 | InternVL3.5-38B | 53.4 | #1026 |
| 4 | Qwen 3 VL 30B A3B | 49.1 | #791 |
| 5 | Qwen 3 VL 8B | 45 | #927 |
| 6 | GLM-4.1V-9B (Thinking) | 42.8 | |
| 7 | Gemma 3 27B | 42.5 | #1672 |
| 8 | Qwen 2.5 VL 7B | 42.2 | #1878 |
| 9 | InternVL3.5-8B | 42.2 | #1618 |
| 10 | Qwen 2.5 VL 3B | 41.9 | #2664 |
| 11 | MiniCPM-V-4.5 | 40.6 | #1451 |
| 12 | Gemma 3 12B | 38.4 | #2091 |
| 13 | Qwen 3.5 2B | 36.6 | #5380 |
| 14 | LLaVA-OV-8B (IKEA-Bench checkpoint unspecified) | 35 | |
| 15 | Qwen 3 VL 2B | 34.4 | #2156 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=ikea-bench-visual-plustext-step-recognition · How It Works · Data refreshed daily, snapshot 2026-11-22.