IDEAL-Bench - Room Type Accuracy: leaderboard

Metric: Room type accuracy (%) among parse-successful scenes: the predicted room type matches the ground truth, IDEAL-Bench 3D layout task; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked.

Top models

#ModelScore
1Qwen 3 VL 235B A22B Instruct90.3
2GPT-5.489.3
3GPT-4o88.5
4Claude Sonnet 4.688.5
5Gemini 2.5 Pro87.5
6GLM-4.6V87
7Qwen 2.5 VL 72B Instruct85.4
8Gemma 4 31B (IT)84.4
9Qwen 3 VL 8B Instruct84.1
10Qwen 3 VL 30B A3B Instruct84
11InternVL3.5-8B80.8

Interactive version: theaggregate.ai/benchmark?slug=ideal-bench-room-type-accuracy · How It Works · Data refreshed daily, snapshot 2026-09-29.