Embodied3DBench - 2D Average: leaderboard

Metric: Mean of the five 2D task scores, each a normalized score (0-100): IoU of predicted boxes or the L2 error of predicted points (pixels in 2D, metres in 3D) mapped to 0-100, on the simulated robotic tabletop scenes of Embodied3DBench (21K QA pairs over 4.8K object instances), zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 13 models tracked.

Top models

#ModelScore
1Qwen 3 VL 4B Instruct56.5
2Qwen 2.5 VL 72B Instruct55.5
3GPT-554.4
4Qwen 2.5 VL 7B Instruct43
5Claude Sonnet 441.2
6GPT-4o36.6
7Gemini 2.5 Flash31.8
8Gemini 2.5 Pro31.4
9InternVL3-38B27.4
10Doubao-Seed-1.6 (Thinking)27.2

Interactive version: theaggregate.ai/benchmark?slug=embodied3dbench-2d-average · How It Works · Data refreshed daily, snapshot 2026-10-07.