EPIC-Bench - Basic Attributes: leaderboard

EPIC-Bench (2026) is a mask-grounded benchmark of embodied visual perception: 6,661 annotated image, text and mask samples across 23 tasks in target localization, navigation and manipulation, scored by localization, counting, path and feasibility metrics. This board scores exhaustive grounding of every object matching a colour, material, shape or category description, on a 0-100 scale; higher is better.

Metric: Target localization score (0-100) on the basic-attribute tasks (exhaustive grounding of every object matching a colour, material, shape or category description), on EPIC-Bench (6,661 human-annotated image, text and mask tuples from 25 public datasets across 23 fine-grained embodied perception tasks; the model outputs bounding boxes, counts, path points or feasibility judgements that are scored against the masks), zero-shot, averaged over six runs for local models and two for API models; higher is better. Source: arxiv.org. Saturation forecast: Around April 2027. 76 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Qwen 3 VL 235B A22B (Thinking)58#459
2GPT-5.5Non-reasoning57.78#54
3Gemini 3 Pro56.81#145
4Qwen 3.5 397B A17B55.45#264
5Gemini 3.1 Pro (Preview)55.38#99
6Seed 1.855.29#252
7Qwen 3.5 Plus55.09#242
8Doubao-Seed-1.6-vision54.64#361
9Qwen 3.5 27B54.15#375
10Qwen 3.5 122B A10B53.61#346
11Qwen 3.5 35B A3B53.51#492
12Qwen 3 VL 30B A3B (Thinking)52.69#719
13Hunyuan-T1-Vision51.24#767
14Qwen 3.6 27BNon-reasoning51.04#351
15RoboBrain-2.0-32B50.66

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=epic-bench-basic-attributes · How It Works · Data refreshed daily, snapshot 2026-11-21.