E3VS-Bench - Object State: leaderboard
E3VS-Bench (2026) embodied active-perception episodes on Object State questions (open/closed and similar states visible only from suitable viewpoints): a vision-language agent moves a 5-DoF camera in 3D Gaussian Splatting scenes, and a GPT-5.1 answerer and judge score the outcome 5 (correct) or 1 (incorrect). Mean score on a 1-5 scale; higher is better.
Metric: Judge score on Object State questions (open/closed and similar states visible only from suitable viewpoints) of the E3VS-Bench test split (377 episodes, 21 3D Gaussian Splatting scenes): the model drives a 5-DoF camera agent (at most 25 steps) to a viewpoint from which the question can be answered; GPT-5.1 then answers from the agent's final view and a GPT-5.1 judge scores the answer 5 (correct) or 1 (incorrect); mean judge score on a 1-5 scale; higher is better. Source: arxiv.org. Saturation forecast: Around May 2027. 8 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 3 Flash | Non-reasoning | 2.82 | #180 |
| 2 | Gemini 3 Pro | 2.55 | #146 | |
| 3 | Gemini 2.5 Pro | 2.36 | #280 | |
| 4 | Qwen 3 VL 8B | 2.36 | #927 | |
| 5 | Step3 VL 10B | 2.27 | #1058 | |
| 6 | GPT-5.1 | Non-reasoning | 2.18 | #248 |
| 7 | InternVL3.5-8B | 2.18 | #1618 | |
| 8 | Qwen 3 VL 30B A3B | 2.09 | #791 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=e3vs-bench-object-state · How It Works · Data refreshed daily, snapshot 2026-11-22.