E3VS-Bench - Context-Guided Search: leaderboard

E3VS-Bench (2026) embodied active-perception episodes on Context-guided Search questions (finding an object from its function or situation without its name): a vision-language agent moves a 5-DoF camera in 3D Gaussian Splatting scenes, and a GPT-5.1 answerer and judge score the outcome 5 (correct) or 1 (incorrect). Mean score on a 1-5 scale; higher is better.

Metric: Judge score on Context-guided Search questions (finding an object from its function or situation without its name) of the E3VS-Bench test split (377 episodes, 21 3D Gaussian Splatting scenes): the model drives a 5-DoF camera agent (at most 25 steps) to a viewpoint from which the question can be answered; GPT-5.1 then answers from the agent's final view and a GPT-5.1 judge scores the answer 5 (correct) or 1 (incorrect); mean judge score on a 1-5 scale; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3 FlashNon-reasoning3.53#180
2Gemini 3 Pro3.4#146
3Qwen 3 VL 8B3.13#927
4Step3 VL 10B3.13#1058
5GPT-5.1Non-reasoning2.73#248
6Gemini 2.5 Pro2.6#280
7InternVL3.5-8B2.6#1618
8Qwen 3 VL 30B A3B2.47#791

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=e3vs-bench-context-guided-search · How It Works · Data refreshed daily, snapshot 2026-11-22.