E3VS-Bench - Counting: leaderboard
Metric: Judge score on Counting questions (instances of an object class across the scene) of the E3VS-Bench test split (377 episodes, 21 3D Gaussian Splatting scenes): the model drives a 5-DoF camera agent (at most 25 steps) to a viewpoint from which the question can be answered; GPT-5.1 then answers from the agent's final view and a GPT-5.1 judge scores the answer 5 (correct) or 1 (incorrect); mean judge score on a 1-5 scale; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro | 2.04 |
| 2 | Gemini 3 Pro | 1.96 |
| 3 | GPT-5.1 (Non-reasoning) | 1.88 |
| 4 | Step3 VL 10B | 1.64 |
Interactive version: theaggregate.ai/benchmark?slug=e3vs-bench-counting · How It Works · Data refreshed daily, snapshot 2026-10-07.