EgoPoint-Bench - Simulation Function & State: leaderboard
Metric: Accuracy (%) on the Function & State questions among the 1,929 held-out simulation test questions (HM3D, HSSD and AI2-THOR scenes); zero-shot (direct inference); true/false and single-choice questions by exact match, open-ended answers scored 0 to 1 by a GPT-4o judge; greedy decoding for open models, temperature 0 for API models; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 12 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5 Mini | 58.22 |
| 2 | Qwen 3 VL 8B Instruct | 54 |
| 3 | Qwen 3 VL 32B Instruct | 53.75 |
| 4 | Gemini 3 Flash | 53.33 |
| 5 | Gemini 3 Pro | 51.39 |
| 6 | GPT-5.2 Instant | 49.81 |
Interactive version: theaggregate.ai/benchmark?slug=egopoint-bench-simulation-function-state · How It Works · Data refreshed daily, snapshot 2026-10-07.