EgoGapBench: leaderboard

EgoGapBench (2026) asks multimodal LLMs to pick the action available from an assigned viewpoint in multi-agent COCO scenes without first-person body cues, where copying another visible agent is a structural error. Zero-shot multiple-choice accuracy over all 1,000 items in percent, higher is better; chance is about 30%.

Metric: Accuracy (%; zero-shot multiple choice on 1,000 single-image items built from COCO multi-agent scenes: choose the action available from the given viewpoint, with distractors copying the singleton action of another visible agent (618 three-option and 382 four-option items, the latter adding an off-vantage distractor); predicted option string-matched to the key; chance about 30%). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 (2026-03-05) (Medium)66.1#87 (GPT-5.4 (2026-03-05))
2GPT-5.4 (2026-03-05) (Low)58.3#87 (GPT-5.4 (2026-03-05))
3gemma-4-E4B-it51.7#1469
4Gemini 3 Flash (Preview) (Low)39.2#144 (Gemini 3 Flash (Preview))
5Qwen 3.5 9B29#803
6Qwen 2.5 VL 7B Instruct28.6#1833
7GPT-4o (2024-11-20)26.7#866

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=egogapbench · How It Works · Data refreshed daily, snapshot 2026-11-13.