EgoGapBench - Four Options: leaderboard

EgoGapBench (2026) asks multimodal LLMs to pick the action available from an assigned viewpoint in multi-agent COCO scenes without first-person body cues, where copying another visible agent is a structural error. Accuracy in percent on the 382 four-option items, which add an off-vantage distractor; higher is better, chance is 25%.

Metric: Accuracy (%; zero-shot multiple choice on 382 four-option single-image items built from COCO multi-agent scenes: choose the action available from the given viewpoint, with distractors copying the singleton action of another visible agent, plus an off-vantage distractor that fits the activity but not the viewpoint; predicted option string-matched to the key; chance about 25%). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 (2026-03-05) (Medium)65.7#87 (GPT-5.4 (2026-03-05))
2GPT-5.4 (2026-03-05) (Low)57.3#87 (GPT-5.4 (2026-03-05))
3gemma-4-E4B-it49#1469
4Gemini 3 Flash (Preview) (Low)33.5#144 (Gemini 3 Flash (Preview))
5Qwen 2.5 VL 7B Instruct27#1833
6Qwen 3.5 9B24.3#803
7GPT-4o (2024-11-20)19.6#866

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=egogapbench-four-options · How It Works · Data refreshed daily, snapshot 2026-11-13.