EgoMonth - Direction Judgement: leaderboard
The Direction Judgement task of EgoMonth (Nanjing University, 2026): orientation judgements from the egocentric view, over month-long first-person recordings. Accuracy in percent on 36 four-option questions (chance 25); higher is better.
Metric: Accuracy (%; 36 direction judgement questions; four-option multiple-choice questions written by annotators over month-long first-person recordings of 20 participants (over 300 hours, 20 to 120 days each), answers matched to the key without an LLM judge; each model at its official frame setting (16 to 512 frames, 1 fps for Gemini); chance 25%). Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 58.3 | #266 |
| 2 | Qwen 2 VL 7B | 50 | #2261 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=egomonth-direction-judgement · How It Works · Data refreshed daily, snapshot 2026-11-13.