SuperMemory-VQA (EgoButler) - MRR: leaderboard
SuperMemory-VQA is an egocentric long-horizon memory question-answering benchmark of 4,853 QA pairs from 52.9 hours of Meta Aria glasses recordings across six memory tasks, with ordered answer choices (correct, vague, wrong, unanswerable). This board reports Mean reciprocal rank (%) of the correct answer under EgoButler; higher is better.
Metric: Mean reciprocal rank (%) of the correct answer under EgoButler; higher is better. Source: arxiv.org. Saturation forecast: Around July 2027. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash | 71.6 | #164 |
| 2 | GPT-5.4 | 67.2 | #123 |
| 3 | GPT-5.4 Mini | 66.1 | #389 |
| 4 | Gemini 3.1 Pro (Preview) | 64.2 | #94 |
| 5 | Gemma 4 31B (IT) | 62.2 | #342 |
| 6 | gemma-4-E4B-it | 58.2 | #1469 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=supermemory-vqa-egobutler-mrr · How It Works · Data refreshed daily, snapshot 2026-11-13.