SuperMemory-VQA (EgoButler) - Answerable F1: leaderboard

Metric: Binary answerable-vs-unanswerable F1 (%) under EgoButler; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 10 models tracked.

Top models

#ModelScore
1GPT-5.4 Mini75
2GPT-5.471.7
3Gemini 3 Flash71.2
4InternVL3.5-8B61.4
5Gemma 4 31B (IT)43.9
6Gemini 3.1 Pro (Preview)43.5
7gemma-4-E4B-it30.9

Interactive version: theaggregate.ai/benchmark?slug=supermemory-vqa-egobutler-answerable-f1 · How It Works · Data refreshed daily, snapshot 2026-09-29.