SuperGlasses: leaderboard

Metric: Accuracy (%) on all 2,422 questions of SuperGlasses' smart-glasses visual question answering set (images captured with Ray-Ban Meta, XiaoMi and RayNeo glasses), direct answers without retrieval, graded against the reference by a Qwen2.5-32B judge; higher is better. Source: arxiv.org. Saturation forecast: Around January 2028. 20 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro43.02#145
2GPT-4o41.91#333
3Qwen 2.5 VL 72B Instruct37.65#364
4Claude Sonnet 437.16#194
5Qwen 2.5 VL 32B Instruct36.54#443
6Qwen 2.5 VL 7B Instruct32.82#643
7InternVL3-8B26.88#606
8GLM-4.1V-9B (Thinking)23.82#457 (GLM-4.1V-9B)

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=superglasses · How It Works · Data refreshed daily, snapshot 2026-10-11.