LifeEval (Open-Ended) - Multi-turn Interactive Collaboration: leaderboard

Metric: GPT-5 judge score against the reference answer (0 to 1 in steps of 0.25, shown times 100) on the 267 open-ended Multi-turn Interactive Collaboration questions of LifeEval, zero-shot, the model sees only the egocentric clip up to the question time (8 uniformly sampled frames for models without native video input), answer in fixed tags; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 26 models tracked.

Top models

#ModelScoreOverall rank
1GPT-573.92#91
2Gemini 2.5 Pro72.31#145
3GPT-5 Mini69.12#176
4Grok 467.62#169
5Gemini 2.5 Flash67.23#237
6GPT-4o59.29#333
7Qwen 3 VL 30B A3B Instruct52.39#365
8Qwen 3 VL 30B A3B (Thinking)50.41#338 (Qwen 3 VL 30B A3B)
9Qwen 3 VL 8B (Thinking)45.78
10Qwen 3 VL 8B Instruct42.41#401

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=lifeeval-open-ended-multi-turn-interactive-collaboration · How It Works · Data refreshed daily, snapshot 2026-10-11.