EvaOmni - Complex Reasoning - Bottleneck Grounded Score: leaderboard

EvaOmni (2026):1027questions from392videos,1FPS and480px long side with audio; shared prompt. Open non-MiMo models use recommended card configurations on8H20GPUs; MiMo and closed models use official APIs. Coverage/bottleneck grounding score correct answers against annotated audio and visual intervals; expert reference uses replay and is retained separately. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around 2030. 24 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.7 Flash12.3#22
2Gemini 3.5 Flash11.3#61
3Gemini 3.1 Pro (Preview)11.2#60
4Gemini 3.6 Flash10.6#51
5Gemini 3.8 Flash9.5#24
6Gemini 2.5 Pro9.4#154
7Qwen3.8 Omni Flash7.8#33
8Gemini 4 Argon7.5#8
9MiMo-V2.56.7#197
10Seed 2.0 Lite5.9#146
11MiMo-V2.6-Flash5.9#73
12MiMo-V2.6-Pro5#38
13Gemini 2.5 Flash4#246
14Gemini 3.5 Flash Lite3.5#159
15Gemini 3.1 Flash Lite (Preview)3.3#198

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=evaomni-complex-reasoning-bottleneck-grounded-score · How It Works · Data refreshed daily, snapshot 2026-10-22.