EvaOmni - Basic Understanding - Bottleneck Grounded Score: leaderboard

EvaOmni (2026):1027questions from392videos,1FPS and480px long side with audio; shared prompt. Open non-MiMo models use recommended card configurations on8H20GPUs; MiMo and closed models use official APIs. Coverage/bottleneck grounding score correct answers against annotated audio and visual intervals; expert reference uses replay and is retained separately. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around 2029. 24 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.7 Flash29.2#22
2Gemini 3.5 Flash27.4#61
3Gemini 3.8 Flash27.4#24
4Gemini 3.6 Flash26.1#51
5Gemini 3.1 Pro (Preview)24.8#60
6Gemini 2.5 Pro22.5#154
7MiMo-V2.515.1#197
8MiMo-V2.6-Flash14.5#73
9Gemini 4 Argon13#8
10MiMo-V2.6-Pro12#38
11Gemini 2.5 Flash11.8#246
12Qwen3.8 Omni Flash11.8#33
13Seed 2.0 Lite11.7#146
14Gemini 3.5 Flash Lite10.7#159
15Gemini 3.1 Flash Lite10.5#194

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=evaomni-basic-understanding-bottleneck-grounded-score · How It Works · Data refreshed daily, snapshot 2026-10-22.