EvaOmni - Basic Understanding - Coverage Grounded Score: leaderboard

EvaOmni (2026):1027questions from392videos,1FPS and480px long side with audio; shared prompt. Open non-MiMo models use recommended card configurations on8H20GPUs; MiMo and closed models use official APIs. Coverage/bottleneck grounding score correct answers against annotated audio and visual intervals; expert reference uses replay and is retained separately. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around May 2027. 24 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.7 Flash65.3#22
2Gemini 3.8 Flash63.3#24
3Gemini 3.5 Flash61.4#61
4Gemini 3.6 Flash61.3#51
5Gemini 3.1 Pro (Preview)59.8#60
6Gemini 2.5 Pro55#154
7MiMo-V2.542.3#197
8MiMo-V2.6-Flash41.4#73
9Qwen3.8 Omni Flash41.4#33
10Seed 2.0 Lite36.1#146
11MiMo-V2.6-Pro35.2#38
12Gemini 4 Argon33.7#8
13Gemini 2.5 Flash31.4#246
14Gemini 3.1 Flash Lite (Preview)31.1#198
15Gemini 3.1 Flash Lite30.7#194

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=evaomni-basic-understanding-coverage-grounded-score · How It Works · Data refreshed daily, snapshot 2026-10-22.