EvaOmni - Overall - Answer Accuracy: leaderboard

EvaOmni (2026):1027questions from392videos,1FPS and480px long side with audio; shared prompt. Open non-MiMo models use recommended card configurations on8H20GPUs; MiMo and closed models use official APIs. Coverage/bottleneck grounding score correct answers against annotated audio and visual intervals; expert reference uses replay and is retained separately. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around January 2027. 24 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.7 Flash79.4#22
2Gemini 3.8 Flash78#24
3Gemini 3.6 Flash74.4#51
4Gemini 3.1 Pro (Preview)72.3#60
5Gemini 2.5 Pro71#154
6Gemini 3.5 Flash68.5#61
7Gemini 4 Argon61.4#8
8Qwen3.8 Omni Flash58.2#33
9MiMo-V2.556.8#197
10Seed 2.0 Lite55.4#146
11MiMo-V2.6-Flash53.6#73
12MiMo-V2.6-Pro51.8#38
13Qwen 3.5 Omni Plus49#98
14Gemini 3.5 Flash Lite48.3#159
15Gemini 2.5 Flash48.1#246

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=evaomni-overall-answer-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-22.