EvaOmni - Complex Reasoning - Answer Accuracy: leaderboard

EvaOmni (2026):1027questions from392videos,1FPS and480px long side with audio; shared prompt. Open non-MiMo models use recommended card configurations on8H20GPUs; MiMo and closed models use official APIs. Coverage/bottleneck grounding score correct answers against annotated audio and visual intervals; expert reference uses replay and is retained separately. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around January 2027. 24 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.7 Flash79.1#22
2Gemini 3.5 Flash77.8#61
3Gemini 3.1 Pro (Preview)76.5#60
4Gemini 3.8 Flash74.5#24
5Gemini 3.6 Flash73.2#51
6Gemini 2.5 Pro72.5#154
7Gemini 4 Argon72.5#8
8Seed 2.0 Lite62.7#146
9Qwen3.8 Omni Flash56.2#33
10MiMo-V2.6-Pro49.7#38
11MiMo-V2.6-Flash45.8#73
12MiMo-V2.545.1#197
13Gemini 3.5 Flash Lite42.5#159
14Qwen 3.5 Omni Plus42.5#98
15Gemini 2.5 Flash41.8#246

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=evaomni-complex-reasoning-answer-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-22.