VideoJev Evaluation - Video-MME test without subtitles: leaderboard
VideoJev Evaluation - Video-MME test without subtitles. Table2 source protocol; VideoJev Joint inference; Instruct and Thinking checkpoints/runs preserved. Molmo2 32K context and Nemotron128K context. Missing source cells retained as absent. Metric: Accuracy (%). Primary published table; source configurations remain distinct.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around January 2027. 19 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Pro | 87.7 | #77 |
| 2 | GPT-5.2 | 85.8 | #109 |
| 3 | Qwen 3.5 35B A3B (Thinking) | 82.5 | #250 (Qwen 3.5 35B A3B) |
| 4 | Qwen 3.6 35B A3B (Thinking) | 82.5 | #217 (Qwen 3.6 35B A3B) |
| 5 | Claude Opus 4.5 | 81.4 | #81 |
| 6 | Qwen 3.5 4B (Thinking) | 76.9 | #463 (Qwen 3.5 4B) |
| 7 | Qwen 3 VL 30B A3B (Thinking) | 73.3 | #341 (Qwen 3 VL 30B A3B) |
| 8 | Qwen 3 VL 4B (Thinking) | 68.9 | #469 (Qwen 3 VL 4B) |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=videojev-evaluation-video-mme-test-without-subtitles · How It Works · Data refreshed daily, snapshot 2026-10-16.