VideoJev Evaluation - LVBench test without subtitles: leaderboard
VideoJev Evaluation - LVBench test without subtitles. Table2 source protocol; VideoJev Joint inference; Instruct and Thinking checkpoints/runs preserved. Molmo2 32K context and Nemotron128K context. Missing source cells retained as absent. Metric: Accuracy (%). Primary published table; source configurations remain distinct.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around January 2027. 20 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Seed 2.0 Pro | 76.4 | #114 |
| 2 | Gemini 3 Pro | 76.2 | #77 |
| 3 | GPT-5.2 | 73.7 | #109 |
| 4 | Qwen 3.5 35B A3B (Thinking) | 71.4 | #250 (Qwen 3.5 35B A3B) |
| 5 | Qwen 3.6 35B A3B (Thinking) | 71.4 | #217 (Qwen 3.6 35B A3B) |
| 6 | Qwen 3.5 4B (Thinking) | 66.4 | #463 (Qwen 3.5 4B) |
| 7 | Qwen 3 VL 30B A3B (Thinking) | 59.2 | #341 (Qwen 3 VL 30B A3B) |
| 8 | Claude Opus 4.5 | 57.3 | #81 |
| 9 | Qwen 3 VL 4B (Thinking) | 53.5 | #469 (Qwen 3 VL 4B) |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=videojev-evaluation-lvbench-test-without-subtitles · How It Works · Data refreshed daily, snapshot 2026-10-16.