OmniClean - Video-Holmes: leaderboard
The 885 of 1,837 Video-Holmes queries (reasoning questions on suspense short films that connect clues across the video) that OmniClean (StepFun-Audio Team, 2026) keeps after removing those Qwen3-VL-30B-A3B-Thinking can answer from the visual input and question alone. Accuracy in percent under Video-Holmes's official protocol; higher is better.
Metric: Accuracy (%; the 885 of 1,837 Video-Holmes queries left after visual-only cleaning; official answer matching). Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen3 Omni 30B A3B Instruct | 40.94 | #902 |
| 2 | Qwen2.5-Omni-7B | 27.37 | #1797 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=omniclean-video-holmes · How It Works · Data refreshed daily, snapshot 2026-11-12.