ViMU: leaderboard
ViMU (2026) benchmarks video metaphorical understanding: whether models grasp the implicit, ironic or socially coded meaning of short online videos. The score is the average in percent of its four tasks: open-ended interpretation, evidence grounding, and identification of rhetoric mechanisms and social value signals; higher is better.
Metric: Average (%) of the four task scores (open-ended interpretation, evidence grounding, rhetoric mechanism and social value signal identification) on ViMU, short online videos whose meaning lies in subtext (irony, mockery, criticism), uniformly sampled frames, zero-shot through official implementations or APIs; questions and references written by GPT-5.4 and reviewed by human experts; higher is better. Source: arxiv.org. Saturation forecast: Around July 2028. 16 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | O4 Mini | 46.91 | #368 |
| 2 | Grok 4.1 Fast | 46.28 | #427 |
| 3 | Qwen 3.5 27B | 45.91 | #375 |
| 4 | GPT-5.2 | 44.67 | #185 |
| 5 | Gemini 3 Flash (Preview) | 44.31 | #152 |
| 6 | Qwen 3 VL 32B Instruct | 41.64 | #606 |
| 7 | Seed 2.0 Lite | 40.62 | #300 |
| 8 | MiMo-V2-Omni | 38.14 | #465 |
| 9 | GPT-5.4 Mini | 36.64 | #406 |
| 10 | Gemma 3 27B (IT) | 36.43 | #1324 |
| 11 | Ministral 3 14B | 35.45 | #1870 |
| 12 | Ministral 8B | 34.79 | #4857 |
| 13 | GLM-4.5V | 25.94 | #754 |
| 14 | Gemma 3 4B (IT) | 23.28 | #4139 |
| 15 | Claude 3 Haiku | 22.9 | #2663 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=vimu · How It Works · Data refreshed daily, snapshot 2026-11-21.