ViMU - Rhetoric Mechanism Identification: leaderboard
ViMU (2026) benchmarks video metaphorical understanding: whether models grasp the implicit, ironic or socially coded meaning of short online videos. This board is a multiple-choice score in percent for identifying the rhetorical devices used, with zero credit for any wrong selection and partial credit otherwise; higher is better.
Metric: Rhetoric mechanism identification score (%): selecting the rhetorical devices (irony, exaggeration, juxtaposition and others) that carry the meaning, set-based multiple-choice scoring: 0 if any selected option is wrong, otherwise the share of gold options selected, averaged over items, on ViMU, short online videos whose meaning lies in subtext (irony, mockery, criticism), uniformly sampled frames, zero-shot through official implementations or APIs; questions and references written by GPT-5.4 and reviewed by human experts; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 16 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.5 27B | 38.18 | #375 |
| 2 | Grok 4.1 Fast | 34.91 | #427 |
| 3 | Gemini 3 Flash (Preview) | 33.63 | #152 |
| 4 | O4 Mini | 33.21 | #368 |
| 5 | Gemma 3 27B (IT) | 32.47 | #1324 |
| 6 | Ministral 8B | 31.87 | #4857 |
| 7 | Qwen 3 VL 32B Instruct | 27.65 | #606 |
| 8 | Ministral 3 14B | 27.29 | #1870 |
| 9 | Gemma 3 4B (IT) | 21.1 | #4139 |
| 10 | MiMo-V2-Omni | 21.04 | #465 |
| 11 | Seed 2.0 Lite | 18.75 | #300 |
| 12 | GPT-5.2 | 16.55 | #185 |
| 13 | GLM-4.5V | 8.87 | #754 |
| 14 | GPT-5.4 Mini | 4.17 | #406 |
| 15 | Claude 3 Haiku | 2.99 | #2663 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=vimu-rhetoric-mechanism-identification · How It Works · Data refreshed daily, snapshot 2026-11-21.