ViMU - Social Value Signal Identification: leaderboard
Metric: Social value signal identification score (%): selecting the social values or stances the video signals, set-based multiple-choice scoring: 0 if any selected option is wrong, otherwise the share of gold options selected, averaged over items, on ViMU, short online videos whose meaning lies in subtext (irony, mockery, criticism), uniformly sampled frames, zero-shot through official implementations or APIs; questions and references written by GPT-5.4 and reviewed by human experts; higher is better. Source: arxiv.org. Saturation forecast: Around April 2028. 16 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | O4 Mini | 29.51 |
| 2 | Grok 4.1 Fast | 28.73 |
| 3 | Gemini 3 Flash (Preview) | 28.26 |
| 4 | Qwen 3.5 27B | 22.4 |
| 5 | GPT-5.2 | 21.15 |
| 6 | MiMo-V2-Omni | 18.52 |
| 7 | Seed 2.0 Lite | 16.73 |
| 8 | Qwen 3 VL 32B Instruct | 15.17 |
| 9 | GPT-5.4 Mini | 11.77 |
| 10 | Ministral 8B | 10.45 |
| 11 | GLM-4.5V | 9.26 |
| 12 | GPT-4.1 Nano | 9.02 |
| 13 | Gemma 3 27B (IT) | 7.95 |
| 14 | Gemma 3 4B (IT) | 7.17 |
| 15 | Ministral 3 14B | 6.57 |
Interactive version: theaggregate.ai/benchmark?slug=vimu-social-value-signal-identification · How It Works · Data refreshed daily, snapshot 2026-10-07.