Cedar - Multimodal - Hindi: leaderboard

Culturally grounded emotion understanding on Cedar's 400 Hindi image-plus-narrative scenarios: choose which of 14 emotions Hindi-speaking annotators assign, a label chosen because it differs across cultures for the same scene. Accuracy (%) at temperature 0, higher is better (Cedar, Dai et al., Hefei University of Technology, ACL 2026).

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around 2029. 15 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash (Thinking)47.73#452 (Gemini 2.5 Flash)
2Gemma 3 27B (IT)44.38#1306
3Qwen 3 VL 235B A22B (Thinking)41.71#451
4Claude Sonnet 4.540.82#244
5GPT-4o (2024-11-20)39.14#864
6Mistral Small 3.232.98#1592
7Llama 3.2 11B Instruct32.92#5039
8Qwen 3 VL 8B (Thinking)27.85#887

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cedar-multimodal-hindi · How It Works · Data refreshed daily, snapshot 2026-11-12.