Cedar - Text-Only - Hindi: leaderboard

Culturally grounded emotion understanding on Cedar's 1,166 Hindi text-only scenarios: choose which of 14 emotions Hindi-speaking annotators assign, a label chosen because it differs across cultures for the same scenario. Accuracy (%) at temperature 0, higher is better (Cedar, Dai et al., Hefei University of Technology, ACL 2026).

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around 2028. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash (Thinking)51.27#452 (Gemini 2.5 Flash)
2Qwen 3 VL 235B A22B (Thinking)49.06#451
3GPT-4o (2024-11-20)47.45#864
4Gemma 3 27B (IT)46.85#1306
5Kimi K246.06#435
6Claude Sonnet 4.543.95#244
7aya-10138.29#4382
8Mistral Small 3.237.26#1592
9Qwen 3 VL 8B (Thinking)37.08#887
10Llama 3.2 11B Instruct32.84#5039

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cedar-text-only-hindi · How It Works · Data refreshed daily, snapshot 2026-11-12.