Cedar - Text-Only - Arabic: leaderboard

Culturally grounded emotion understanding on Cedar's 1,166 Arabic text-only scenarios: choose which of 14 emotions Arabic-speaking annotators assign, a label chosen because it differs across cultures for the same scenario. Accuracy (%) at temperature 0, higher is better (Cedar, Dai et al., Hefei University of Technology, ACL 2026).

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around February 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash (Thinking)51.48#452 (Gemini 2.5 Flash)
2Claude Sonnet 4.549.69#244
3Qwen 3 VL 235B A22B (Thinking)47.95#451
4GPT-4o (2024-11-20)46.56#864
5Kimi K244.15#435
6Qwen 3 VL 8B (Thinking)39.36#887
7Gemma 3 27B (IT)39.13#1306
8aya-10129.33#4382
9Mistral Small 3.220.12#1592

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cedar-text-only-arabic · How It Works · Data refreshed daily, snapshot 2026-11-12.