Cedar - Multimodal - Arabic: leaderboard

Culturally grounded emotion understanding on Cedar's 400 Arabic image-plus-narrative scenarios: choose which of 14 emotions Arabic-speaking annotators assign, a label chosen because it differs across cultures for the same scene. Accuracy (%) at temperature 0, higher is better (Cedar, Dai et al., Hefei University of Technology, ACL 2026).

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around October 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash (Thinking)45.75#452 (Gemini 2.5 Flash)
2Claude Sonnet 4.539.9#244
3Qwen 3 VL 235B A22B (Thinking)39.85#451
4Gemma 3 27B (IT)38.56#1306
5GPT-4o (2024-11-20)36.93#864
6Mistral Small 3.230.32#1592
7Qwen 3 VL 8B (Thinking)30.32#887

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cedar-multimodal-arabic · How It Works · Data refreshed daily, snapshot 2026-11-12.