Ambiguous Speech Emotion - CREMA-D: leaderboard

Ambiguous emotion recognition from speech: an audio-language model outputs a probability distribution over six basic emotions for acted CREMA-D clips, compared with the spread of the crowd raters' labels (Jia et al., 2026). Jensen-Shannon divergence between the two distributions, from 0 to 1; lower is better.

Metric: Jensen-Shannon divergence (0-1; between the emotion distribution the model predicts for an utterance and the distribution of the human annotators' labels, mean over utterances; lower is better; CREMA-D, crowd-rated acted clips of six basic emotions). Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro0.3#262
2Gemini 2.0 Flash0.34#702
3Qwen2.5-Omni-7B0.42#1797

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=ambiguous-speech-emotion-crema-d · How It Works · Data refreshed daily, snapshot 2026-11-12.