HUG-VIS - Emotion Recognition (Video + Text): leaderboard

HUG-VIS (2026) records 30 professional actors performing the same 280 emotion-conditioned assignments. This board scores zero-shot seven-class emotion recognition from video and text input over its 8,400 clips, as accuracy in percent; higher is better.

Metric: Seven-class emotion recognition accuracy (%; 8,400 seated half-body clips of 30 professional actors, each performing the same 280 emotion-action-prompt assignments in a controlled Mandarin studio, 1,200 clips per emotion; zero-shot; input: video, text). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.

Top models

#ModelScoreOverall rank
1Qwen2.5-Omni-7B83.74#1789
2Molmo2-8B75.23#1483

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=hug-vis-emotion-recognition-video-plus-text · How It Works · Data refreshed daily, snapshot 2026-11-13.