AffectSim (Initial View): leaderboard

AffectSim (2026) tests emotion recognition from body movement in simulated homes: emotion-labelled full-body motions are replayed in Habitat indoor scenes and a frozen vision-language model classifies each of 3,941 test episodes as angry, fearful, happy, neutral or sad. The observation is the agent's initial camera pose, held fixed. Score is macro-F1 in percent; higher is better.

Metric: Macro-F1 (%; P-Init: the agent's initial camera pose, held fixed; five-class emotion recognition (angry, fearful, happy, neutral, sad) on the 3,941 test episodes of AffectSim, full-body affective motions replayed in Habitat indoor scenes; frozen recognizer, eight uniformly sampled frames for most open models, full video or eight frames for closed models). Source: arxiv.org. Saturation forecast: Around 2029. 24 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 525.46#22
2Gemini 3 Flash24.77#164
3Gemini 3 Pro22.66#137
4GPT-5.220.89#176
5GPT-5.6 Sol19.29#30
6InternVL2.5-78B17.24#1014
7Qwen 3 VL 8B Instruct10.12#981
8Qwen 3 VL 8B (Thinking)7.93#887
9Qwen2.5-Omni-7B7.78#1789
10MiniCPM-V-2.66.55#3063
11Qwen 2.5 VL 72B Instruct6.53#846
12Qwen 2.5 VL 7B Instruct6.09#1833

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=affectsim-initial-view · How It Works · Data refreshed daily, snapshot 2026-11-13.