AffectSim (Active Observation): leaderboard
AffectSim (2026) tests emotion recognition from body movement in simulated homes: emotion-labelled full-body motions are replayed in Habitat indoor scenes and a frozen vision-language model classifies each of 3,941 test episodes as angry, fearful, happy, neutral or sad. The observation is the view reached by the authors' two-stage active-observation baseline (person search, then target following), falling back to P-Init when no new view is acquired. Score is macro-F1 in percent; higher is better.
Metric: Macro-F1 (%; A-Obs: the view reached by the authors' two-stage active-observation baseline (person search, then target following), falling back to P-Init when no new view is acquired; five-class emotion recognition (angry, fearful, happy, neutral, sad) on the 3,941 test episodes of AffectSim, full-body affective motions replayed in Habitat indoor scenes; frozen recognizer, eight uniformly sampled frames for most open models, full video or eight frames for closed models). Source: arxiv.org. Saturation forecast: Around 2029. 24 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 28.37 | #22 |
| 2 | Gemini 3 Pro | 25.42 | #137 |
| 3 | Gemini 3 Flash | 24.62 | #164 |
| 4 | GPT-5.6 Sol | 21.87 | #30 |
| 5 | GPT-5.2 | 21 | #176 |
| 6 | InternVL2.5-78B | 18.52 | #1014 |
| 7 | Qwen 3 VL 8B Instruct | 13.19 | #981 |
| 8 | Qwen 3 VL 8B (Thinking) | 9.59 | #887 |
| 9 | Qwen2.5-Omni-7B | 9.45 | #1789 |
| 10 | Qwen 2.5 VL 72B Instruct | 7.63 | #846 |
| 11 | MiniCPM-V-2.6 | 6.79 | #3063 |
| 12 | Qwen 2.5 VL 7B Instruct | 6.11 | #1833 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=affectsim-active-observation · How It Works · Data refreshed daily, snapshot 2026-11-13.