Social Caption - Holistic Social Analysis: leaderboard
Metric: Human rating of a holistic description of the video's social interaction (sum of six 1-5 Likert sub-dimensions: scene description, individuals, topic and context, socio-emotional analysis, answer detail, prompt adherence; 6-30; mean of two annotators per video; Social-IQ 2.0 validation videos (one minute each), a 50-video subset matched to the full set; the model gets the video at 1 frame per second and a timestamped WhisperX transcript, default temperature). Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro | 26.14 |
| 2 | Gemini 1.5 Pro | 24.46 |
| 3 | Qwen 2.5 VL 7B | 23.24 |
| 4 | InternVL2-8B | 23.13 |
| 5 | GPT-4o | 22.85 |
| 6 | MiniCPM-V-2.6 | 22.35 |
| 7 | InternVL3-8B | 21.78 |
| 8 | Qwen 2 VL 7B | 21.63 |
| 9 | Qwen2.5-Omni-7B | 14.84 |
Interactive version: theaggregate.ai/benchmark?slug=social-caption-holistic-social-analysis · How It Works · Data refreshed daily, snapshot 2026-09-26.