Molmo2 Human Preference: leaderboard

Metric: Elo rating (bootstrap median, Bradley-Terry; pairwise human preferences on 450 video questions and 51 captioning videos). Source: arxiv.org. Saturation forecast: Around March 2027. 21 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro1096
2Gemini 2.5 Flash1084
3Gemini 3 Pro1082
4GPT-5 Mini1076
5Molmo2-8B1057
6Qwen 3 VL 8B1054
7Qwen 3 VL 4B1048
8GPT-51031
9Claude Sonnet 4.51008
10GLM-4.1V-9B (Thinking)962

Interactive version: theaggregate.ai/benchmark?slug=molmo2-human-preference · How It Works · Data refreshed daily, snapshot 2026-09-25.