RepProbe Real - Normalized MAE: leaderboard
RepProbe Real - Normalized MAE. Generalist video-language models; counts 1–20, predictions clipped 0–40; Few 1–6, Mid 7–13, Many 14–20. Reported metric: Normalized MAE (lower is better). Primary published table, with source configuration boundaries preserved.
Metric: Normalized MAE (lower is better). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Cosmos-Reason2-8B | 0.43 | |
| 2 | Qwen3-VL-8B | 0.68 | |
| 3 | Video-R1-7B | 1.35 | |
| 4 | VideoChat-R1.5-7B | 1.4 | |
| 5 | LongVILA-R1-7B | 1.47 | |
| 6 | InternVL3.5-8B | 1.51 | |
| 7 | LLaVA-OneVision-7B | 2.19 |
Interactive version: theaggregate.ai/benchmark?slug=repprobe-real-normalized-mae · How It Works · Data refreshed daily, snapshot 2026-10-16.