RepProbe Synthetic - Normalized MAE: leaderboard
RepProbe Synthetic - Normalized MAE. Generalist video-language models; counts 1–20, predictions clipped 0–40; Few 1–6, Mid 7–13, Many 14–20. Reported metric: Normalized MAE (lower is better). Primary published table, with source configuration boundaries preserved.
Metric: Normalized MAE (lower is better). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen3-VL-8B | 0.69 | |
| 2 | InternVL3.5-8B | 0.7 | |
| 3 | Cosmos-Reason2-8B | 0.71 | |
| 4 | VideoChat-R1.5-7B | 0.72 | |
| 5 | Video-R1-7B | 0.73 | |
| 6 | LongVILA-R1-7B | 0.77 | |
| 7 | LLaVA-OneVision-7B | 0.87 |
Interactive version: theaggregate.ai/benchmark?slug=repprobe-synthetic-normalized-mae · How It Works · Data refreshed daily, snapshot 2026-10-16.