Video-R1-7B: benchmark results

Video-R1 project’s final 7B video-reasoning checkpoint, released with weights and datasets on March 28, 2025. It follows the distinct February preliminary version and uses temporal GRPO on a Qwen2.5-VL backbone. Provider: Other. Released 2025-03-28. Access: Open.

Aggregate Rating 1525 ± 42, rank #2014 of 10916 rated models, from 30 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SceneBench - Clip QA71.9Accuracy (%) on SceneBench's 368 clip qa items (questions ab88.9
RepProbe Real - Normalized MAE1.35Normalized MAE (lower is better)66.7
RepProbe Synthetic - OBO Few50.9OBO Few (%)66.7
SceneBench54.5Average accuracy (%) over SceneBench's six tasks (title and 66.7
SceneBench - Inverse VQA40.7Accuracy (%) on SceneBench's 485 inverse vqa items (choosing61.1
SceneBench - Title Prediction98.5Accuracy (%) on SceneBench's 345 title prediction items (cho61.1
RepProbe Real - Exact7.2Exact (%)50
RepProbe Real - MAE6.24MAE (lower is better)50
RepProbe Real - OBO19.3OBO (%)50
RepProbe Real - OBO Mid21.4OBO Mid (%)50
RepProbe Synthetic - OBO15.3OBO (%)50
RepProbe Synthetic - OBO Many0OBO Many (%)50

Interactive version: theaggregate.ai/model?slug=video-r1-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.