StreamPro-Bench: leaderboard
Metric: StreamPro-F1 (%; a response counts only when a Gemini 2.5 Pro judge credits its content and it arrives inside the task time window, and precision and recall over the response trajectory penalize extra and missed responses; videos streamed at 1 FPS; the weighted average (W-Avg.) the paper reports over the three dimensions, 1,285 QA pairs in seven tasks). Source: arxiv.org. Saturation forecast: Around September 2028. 11 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | MiniCPM-o-4.5 | 6.4 |
| 2 | Qwen 3 VL 8B | 3.4 |
| 3 | Qwen 2.5 VL 7B | 1.6 |
Interactive version: theaggregate.ai/benchmark?slug=streampro-bench · How It Works · Data refreshed daily, snapshot 2026-09-26.