StreamPro-Bench - Proactive Agency: leaderboard
The proactive agency dimension of StreamPro-Bench (Li et al., 2026): goal planning that gives the next step once the previous one is done and risk forecasting for visually impaired pedestrians, weighted over the two tasks, on videos streamed at 1 FPS. StreamPro-F1 in percent, which credits a response only when it arrives inside the task time window and a Gemini 2.5 Pro judge accepts its content, with precision and recall penalizing extra and missed responses; higher is better.
Metric: StreamPro-F1 (%; a response counts only when a Gemini 2.5 Pro judge credits its content and it arrives inside the task time window, and precision and recall over the response trajectory penalize extra and missed responses; videos streamed at 1 FPS; goal planning and risk forecasting, weighted as in the paper). Source: arxiv.org. Saturation forecast: Around 2029. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2.5 VL 7B | 0.9 | #1796 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=streampro-bench-proactive-agency · How It Works · Data refreshed daily, snapshot 2026-11-12.