StreamPro-Bench - Proactive Agency: leaderboard

Metric: StreamPro-F1 (%; a response counts only when a Gemini 2.5 Pro judge credits its content and it arrives inside the task time window, and precision and recall over the response trajectory penalize extra and missed responses; videos streamed at 1 FPS; goal planning and risk forecasting, weighted as in the paper). Source: arxiv.org. Saturation forecast: Around 2029. 11 models tracked.

Top models

#ModelScore
1MiniCPM-o-4.53.8
2Qwen 3 VL 8B2.6
3Qwen 2.5 VL 7B0.9

Interactive version: theaggregate.ai/benchmark?slug=streampro-bench-proactive-agency · How It Works · Data refreshed daily, snapshot 2026-09-26.