OmniPro (Online): leaderboard
Metric: Online-mode F1 (%): a streaming model sees the instruction at the start and decides itself when to respond; responses within 3 s of a ground-truth trigger and correct in content (exact match, or a Gemini-3-Flash rating of at least 3 of 5 for narration and step instruction) are matches; F1 of response precision and trigger recall, mean of the nine sub-tasks of OmniPro (2,700 human-verified proactive streaming questions on LongVALE and COIN videos, 84% needing audio; 1 fps input); higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | MiniCPM-o 4.5 | 20.9 |
| 2 | MMDuet2 | 11.3 |
| 3 | LiveStar | 3.6 |
Interactive version: theaggregate.ai/benchmark?slug=omnipro-online · How It Works · Data refreshed daily, snapshot 2026-10-07.