RealStreamEval - Forward Active Responding: leaderboard
Streaming video question answering under the RealStreamEval protocol (Wen et al., 2026): OVO-Bench clips arrive at 0.5 frames per second and the model must stay silent until the evidence appears, then answer (repetition counting, sequential steps and clue-revealed questions). Scored within timing windows by a Qwen3-VL-235B-A22B-Instruct judge, with a multiplicative penalty for answering too often or too early, in percent; higher is better.
Metric: Score (%; RealStreamEval on OVO-Bench tasks and questions: frames arrive at 0.5 fps and the model decides at every step whether to answer or stay silent; answers judged by Qwen3-VL-235B-A22B-Instruct with timing windows and a verbosity or repetition penalty; 768 visual tokens per frame; mean of the three forward active responding tasks, where the model must wait until the evidence appears: repetition counting, sequential steps and clue-revealed responding). Source: arxiv.org. Saturation forecast: Around June 2027. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2 VL 7B | 12.6 | #2273 |
| 2 | Qwen 2.5 VL 7B | 12.6 | #1796 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=realstreameval-forward-active-responding · How It Works · Data refreshed daily, snapshot 2026-11-12.