IPIBench - Proactive Task Management: leaderboard
IPIBench (2026) streams videos to multimodal LLMs at one frame per second and checks whether they respond proactively at the right moment, manage monitoring tasks the user cancels or changes, and handle reactive questions interleaved with proactive tasks. This board is accuracy on the proactive task management tasks (mean of cancellation, modification and multi-task management); percent, higher is better.
Metric: Accuracy (%) on the proactive task management tasks (mean of cancellation, modification and multi-task management), on IPIBench (1,831 videos, 3,738 interaction instances from egocentric and exocentric datasets) under a unified streaming protocol at 1 FPS (offline models see a sliding window of the latest 16 frames); a proactive response counts only if the first trigger falls within one second of the ground-truth moment, multi-turn tasks only if every required trigger and answer is correct, reactive answers by bidirectional substring matching against up to 20 reference answers; higher is better. Source: arxiv.org. Saturation forecast: Around April 2028. 15 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.4 | 23.5 | #135 |
| 2 | Gemini 2.5 Pro | 20.71 | #276 |
| 3 | Gemini 3 Pro | 20.22 | #145 |
| 4 | GPT-4o | 19.21 | #751 |
| 5 | Qwen 3.5 Plus | 18.46 | #242 |
| 6 | GLM-4.6V | 16.38 | #710 |
| 7 | MOSS-VL-Realtime | 11.46 | |
| 8 | Qwen 3.5 9B (Harness: AURA2 IPIBench offline30frames; Thinking: On) | 11.31 | |
| 9 | Qwen 3 VL 8B | 9.35 | #917 |
| 10 | JoyAI-VL-Interaction | 5.99 | |
| 11 | InternVL3-8B | 5.51 | #1782 |
| 12 | VideoLLM-online-8B | 5.39 | |
| 13 | Qwen 3.5 9B (Harness: AURA2 IPIBench offline30frames; Thinking: Off) | 3.32 | |
| 14 | LLaVA-OneVision-7B | 0.96 | #2981 |
| 15 | Flash-VStream-7B | 0.77 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=ipibench-proactive-task-management · How It Works · Data refreshed daily, snapshot 2026-11-21.