IPIBench - Repeated Proactiveness: leaderboard

Metric: Accuracy (%) on repeated proactiveness (trigger on every recurrence of the event), on IPIBench (1,831 videos, 3,738 interaction instances from egocentric and exocentric datasets) under a unified streaming protocol at 1 FPS (offline models see a sliding window of the latest 16 frames); a proactive response counts only if the first trigger falls within one second of the ground-truth moment, multi-turn tasks only if every required trigger and answer is correct, reactive answers by bidirectional substring matching against up to 20 reference answers; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 12 models tracked.

Top models

#ModelScore
1Gemini 3 Pro18.4
2GPT-4o13.68
3Gemini 2.5 Pro13.21
4GLM-4.6V10.85
5GPT-5.48.96
6Qwen 3.5 Plus7.89
7InternVL3-8B3.77

Interactive version: theaggregate.ai/benchmark?slug=ipibench-repeated-proactiveness · How It Works · Data refreshed daily, snapshot 2026-10-07.