EgoArgus (Assistance Decision) - Video-Grounded Off-Topic: leaderboard

Metric: Assistance-decision F1 (%; whether help is required, from the egocentric video, dialogue and dialogue timestamp of 789 VISTA episodes, video-grounded off-topic scenario: unrelated dialogue; API models get the full video, open models sampled frames). Source: arxiv.org. Saturation forecast: Around December 2026. 7 models tracked.

Top models

#ModelScore
1Gemini 3.1 Flash Lite74.31
2MiMo-V2-Omni70.46
3Qwen 3.5 Plus (2026-02-15)60.87
4Qwen 3.5 2B8.54
5Molmo2-8B8.54

Interactive version: theaggregate.ai/benchmark?slug=egoargus-assistance-decision-video-grounded-off-topic · How It Works · Data refreshed daily, snapshot 2026-09-26.