EgoArgus (Assistance Decision) - Contradictory: leaderboard

Metric: Assistance-decision F1 (%; whether help is required, from the egocentric video, dialogue and dialogue timestamp of 789 VISTA episodes, contradictory scenario: the dialogue points to a wrong judgment the video refutes; API models get the full video, open models sampled frames). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.

Top models

#ModelScore
1Qwen 3.5 Plus (2026-02-15)91.01
2Gemini 3.1 Flash Lite90.42
3MiMo-V2-Omni86.81
4Molmo2-8B86.03
5Qwen 3.5 2B15.09

Interactive version: theaggregate.ai/benchmark?slug=egoargus-assistance-decision-contradictory · How It Works · Data refreshed daily, snapshot 2026-09-26.