GUIDE - Intent Prediction: leaderboard

Metric: Accuracy (%) of choosing the user's intent among four options, 32 frames per screen-recording segment, video only (no narration), offline setting; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.571.39#138
2Gemini 2.5 Pro67.8#145
3Gemini 2.5 Flash65.4#237
4GPT-4o61.19#333
5GPT-4o Mini60.76#588
6InternVL3-8B46.11#606

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=guide-intent-prediction · How It Works · Data refreshed daily, snapshot 2026-10-11.