GUIDE - Behavior State Detection: leaderboard

Metric: Accuracy (%) of classifying the user's behavior state into one of 9 states from the current segment, 32 frames per screen-recording segment, video only (no narration), offline setting; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.544.61#138
2Gemini 2.5 Pro42.44#145
3Gemini 2.5 Flash36.91#237
4GPT-4o36.32#333
5InternVL3-8B22.57#606
6GPT-4o Mini17.65#588

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=guide-behavior-state-detection · How It Works · Data refreshed daily, snapshot 2026-10-11.