KnowU-Bench - Proactive (Easy): leaderboard

Proactive mobile assistance on KnowU-Bench (2026), easy split: 32 situations with no instruction, where the agent must decide from the user logs and current context whether to act, ask the simulated user for consent or stay silent, and must respect a rejection. Success rate in percent; higher is better.

Metric: Success rate (%) on the 32 easy proactive tasks (no instruction: act, ask for consent or stay silent, and respect a rejection) in the reproducible KnowU-Bench Android emulator, noisy full-history memory setting (the complete user logs plus irrelevant history), gpt-4o as the user simulator grounded in a hidden user profile, scored by rule-based checks fused with a rubric-conditioned LLM judge; higher is better. Source: arxiv.org. Saturation forecast: Around June 2027. 11 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.684.4#173
2Qwen 3.5 397B A17B68.8#264
3Qwen 3.5 9B65.6#828
4Seed 2.0 Pro62.5#222
5Gemini 3.1 Pro (Preview)50#99
6Qwen 3 VL 32B50#622
7Qwen 3 VL 8B46.9#917
8UI-Venus-1.5-8B34.4
9GUI-OWL-1.5-8B28.1
10Qwen 3.5 122B A10B25#346
11MAI-UI-8B17.9

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=knowu-bench-proactive-easy · How It Works · Data refreshed daily, snapshot 2026-11-21.