EgoBench - Dynamic Hard Mode - Micro Accuracy: leaderboard
Egocentric multimodal tool use (EgoBench, Liu et al., 2026): an agent watches a short first-person video and serves a simulated customer in retail, restaurant, food-ordering and kitchen scenarios by calling scenario tools over a database, with thinking disabled, across 1,045 tasks. Here the simulated user reveals the request over several turns but is impatient, adds unrelated chatter to each message and may end the conversation. MicroAcc is the percent of all ground-truth tool calls, pooled over tasks, that the agent issued, with no penalty for extra calls; higher is better.
Metric: MicroAcc (%; share of ground-truth tool calls issued, pooled over tasks, impatient simulated user adding unrelated chatter). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 42.89 | #91 |
| 2 | Qwen 3.5 397B A17B (Non-reasoning) | 36.97 | #242 (Qwen 3.5 397B A17B) |
| 3 | Qwen 3.6 Plus (Non-reasoning) | 32.95 | #217 (Qwen 3.6 Plus) |
| 4 | Kimi K2.5 (Non-reasoning) | 31.01 | #252 (Kimi K2.5) |
| 5 | GLM-5V Turbo | 22.41 | #342 |
| 6 | Qwen 3 VL 235B A22B Instruct | 4.17 | #521 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=egobench-dynamic-hard-mode-micro-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-12.