STAGE-Claw - First-Pass Rate: leaderboard
STAGE-Claw (2026) builds 40 realistic personal-agent tasks automatically and scores an agent in the OpenClaw framework by the verified final state of real calendars, mail, reminders and files rather than by its text reply, with reasoning disabled where a model allows it. This board is the percentage of tasks scoring above 60 in the first round; higher is better.
Metric: First-pass rate (%): share of tasks scoring above 60 in the first round, 40 automatically built and human-audited personal-agent tasks run in real operating-system environments (calendar, email, reminders, files); the final system state is checked by task-specific verification programs; OpenClaw agent framework, reasoning disabled where the model allows it, temperature 0 where configurable, first valid run per task; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.7 | 80 | #79 |
| 2 | Gemini 3.1 Pro (Preview) | 67.5 | #94 |
| 3 | Claude Sonnet 4.6 | 65 | #161 |
| 4 | GPT-5.5 (Non-reasoning) | 65 | #49 (GPT-5.5) |
| 5 | GLM-5 (Non-reasoning) | 60 | #260 (GLM-5) |
| 6 | DeepSeek V4 Pro (Non-reasoning) | 60 | #188 (DeepSeek V4 Pro) |
| 7 | Kimi K2.6 (Non-reasoning) | 55 | #178 (Kimi K2.6) |
| 8 | GPT-5.4 (Non-reasoning) | 52.5 | #123 (GPT-5.4) |
| 9 | MiniMax-M2.7 | 35 | #518 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=stage-claw-first-pass-rate · How It Works · Data refreshed daily, snapshot 2026-11-13.