STAGE-Claw - First-Pass Rate: leaderboard
Metric: First-pass rate (%): share of tasks scoring above 60 in the first round, 40 automatically built and human-audited personal-agent tasks run in real operating-system environments (calendar, email, reminders, files); the final system state is checked by task-specific verification programs; OpenClaw agent framework, reasoning disabled where the model allows it, temperature 0 where configurable, first valid run per task; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 11 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 4.7 | 80 |
| 2 | Gemini 3.1 Pro (Preview) | 67.5 |
| 3 | Claude Sonnet 4.6 | 65 |
| 4 | GPT-5.5 (Non-reasoning) | 65 |
| 5 | GLM-5 (Non-reasoning) | 60 |
| 6 | DeepSeek V4 Pro (Non-reasoning) | 60 |
| 7 | Qwen 3.5 Plus (Non-reasoning) | 57.5 |
| 8 | Kimi K2.6 (Non-reasoning) | 55 |
| 9 | GPT-5.4 (Non-reasoning) | 52.5 |
| 10 | Seed 2.0 Pro (Non-reasoning) | 50 |
| 11 | MiniMax-M2.7 | 35 |
Interactive version: theaggregate.ai/benchmark?slug=stage-claw-first-pass-rate · How It Works · Data refreshed daily, snapshot 2026-09-29.