Claw-Anything - Consistency (Pass^3): leaderboard
Metric: Pass^3 (%): share of tasks solved in all three runs, over the 200 Claw-Anything tasks (simulated months of user activity, interdependent backend services, CLI Linux and GUI Android devices, reactive and proactive tasks), every model in the OpenHarness agent scaffold, three independent runs, rubric checks plus a Claude Sonnet 4.5 judge giving a pass label and a soft score; higher is better. Source: arxiv.org. Saturation forecast: Around February 2028. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.5 | 20 |
| 2 | GLM-5.1 | 17 |
| 3 | Claude Opus 4.7 | 13.5 |
| 4 | Claude Sonnet 4.5 | 12 |
| 5 | Kimi K2.6 | 6.5 |
| 6 | Qwen 3.6 27B | 6 |
| 7 | MiniMax-M2.7 | 3.5 |
| 8 | Qwen 3.5 27B | 2 |
Interactive version: theaggregate.ai/benchmark?slug=claw-anything-consistency-pass-pow-3 · How It Works · Data refreshed daily, snapshot 2026-10-07.