Claw-Anything - CLI-Only Tasks: leaderboard

Metric: Pass@1 (%) on the 150 CLI-only tasks, over the 200 Claw-Anything tasks (simulated months of user activity, interdependent backend services, CLI Linux and GUI Android devices, reactive and proactive tasks), every model in the OpenHarness agent scaffold, three independent runs, rubric checks plus a Claude Sonnet 4.5 judge giving a pass label and a soft score; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScore
1GPT-5.540.2
2Claude Opus 4.740
3GLM-5.136.9
4Claude Sonnet 4.535.1
5Kimi K2.627.3
6Qwen 3.6 27B24
7MiniMax-M2.714.2
8Qwen 3.5 27B10

Interactive version: theaggregate.ai/benchmark?slug=claw-anything-cli-only-tasks · How It Works · Data refreshed daily, snapshot 2026-10-07.