MacAgentBench (OpenClaw) - Productivity: leaderboard

Metric: Pass@1 (%; share of the 224 Productivity tasks solved on a single attempt, deterministic rule-based checks; the OpenClaw in-container agent harness with shell, AppleScript and its skill library, at most 50 steps). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.

Top models

#ModelScore
1Claude Opus 4.6 (OpenClaw)70.1
2Gemini 3.1 Pro (OpenClaw)62.9
3GPT-5.4 (OpenClaw)61.6
4Qwen3-VL-235B-A22B (OpenClaw)42.9
5Qwen3-VL-32B-Thinking (OpenClaw)29.5
6Qwen3-VL-8B-Thinking (OpenClaw)22.3
7InternVL3.5-14B (OpenClaw)0
8InternVL3.5-8B (OpenClaw)0

Interactive version: theaggregate.ai/benchmark?slug=macagentbench-openclaw-productivity · How It Works · Data refreshed daily, snapshot 2026-09-26.