OSWorld 2.0 Strict Pass Rate (Mythos 5.1 System Card): leaderboard
OSWorld 2.0 (Yuan et al., 2026): 108 long-horizon computer-use tasks on a live Ubuntu VM, graded against weighted checkpoints. Strict pass rate is the percentage of tasks with every checkpoint satisfied, Pass@1 over five runs at max effort (higher is better). Anthropic's runs from Table 8.1.A of the Claude Fable 5.1 & Claude Mythos 5.1 System Card (September 2026).
Metric: Strict Pass Rate (%). Source: www-cdn.anthropic.com. Saturation forecast: Around 2028. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Fable 5.1 (Max) | 41.7 | #10 (Claude Fable 5.1) |
| 2 | Claude Opus 5 (Max) | 39.6 | #16 (Claude Opus 5) |
| 3 | Claude Fable 5 (Max) | 36.1 | #20 (Claude Fable 5) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=osworld-2-0-strict-pass-rate-mythos-5-1-system-card · How It Works · Data refreshed daily, snapshot 2026-11-05.