Agents' Last Exam v1.1 - OpenClaw CLI Pass Rate: leaderboard
ALE v1.1 evaluates agents on 122 long-horizon professional tasks in the OpenClaw CLI harness. Pass rate is the percentage of perfect-score runs across all 122 tasks, including failed or missing runs as zero; timed-out runs retain their graded scores. Higher is better. Exact model and effort settings stay separate from other harnesses and legacy ALE v1.
Metric: Pass Rate (%). Source: agents-last-exam.org. Saturation forecast: Rough model projection: around 2026. 2 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | deepseek-deepseek-v4-1-flash-1017 (ALE Run: harness=OpenClaw%20CLI; effort=high; source-model=deepseek-deepseek-v4-1-flash-1017) | 36.07 | |
| 2 | deepseek-deepseek-v4-1-flash-1017 (ALE Run: harness=OpenClaw%20CLI; effort=max; source-model=deepseek-deepseek-v4-1-flash-1017) | 35.25 |
Interactive version: theaggregate.ai/benchmark?slug=agents-last-exam-v1-1-openclaw-cli-pass-rate · How It Works · Data refreshed daily, snapshot 2026-11-05.