CLE - Hermes-Agent Trial 1 Level 1: leaderboard
Full Continual Learning Exam: one serial stream of 120 professional tasks, five levels each (600 levels), in fixed order. Trial 1 permits one submission per level; Trial 2 permits one feedback-guided revision. Unreached levels fail. Lk is cumulative clearance through level k. DeepSeek V4 Flash grades the human-authored rubrics. Harness/provider default effort is unspecified. These are the full exam results, not the 20-task CLE Lite release. Harness: Hermes-Agent; trial: t1. Metric: Cumulative pass rate (%).
Metric: Cumulative pass rate (%). Source: haoyu-zhao.github.io. Saturation forecast: Around July 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.8 Max | 70.83 | #32 |
| 2 | GLM-5.3 | 60 | #39 |
| 3 | DeepSeek V4 Pro | 56.67 | #109 |
| 4 | Gemini 3.7 Flash | 55 | #22 |
| 5 | Hy3 | 50.83 | #96 |
No result here: #5 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=cle-hermes-agent-trial-1-level-1 · How It Works · Data refreshed daily, snapshot 2026-10-26.