SkillEvolBench (SelfGen-Zero-Shot) - Deployment Success: leaderboard
Skill reuse by coding agents on SkillEvolBench (Lei et al., 2026): 180 verifier-scored tasks in six environments such as code repair, API orchestration and document transformation, each model running in its vendor agent harness (Claude Code, Codex CLI or Gemini CLI). The agent uses skills it wrote from task metadata alone before any attempt, never revised. After the acquisition tasks the library is frozen, and the board scores the 90 deployment tasks, which embed a procedure in a broader request, add shortcut traps or require composing skills; success rate in percent, higher is better.
Metric: Frozen deployment success rate (%; ESR, share of the 90 context-shift, adversarial and composition tasks, 30 of each, solved with the environment's frozen skill library; fixed skills the model generates from task metadata before any attempt; verifier-scored). Source: arxiv.org. Saturation forecast: Around March 2027. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash | 40 | #159 |
| 2 | Gemini 3.1 Pro (Preview) | 36.7 | #91 |
| 3 | Claude Sonnet 4.6 | 36.7 | #158 |
| 4 | Claude Opus 4.5 | 34.4 | #152 |
| 5 | GPT-5.3 Codex | 34.4 | #114 |
| 6 | GPT-5.4 | 33.3 | #121 |
| 7 | Claude Opus 4.6 | 32.2 | #100 |
| 8 | GPT-5.2 Codex | 30 | #185 |
| 9 | Claude Sonnet 4.5 | 27.8 | #244 |
| 10 | Gemini 2.5 Pro | 15.6 | #262 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=skillevolbench-selfgen-zero-shot-deployment-success · How It Works · Data refreshed daily, snapshot 2026-11-12.