Agent2 RL-Bench - HumanEval: leaderboard
Agentic post-training engineering on Agent^2 RL-Bench (2026): a coding agent driven by the model has 12 hours in an isolated GPU workspace to post-train Qwen3-8B-Base, and the grading server keeps the best checkpoint score of the run. HumanEval pass rate of the trained model on held-out problems, in percent; higher is better.
Metric: HumanEval pass rate (%) on the 82 held-out problems of the Qwen3-8B-Base model after the coding agent (driver LLM in a CLI scaffold) post-trains it for 12 hours in an isolated GPU workspace, best score the grading server returned over the run, single run; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 84.15 | #113 |
| 2 | GPT-5.4 | 72.25 | #135 |
| 3 | GPT-5.2 | 69.51 | #185 |
| 4 | Claude Sonnet 4.5 | 65.85 | #261 |
| 5 | GPT-4o | 64.63 | #751 |
| 6 | Gemini 2.5 Flash | 10.98 | #463 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=agent2-rl-bench-humaneval · How It Works · Data refreshed daily, snapshot 2026-11-21.