HSE SWE-bench Verified - Target Adaptation Pi: leaderboard
HSE v1 reports resolved rates on 500 SWE-bench Verified tasks and 113 DeepSWE tasks, using 3 runs. The default model is GLM-5.2 in the Pi or Claude Code harness. Its static library of 10 skills is evolved on SWE-Gym, with 8 success skills and 2 recovery skills. Gates 1–8 explicitly adapt to the target benchmark and remain distinct from frozen transfer. Cross-model GPT 5.5 and Opus 4.8 evaluations use Pi only. Model, harness, skill library, training scope, and gate identities are preserved. Metric: Resolved rate (%).
Metric: Resolved rate (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate8 | 90.1 | |
| 2 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate7 | 89.4 | |
| 3 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate6 | 88.7 | |
| 4 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate5 | 87.6 | |
| 5 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate4 | 86.3 | |
| 6 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate3 | 86.1 | |
| 7 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate2 | 85.1 | |
| 8 | HSE GLM-5.2 Pi SWE-bench Verified adapted Gate1 | 81.1 |
Interactive version: theaggregate.ai/benchmark?slug=hse-swe-bench-verified-target-adaptation-pi · How It Works · Data refreshed daily, snapshot 2026-10-28.