HWE-Bench v1.1 (DeepSeek Harness): leaderboard
HWE-Bench v1.1 (November 2026) tests hardware bug-repair agents on 417 simulation-verified RTL tasks from six projects. Updates affect 208 tasks (188 test scripts and 50 statements, with overlap). The evaluator-container limit is normally 1,800 seconds, with seven 4,500-second task exceptions and five RocketChip test scripts limited to 3,600 seconds; original v1.0 results remain separate. This board uses DeepSeek Harness and retains each model’s native reasoning effort. Resolved tasks as a percentage of 417; higher is better.
Metric: Resolved (%). Source: pku-liang.github.io. 1 model tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | DeepSeek V4.1 Flash 1017 | max | 92.6 |
Interactive version: theaggregate.ai/benchmark?slug=hwe-bench-v1-1-deepseek-harness · How It Works · Data refreshed daily, snapshot 2026-11-16.