AssertLLM2 - Bug Kill Ratio: leaderboard
Metric: Bug kill ratio (%): share of mutated buggy RTL variants (20 single-bug variants per design, or 5 bugs in a merged bug-hunting variant) on which a proven assertion fails, SystemVerilog assertions generated from the structured specification of each of 83 AssertLLM2 designs and checked in Cadence JasperGold, mean of three independent generations per design (the paper's default average setting); higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.5 | 11.69 |
| 2 | GPT-5.2 | 10.19 |
| 3 | Gemini 2.5 Pro | 9.76 |
| 4 | DeepSeek V3.2 | 9.2 |
| 5 | Qwen 3 Coder Plus | 6.82 |
| 6 | Llama 4 Maverick | 5.08 |
Interactive version: theaggregate.ai/benchmark?slug=assertllm2-bug-kill-ratio · How It Works · Data refreshed daily, snapshot 2026-10-07.