AssertLLM2 - Formal Coverage: leaderboard
Formal RTL coverage (%) reached by the proven generated assertions on AssertLLM2 (2026), where LLMs write SystemVerilog assertions from the specifications of 83 real-world hardware designs, checked by formal property verification; mean of three generations per design. Higher is better.
Metric: Formal RTL coverage (%) reached by the proven assertions, SystemVerilog assertions generated from the structured specification of each of 83 AssertLLM2 designs and checked in Cadence JasperGold, mean of three independent generations per design (the paper's default average setting); higher is better. Source: arxiv.org. Saturation forecast: Around July 2027. 6 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 22.38 | #261 |
| 2 | GPT-5.2 | 21.18 | #185 |
| 3 | Gemini 2.5 Pro | 19.16 | #276 |
| 4 | DeepSeek V3.2 | 15.73 | #419 |
| 5 | Qwen 3 Coder Plus | 12.07 | #720 |
| 6 | Llama 4 Maverick | 8.46 | #1110 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=assertllm2-formal-coverage · How It Works · Data refreshed daily, snapshot 2026-11-21.