AssertLLM2 - Formal Coverage: leaderboard

Formal RTL coverage (%) reached by the proven generated assertions on AssertLLM2 (2026), where LLMs write SystemVerilog assertions from the specifications of 83 real-world hardware designs, checked by formal property verification; mean of three generations per design. Higher is better.

Metric: Formal RTL coverage (%) reached by the proven assertions, SystemVerilog assertions generated from the structured specification of each of 83 AssertLLM2 designs and checked in Cadence JasperGold, mean of three independent generations per design (the paper's default average setting); higher is better. Source: arxiv.org. Saturation forecast: Around July 2027. 6 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.522.38#261
2GPT-5.221.18#185
3Gemini 2.5 Pro19.16#276
4DeepSeek V3.215.73#419
5Qwen 3 Coder Plus12.07#720
6Llama 4 Maverick8.46#1110

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=assertllm2-formal-coverage · How It Works · Data refreshed daily, snapshot 2026-11-21.