RTL-BenchLS - Round-Trip Python: leaderboard

Metric: Functional pass rate (%) on round-trip reasoning on 420 designs (slice 1 of RTL-BenchLS): the model compresses a Verilog design into an intermediate abstract, then regenerates the RTL from its own abstract, the abstract executable Python code; functional pass rate (%; output formally equivalent to the golden design, Cadence Conformal LEC for combinational and JasperGold SEC for sequential designs), temperature 0.2; higher is better. Source: arxiv.org. Saturation forecast: Around 2028. 8 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.552.1
2GPT-4o39.8
3DeepSeek V3.239.5
4Claude Haiku 4.531.4
5GPT-4o Mini25
6Llama 3.3 70B Instruct18.8
7Qwen 3.5 397B A17B0.7

Interactive version: theaggregate.ai/benchmark?slug=rtl-benchls-round-trip-python · How It Works · Data refreshed daily, snapshot 2026-09-29.