TuRTLe Module Completion (NotSoTiny) — leaderboard
TuRTLe module-completion leaderboard on the NotSoTiny benchmark, using formal equivalence and partition coverage over Tiny Tapeout-derived RTL modules.
Metric: Functionality EQV (self-reported). Source: benchmarklist.com. Status: saturation imminent. 15 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 4 31B | 29.54 |
| 2 | GPT-OSS-120B | 20.9 |
| 3 | DeepSeek R1 0528 | 20.73 |
| 4 | Qwen 2.5 72B Instruct | 14.7 |
| 5 | Qwen2.5-14B-Instruct-1M | 12.49 |
| 6 | Qwen 2.5 Coder 32B Instruct | 11.85 |
| 7 | Qwen 2.5 14B Instruct | 8.97 |
| 8 | Qwen 2.5 7B Instruct | 3.48 |
Interactive version: theaggregate.ai/benchmark?slug=turtle-module-completion-notsotiny · How the rankings work · Data refreshed daily, snapshot 2026-07-22.