TuRTLe Module Completion (NotSoTiny): leaderboard

TuRTLe module-completion leaderboard on the NotSoTiny benchmark, using formal equivalence and partition coverage over Tiny Tapeout-derived RTL modules.

Metric: Functionality EQV (self-reported). Source: benchmarklist.com. Status: saturation imminent. 15 models tracked.

Top models

#ModelScore
1Kimi K2.531.57
2Gemma 4 31B (IT)29.54
3Qwen 3 Coder 480B A35B Instruct23.43
4GPT-OSS-120B20.9
5DeepSeek R1 052820.73
6Kimi K2 090519
7Qwen 2.5 72B Instruct14.7
8Qwen2.5-14B-Instruct-1M12.49
9Qwen 2.5 Coder 32B Instruct11.85
10Qwen 2.5 14B Instruct8.97
11Qwen 2.5 7B Instruct3.48

Interactive version: theaggregate.ai/benchmark?slug=turtle-module-completion-notsotiny · How It Works · Data refreshed daily, snapshot 2026-09-05.