Delulu: leaderboard
Metric: pass@1. Source: benchmarklist.com. 11 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 2.5 Coder 32B Instruct | 0.85 |
| 2 | Qwen 2.5 Coder 14B Instruct | 0.82 |
| 3 | CodeLlama-13B-hf | 0.72 |
| 4 | Qwen 2.5 Coder 7B Instruct | 0.71 |
| 5 | CodeLlama-7B-hf | 0.71 |
| 6 | Qwen2.5-Coder-1.5B-Instruct | 0.65 |
| 7 | starcoder2-15B | 0.37 |
| 8 | starcoder2-7B | 0.19 |
Interactive version: theaggregate.ai/benchmark?slug=delulu · How It Works · Data refreshed daily, snapshot 2026-09-19.