Qwen 2.5 Coder 3B: benchmark results
Provider: Alibaba. Released 2024-11-12. Access: Open.
Unified ELO 1395 ± 1, rank #1301 of 1553 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| GSM8K | 75.7 | Accuracy (%) | 74.2 |
| ARC Challenge (AI2) | 52.9 | Accuracy (%) | 43.4 |
| DomainCodeBench | 87.46 | Composite Score (%) | 33.3 |
| HellaSwag | 70.9 | Accuracy (%) | 32.9 |
| WinoGrande | 67.4 | Accuracy (%) | 31.2 |
| GeoCode Leaderboard | 45.05 | AutoGEEval++ Pass@1 (self-reported) | 27.3 |
| Epoch AI - ECI | 107.45 | ECI Score | 15.5 |
Interactive version: theaggregate.ai/model?slug=qwen-2-5-coder-3b · How It Works · Data refreshed daily, snapshot 2026-09-08.