OpenCoder-1.5B-Instruct: benchmark results
Provider: Infly. Released 2024-11-07. Access: Open.
Aggregate Rating 1266 ± 38, rank #9111 of 10916 rated models, from 15 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| BigCodeBench | 34.9 | Pass@1 (%) | 30.4 |
| FullStackBench (2024-12 bilingual) | 33.52 | Pass@1 (%), 3,374 problems: 1,687 English and 1,687 Chinese; | 19.2 |
| EuroEval Norwegian Knowledge - Idioms NO | -0.22 | MCC (x100) | 15.5 |
| EuroEval Italian NLU - ScaLA IT | 1.07 | Matthews correlation coefficient (%) | 14.9 |
| EuroEval Icelandic Knowledge | 0.45 | Knowledge Average Score (%) | 14.1 |
| EuroEval Norwegian Common Sense Reasoning | 0.35 | Common Sense Reasoning Average Score (%) | 11.9 |
| EuroEval English Knowledge | 2.13 | Knowledge Average Score (%) | 11.5 |
| EuroEval Dutch NLU - DBRD | 25.48 | Matthews correlation coefficient (%) | 10.9 |
| EuroEval Portuguese NLU - ScaLA PT | 0.22 | Matthews correlation coefficient (%) | 10.8 |
| EuroEval Italian NLU - Sentipolc16 | 13.18 | Matthews correlation coefficient (%) | 9.7 |
| EuroEval Portuguese NLU - SST-2 PT | 14.98 | Matthews correlation coefficient (%) | 8.9 |
| EuroEval Norwegian Knowledge - NRK Quiz QA | 0.82 | MCC (x100) | 8.2 |
Interactive version: theaggregate.ai/model?slug=opencoder-1-5b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.