starcoder_mirror: benchmark results
Provider: BigCode.
Aggregate Rating 1162 ± 15, rank #9816 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Mathematics | 36 | Accuracy (%) | 80.2 |
| MMLU-by-task - Machine Learning | 33.04 | Accuracy (%) | 53.4 |
| MMLU-by-task - High School Physics | 30.46 | Accuracy (%) | 50.8 |
| MMLU-by-task - TruthfulQA MC1 | 28.03 | Accuracy (%) | 48.9 |
| MMLU-by-task - Electrical Engineering | 42.07 | Accuracy (%) | 47.6 |
| MMLU-by-task - High School Computer Science | 41 | Accuracy (%) | 46.2 |
| MMLU-by-task - Elementary Mathematics | 27.51 | Accuracy (%) | 43.5 |
| MMLU-by-task - TruthfulQA MC2 | 43.38 | Accuracy (%) | 42.6 |
| MMLU-by-task - Formal Logic | 28.57 | Accuracy (%) | 41.7 |
| MMLU-by-task - Computer Security | 45 | Accuracy (%) | 37.5 |
| MMLU-by-task - Professional Law | 29.47 | Accuracy (%) | 36.4 |
| MMLU-by-task - Philosophy | 35.05 | Accuracy (%) | 35.2 |
Interactive version: theaggregate.ai/model?slug=starcoder-mirror · How It Works · Data refreshed daily, snapshot 2026-11-08.