airocoder-34B-2.1: benchmark results
Provider: Jon Durbin. Access: Open.
Aggregate Rating 1302 ± 15, rank #8708 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Abstract Algebra | 37 | Accuracy (%) | 94.5 |
| MMLU-by-task - Econometrics | 41.23 | Accuracy (%) | 92.9 |
| MMLU-by-task - High School Computer Science | 64 | Accuracy (%) | 89.6 |
| MMLU-by-task - High School Mathematics | 32.22 | Accuracy (%) | 89.1 |
| MMLU-by-task - Formal Logic | 41.27 | Accuracy (%) | 88.9 |
| MMLU-by-task - Elementary Mathematics | 36.77 | Accuracy (%) | 87.2 |
| MMLU-by-task - Machine Learning | 41.07 | Accuracy (%) | 83.2 |
| MMLU-by-task - Computer Security | 70 | Accuracy (%) | 82.7 |
| MMLU-by-task - High School Physics | 35.1 | Accuracy (%) | 82 |
| MMLU-by-task - International Law | 74.38 | Accuracy (%) | 82 |
| MMLU-by-task - College Physics | 32.35 | Accuracy (%) | 80.6 |
| MMLU-by-task - High School Microeconomics | 56.72 | Accuracy (%) | 76.3 |
Interactive version: theaggregate.ai/model?slug=airocoder-34b-2-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.