oasst-pythia-12B-reference: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1153 ± 16, rank #9916 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Physics | 30.39 | Accuracy (%) | 74.7 |
| MMLU-by-task - High School Physics | 32.45 | Accuracy (%) | 66 |
| MMLU-by-task - Professional Medicine | 46.32 | Accuracy (%) | 50.6 |
| MMLU-by-task - College Chemistry | 30 | Accuracy (%) | 40.7 |
| MMLU-by-task - Abstract Algebra | 28 | Accuracy (%) | 39.6 |
| MMLU-by-task - Elementary Mathematics | 26.98 | Accuracy (%) | 39.2 |
| MMLU-by-task - Professional Accounting | 29.43 | Accuracy (%) | 37.6 |
| MMLU-by-task - High School Statistics | 32.87 | Accuracy (%) | 37.3 |
| MMLU-by-task - Security Studies | 37.55 | Accuracy (%) | 35.4 |
| MMLU-by-task - Business Ethics | 36 | Accuracy (%) | 35.2 |
| MMLU-by-task - ARC Challenge | 40.44 | Accuracy (%) | 34.5 |
| MMLU-by-task - Clinical Knowledge | 33.21 | Accuracy (%) | 34.4 |
Interactive version: theaggregate.ai/model?slug=oasst-pythia-12b-reference · How It Works · Data refreshed daily, snapshot 2026-11-08.