OPT-350M-Erebus: benchmark results
Provider: Mr. Seeker. Access: Open.
Aggregate Rating 1122 ± 17, rank #10484 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Physics | 37.25 | Accuracy (%) | 92.9 |
| MMLU-by-task - High School Statistics | 47.22 | Accuracy (%) | 83.3 |
| MMLU-by-task - High School Physics | 33.11 | Accuracy (%) | 70.8 |
| MMLU-by-task - Moral Scenarios | 27.26 | Accuracy (%) | 59.8 |
| MMLU-by-task - Formal Logic | 31.75 | Accuracy (%) | 56 |
| MMLU-by-task - Professional Medicine | 44.85 | Accuracy (%) | 45.7 |
| MMLU-by-task - TruthfulQA MC2 | 43.58 | Accuracy (%) | 44 |
| MMLU-by-task - College Chemistry | 30 | Accuracy (%) | 40.7 |
| MMLU-by-task - High School Chemistry | 30.05 | Accuracy (%) | 40.5 |
| MMLU-by-task - High School Macroeconomics | 36.67 | Accuracy (%) | 40.5 |
| MMLU-by-task - High School Mathematics | 26.3 | Accuracy (%) | 40 |
| MMLU-by-task - High School Microeconomics | 34.87 | Accuracy (%) | 39.3 |
Interactive version: theaggregate.ai/model?slug=opt-350m-erebus · How It Works · Data refreshed daily, snapshot 2026-11-08.