OPT-2.7B-Erebus: benchmark results

Provider: Mr. Seeker. Access: Open.

Aggregate Rating 1138 ± 16, rank #10146 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - High School Statistics42.59Accuracy (%)64.7
MMLU-by-task - High School Physics31.79Accuracy (%)61.3
MMLU-by-task - College Physics26.47Accuracy (%)57.9
MMLU-by-task - Econometrics28.07Accuracy (%)47.3
MMLU-by-task - Moral Scenarios25.03Accuracy (%)44.1
MMLU-by-task - High School Chemistry31.03Accuracy (%)43.8
MMLU-by-task - High School Computer Science35Accuracy (%)37.2
MMLU-by-task - High School Macroeconomics35.38Accuracy (%)35.5
MMLU-by-task - Management37.86Accuracy (%)35.3
MMLU-by-task - Professional Medicine41.18Accuracy (%)35
MMLU-by-task - Professional Law28.03Accuracy (%)33.6
MMLU-by-task - College Medicine30.06Accuracy (%)32.7

Interactive version: theaggregate.ai/model?slug=opt-2-7b-erebus · How It Works · Data refreshed daily, snapshot 2026-11-08.