pile-7B-250B-tokens: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1131 ± 15, rank #10310 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Mathematics34Accuracy (%)69.2
MMLU-by-task - High School Mathematics28.15Accuracy (%)61.8
MMLU-by-task - College Computer Science38Accuracy (%)48.8
MMLU-by-task - College Chemistry30Accuracy (%)40.7
MMLU-by-task - High School Physics27.81Accuracy (%)35
MMLU-by-task - Virology33.13Accuracy (%)33.6
MMLU-by-task - Moral Scenarios24.36Accuracy (%)32.6
MMLU-by-task - Professional Psychology27.78Accuracy (%)30
MMLU-by-task - TruthfulQA MC240.49Accuracy (%)29.3
MMLU-by-task - High School US History26.96Accuracy (%)26.7
MMLU-by-task - Logical Fallacies28.22Accuracy (%)26.5
MMLU-by-task - Philosophy28.94Accuracy (%)26.4

Interactive version: theaggregate.ai/model?slug=pile-7b-250b-tokens · How It Works · Data refreshed daily, snapshot 2026-11-08.