pythia-160m-deduped-step92k-193bt: benchmark results

Provider: EleutherAI. Access: Open.

Aggregate Rating 1123 ± 17, rank #10462 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - High School Mathematics28.89Accuracy (%)67.8
MMLU-by-task - College Physics27.45Accuracy (%)63
MMLU-by-task - Machine Learning34.82Accuracy (%)60.8
MMLU-by-task - High School Statistics41.2Accuracy (%)58.8
MMLU-by-task - Econometrics28.07Accuracy (%)47.3
MMLU-by-task - TruthfulQA MC243.49Accuracy (%)43.8
MMLU-by-task - Professional Medicine44.49Accuracy (%)42.8
MMLU-by-task - Medical Genetics31Accuracy (%)29.8
MMLU-by-task - Human Aging34.98Accuracy (%)29.3
MMLU-by-task - US Foreign Policy30Accuracy (%)27
MMLU-by-task - TruthfulQA MC124.36Accuracy (%)26.8
MMLU-by-task - High School US History26.96Accuracy (%)26.7

Interactive version: theaggregate.ai/model?slug=pythia-160m-deduped-step92k-193bt · How It Works · Data refreshed daily, snapshot 2026-11-08.