pythia-6.9B-HC3: benchmark results

Provider: EleutherAI. Access: Open.

Aggregate Rating 1138 ± 16, rank #10166 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Physics36.27Accuracy (%)90.7
MMLU-by-task - High School Physics37.09Accuracy (%)88.1
MMLU-by-task - High School Statistics46.76Accuracy (%)80.4
MMLU-by-task - Moral Scenarios27.26Accuracy (%)59.8
MMLU-by-task - TruthfulQA MC130.35Accuracy (%)59.4
MMLU-by-task - TruthfulQA MC245.05Accuracy (%)51.6
MMLU-by-task - High School Mathematics26.67Accuracy (%)45.9
MMLU-by-task - College Chemistry31Accuracy (%)43.8
MMLU-by-task - College Computer Science35Accuracy (%)42
MMLU-by-task - Formal Logic28.57Accuracy (%)41.7
MMLU-by-task - Professional Medicine42.28Accuracy (%)36.6
MMLU-by-task - Logical Fallacies32.52Accuracy (%)35.4

Interactive version: theaggregate.ai/model?slug=pythia-6-9b-hc3 · How It Works · Data refreshed daily, snapshot 2026-11-08.