megatron-gpt2-345m: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1121 ± 16, rank #10508 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Machine Learning36.61Accuracy (%)68
MMLU-by-task - High School Mathematics26.67Accuracy (%)45.9
MMLU-by-task - High School Statistics34.72Accuracy (%)41.1
MMLU-by-task - Professional Medicine43.38Accuracy (%)38.7
MMLU-by-task - TruthfulQA MC241.51Accuracy (%)33.8
MMLU-by-task - High School Chemistry28.57Accuracy (%)33.2
MMLU-by-task - Econometrics26.32Accuracy (%)32.9
MMLU-by-task - World Religions33.33Accuracy (%)31.6
MMLU-by-task - Business Ethics31Accuracy (%)29.3
MMLU-by-task - Computer Security32Accuracy (%)29.1
MMLU-by-task - Moral Scenarios24.25Accuracy (%)25.7
MMLU-by-task - Medical Genetics30Accuracy (%)25.6

Interactive version: theaggregate.ai/model?slug=megatron-gpt2-345m · How It Works · Data refreshed daily, snapshot 2026-11-08.