xglm-1.7B: benchmark results

Meta's XGLM 1.7B, a multilingual autoregressive language model trained on 500 billion sub-tokens across a balanced set of languages. Provider: Meta. Released 2021-12-29. Access: Open.

Aggregate Rating 1126 ± 13, rank #1622 of 1640 rated models, from 79 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - High School Statistics47.69Accuracy (%)86
MMLU-by-task - High School Mathematics30Accuracy (%)76.1
MMLU-by-task - Abstract Algebra30Accuracy (%)52.2
MMLU-by-task - Professional Medicine45.22Accuracy (%)48.2
MMLU-by-task - High School Chemistry31.03Accuracy (%)43.8
MMLU-by-task - College Physics23.53Accuracy (%)41.6
MMLU-by-task - High School Computer Science33Accuracy (%)33.8
MMLU-by-task - Prehistory32.1Accuracy (%)33.4
MMLU-by-task - Anatomy32.59Accuracy (%)30.4
MMLU-by-task - US Foreign Policy33Accuracy (%)30.4
MMLU-by-task - Econometrics25.44Accuracy (%)26.9
MMLU-by-task - High School Biology28.39Accuracy (%)26.5

Interactive version: theaggregate.ai/model?slug=xglm-1-7b · How It Works · Data refreshed daily, snapshot 2026-11-07.