INTELLECT-1-Instruct: benchmark results

Provider: PrimeIntellect. Released 2024-09-01. Access: Open.

Unified ELO 1322 ± 1, rank #1320 of 1392 rated models, from 12 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ARC Challenge (AI2)54.52Accuracy (%)48.7
GSM8K38.58Accuracy (%)44.1
HellaSwag71.42Accuracy (%)35.5
WinoGrande65.82Accuracy (%)26.2
MMLU49.89Accuracy (%)20
Open LLM Leaderboard - MuSR3.71Score17.8
Open LLM Leaderboard - MATH Level 52.27Score15.4
Big-Bench Hard34.85Average (%)10.4
Open LLM Leaderboard - GPQA0Score2.6
Open LLM Leaderboard - BBH1.75Score1.2
Open LLM Leaderboard - IFEval0Score0.1
Open LLM Leaderboard - MMLU-Pro0.71Score0.1

Interactive version: theaggregate.ai/model?slug=intellect-1-instruct · How It Works · Data refreshed daily, snapshot 2026-09-05.