Grok 3: benchmark results

xAI's Grok 3 flagship model for reasoning and general tasks (February 2025). Provider: xAI. Released 2025-02-17. Access: API.

Aggregate Rating 1653 ± 6, rank #304 of 1656 rated models, from 982 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
IndicSafe83.67SAFE rate (%): share of the model's responses to the 6,000 I100
IndicSafe - Unsafe Rate0.98UNSAFE rate (%): share of the model's responses to the 6,000100
LLM Emergent Collusion19Collusion Rate (%)100
SRBench - Yelp (NDCG@5)0.05NDCG@5 (0-1) of the held-out next item among five recommenda100
SRBench - Yelp (Recall@5)0.07Recall@5 (fraction) of the held-out next item among five rec100
TaxPraBen - TaxCalc19Exact-match accuracy (%) on TaxCalc (tax payment calculation100
Nejumi 4 - BFCL - Non-Live AST85.93Accuracy (%)99.3
UGI Leaderboard63.47UGI Score99.3
SpeechMap Compliance96.1% Requests Completed98
ProLLM - Entity Extraction85.5Score (%)97.9
EuroEval Swedish NLU - ScaLA SV71.91Matthews correlation coefficient (%)97.3
EuroEval Icelandic NLU - Hotter and Colder Sentiment58.9Matthews correlation coefficient (%)97.2

Interactive version: theaggregate.ai/model?slug=grok-3 · How It Works · Data refreshed daily, snapshot 2026-10-20.