Grok 4: benchmark results

xAI's flagship Grok 4 reasoning model with native tool use. Provider: xAI. Released 2025-07-09. Access: API.

Aggregate Rating 1707 ± 4, rank #181 of 1656 rated models, from 1675 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ACE-Bench (Azure SDK, MCP Documentation)68.7Strict pass rate (%) on ACE-Bench (353 Azure SDK coding task100
AIME 202494Score (percentage)100
AJ-Bench (LLM-as-a-Judge) - FileSystem75.7F1 (%) on FileSystem data-system tasks (MCPMark; 24 tasks, 1100
AgenticRAGTracer (Comparison) - 2-Hop80.7Exact match (%) on AgenticRAGTracer's 2-hop parallel compari100
Balrog43.6Score (imported)100
CommunityBench - Preference Distribution Kendall Tau0.17Kendall's Tau (-1 to 1)100
Condesion-Bench (April-September 2025 Subset)89.68Decision Satisfaction Rate (%, from a 0-1 share times 100) o100
Condesion-Bench (April-September 2025 Subset) - Condition Satisfaction Rate96.56Condition Satisfaction Rate (%, from a 0-1 share times 100) 100
DV-World - DV-Evol Vega-Lite50.68Overall score (%) on the Vega-Lite DV-Evol tasks (adapt a re100
DV-World - DV-Inter40.43DV-Inter score (%): per-task MLLM rubric score (interaction,100
DV-World - DV-Inter Interaction Success79.57Interaction success rate (%): 0.5 + 0.5 x (resolved turns mi100
FLY-EVAL++ - Single-Step Prediction - Field Validity68S1 D2 field score (%)100

Interactive version: theaggregate.ai/model?slug=grok-4 · How It Works · Data refreshed daily, snapshot 2026-10-20.