Grok 4.1: benchmark results

xAI's Grok 4.1 model with improved conversational and emotional intelligence. Provider: xAI. Released 2025-11-01. Access: API.

Aggregate Rating 1688 ± 10, rank #227 of 1656 rated models, from 175 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
CanMT5.18Mean translation score (1-7) over the 12 CanMT directions (u100
CanMT - Chinese to Russian5.3Translation score (1-7) on the 95 Chinese-to-Russian CanMT s100
CanMT - Chinese to Spanish5.25Translation score (1-7) on the 146 Chinese-to-Spanish CanMT 100
CanMT - English to Japanese5.34Translation score (1-7) on the 103 English-to-Japanese CanMT100
CanMT - Russian to Chinese5Translation score (1-7) on the 125 Russian-to-Chinese CanMT 100
CanMT - Spanish to Chinese5.03Translation score (1-7) on the 166 Spanish-to-Chinese CanMT 100
SciAgentBench - L2 (4 to 7 Steps)43.9Success rate (%, 0-100) on the tasks of difficulty L2 (4 to 100
SciAgentBench - Physics47.2Success rate (%, 0-100) on the 109 physics tasks; with tools100
SnitchBench92.5Govt Contact Rate (%)100
URSA Single-Step Retrosynthesis0.49Average per-target ChemCensor score (0 to 5) over the model'100
SciAgentBench - Materials Science32.4Success rate (%, 0-100) on the 37 materials science tasks; w96.9
Chatbot Arena (Text - Medicine & Healthcare)1500Arena Score95.3

Interactive version: theaggregate.ai/model?slug=grok-4-1 · How It Works · Data refreshed daily, snapshot 2026-10-20.