Grok 2 Mini: benchmark results

Provider: xAI. Released 2024-08-13. Access: API.

Aggregate Rating 1527 ± 22, rank #1987 of 10916 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LLM Stats (MathVista)68.1Score (%)53.9
LLM Stats (DocVQA)93.2Score (%)51.8
Aider Code Editing Leaderboard54.9Exercises completed correctly after one retry, pass_rate_2 (45.2
BenchTable - Reasoning35.3Weighted Score (%)43
BenchTable - Tech48.1Weighted Score (%)41.6
BenchTable42.6Total Score (%)40.7
BenchTable - STEM35.7Weighted Score (%)31.7
Arcee MMLU-Pro (BenchLM)72Accuracy (%)28.4
BenchTable - Utility38.4Weighted Score (%)28.3
LLM Stats Score8.14LLM Stats Score (conservative rating)23.2
ZeroEval GPQA Diamond51GPQA Diamond Score23.2

Interactive version: theaggregate.ai/model?slug=grok-2-mini · How It Works · Data refreshed daily, snapshot 2026-11-08.