Mistral: Mistral Small 3.1 24B — benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1426 ± 23, rank #1103 of 1776 rated models, from 9 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AA-LCR19.7Score (self-reported)38.9
TextClass Benchmark1484.82Meta-Elo (self-reported)35.5
CritPt0Accuracy (self-reported)30.3
Defects4J22.5Defects4J Plausible @1 (self-reported)15.6
Vals AI MATH 50068.4Accuracy (%)9
Vals AI MGSM84.22Accuracy (%)8.2
Creative Writing v3856.2Elo score (self-reported)7.9
EQ-Bench776.7Normalized Elo (self-reported)6.6
Polaris-Bench19.4Overall C (self-reported)0

Interactive version: theaggregate.ai/model?slug=mistral-mistral-small-3-1-24b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.