Mistral Small 3 2501 — benchmark results

Provider: Mistral. Released 2025-01-30. Access: Open.

Unified ELO 1433 ± 68, rank #1085 of 1839 rated models, from 7 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HELM Safety BBQ93.3BBQ accuracy (%)47.7
HELM Safety XSTest95.3LM Evaluated Safety score (%)40.7
HELM Safety Anthropic Red Team96.4LM Evaluated Safety score (%)15.1
HELM Safety84.7Mean score (self-reported)14.4
HELM Safety SimpleSafetyTests93.2LM Evaluated Safety score (%)14
HELM Safety HarmBench45.2LM Evaluated Safety score (%)5.8
HELM AIR-Bench32.8Refusal Rate (%)4.7

Interactive version: theaggregate.ai/model?slug=mistral-small-3-2501 · How It Works · Data refreshed daily, snapshot 2026-08-05.