Mistral Small (Sep '24): benchmark results

Provider: Mistral. Released 2024-09-17.

Aggregate Rating 1454 ± 28, rank #3615 of 10916 rated models, from 5 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AA Humanity's Last Exam4.25Accuracy (%)16.5
AA MMLU-Pro52.93Accuracy (%)16.4
AA LiveCodeBench14.07Pass@1 (%)14.3
AA GPQA Diamond38.08Accuracy (%)13.6
Conceptual Reasoning Index - Decision Theory (DTBench)15.89Chance-Corrected Score (0-100)8.6

Interactive version: theaggregate.ai/model?slug=mistral-small-sep-24 · How It Works · Data refreshed daily, snapshot 2026-11-08.