Mistral-Small-3.1-24B-Base-2503: benchmark results
Provider: Mistral. Released 2025-03-17. Access: Open.
Aggregate Rating 1609 ± 29, rank #931 of 10916 rated models, from 264 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Slovak NLU - Multi Wiki QA SK | 75.52 | Character F1 (%) | 100 |
| EuroEval German NLU | 64.91 | NLU Average Score (%) | 99.7 |
| EuroEval Polish NLU | 67.89 | NLU Average Score (%) | 99.6 |
| EuroEval German Summarization - Mlsum DE | 41.16 | chrF3++ (%) | 99.3 |
| EuroEval Greek Summarization - Greek Wikipedia | 35.2 | chrF3++ (%) | 99.3 |
| EuroEval Icelandic NLU - NQII | 64.34 | Character F1 (%) | 99.2 |
| EuroEval Polish NLU - PoQuAD | 66.94 | Character F1 (%) | 99.1 |
| EuroEval Slovene NLU - MultiWikiQA SL | 74.96 | Character F1 (%) | 99 |
| EuroEval Ukrainian NLU - MultiWikiQA UK | 70.38 | Character F1 (%) | 99 |
| EuroEval Portuguese NLU | 70.3 | NLU Average Score (%) | 98.8 |
| EuroEval Lithuanian NLU - MultiWikiQA LT | 75.22 | Character F1 (%) | 98.7 |
| EuroEval Greek NLU - Greek SA | 83.42 | Matthews correlation coefficient (%) | 98.5 |
Interactive version: theaggregate.ai/model?slug=mistral-small-3-1-24b-base-2503 · How It Works · Data refreshed daily, snapshot 2026-11-08.