Voxtral-Small-24B-2507: benchmark results
Provider: Mistral. Released 2025-07-01. Access: Open.
Aggregate Rating 1571 ± 17, rank #1291 of 10870 rated models, from 336 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| BASIS-Bench - ASR Spoken StereoSet Age | 99.5 | 100-WER | 100 |
| SWE-Arena | 1004 | Elo Score | 100 |
| EuroEval Catalan NLU - MultiWikiQA CA | 79.54 | Character F1 (%) | 99.5 |
| EuroEval Slovak NLU | 62.09 | NLU Average Score (%) | 98.5 |
| EuroEval Slovak NLU - UNER SK | 68.31 | Micro F1 excluding MISC (%) | 98.5 |
| EuroEval Estonian NLU - EstNER | 57.89 | Micro F1 excluding MISC (%) | 97.6 |
| EuroEval Ukrainian NLU | 58.95 | NLU Average Score (%) | 97 |
| EuroEval Icelandic Summarization - RRN | 38.88 | chrF3++ (%) | 96.8 |
| EuroEval Spanish NLU - Sentiment Headlines ES | 52.43 | Matthews correlation coefficient (%) | 96.4 |
| EuroEval Spanish NLU | 58.63 | NLU Average Score (%) | 96.2 |
| EuroEval Dutch NLU - CoNLL NL | 74.99 | Micro F1 excluding MISC (%) | 96.1 |
| EuroEval Albanian NLU - MultiWikiQA SQ | 67.29 | Character F1 (%) | 96 |
Interactive version: theaggregate.ai/model?slug=voxtral-small-24b-2507 · How It Works · Data refreshed daily, snapshot 2026-11-12.