Devstral Small (May '25): benchmark results
Provider: Mistral. Released 2025-05-21.
Aggregate Rating 1498 ± 42, rank #2393 of 10916 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Tau2-Bench Telecom | 38.01 | Success Rate (%) | 47.3 |
| AA TAU-2 Bench | 38.01 | Accuracy (%) | 46 |
| AA Terminal-Bench Hard | 6.06 | Accuracy (%) | 33.9 |
| AA Long Context Reasoning | 32 | Accuracy (%) | 29.4 |
| AA LiveCodeBench | 25.82 | Pass@1 (%) | 27.2 |
| AA MMLU-Pro | 63.17 | Accuracy (%) | 24.4 |
| AA CritPt | 0 | Accuracy (%) | 20.9 |
| AA GPQA Diamond | 43.43 | Accuracy (%) | 18.9 |
| AA IFBench | 31.63 | Accuracy (%) | 17.4 |
| AA Humanity's Last Exam | 4.03 | Accuracy (%) | 12.2 |
Interactive version: theaggregate.ai/model?slug=devstral-small-may-25 · How It Works · Data refreshed daily, snapshot 2026-11-08.