Devstral Small 2 — benchmark results
Mistral's Apache-2.0 24B agentic coding model with a 256K context, strong on SWE-bench Verified for its size (December 2025). Provider: Mistral. Released 2025-12-09. Access: Open.
Unified ELO 1533 ± 14, rank #672 of 1776 rated models, from 100 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Konkur 1404 - Art | 55.17 | Accuracy (%, text-only) | 94.7 |
| Konkur 1404 - Humanities | 45.7 | Accuracy (%, text-only) | 89.5 |
| YapBench | 449 | YapIndex (lower is better) | 85.4 |
| Konkur 1404 - Overall | 43.8 | Accuracy (%, text-only) | 84.2 |
| UGI Leaderboard | 45.28 | UGI Score | 81.3 |
| Konkur 1404 - Mathematics | 44.35 | Accuracy (%, text-only) | 76.3 |
| Konkur 1404 - Experimental Sciences | 39.13 | Accuracy (%, text-only) | 68.4 |
| UGI - Willingness (W/10) | 6.8 | W/10 Score | 66.6 |
| Konkur 1404 - Foreign Language | 37.5 | Accuracy (%, text-only) | 65.8 |
| AI Chess Leaderboard (Continuation) | 602 | Elo | 54.5 |
| AA Terminal-Bench Hard | 16.67 | Accuracy (%) | 54.2 |
| Artificial Analysis Intelligence Index | 17.44 | Intelligence Index | 53.9 |
Interactive version: theaggregate.ai/model?slug=devstral-small-2 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.