Devstral Small 2: benchmark results
Mistral's Apache-2.0 24B agentic coding model with a 256K context, strong on SWE-bench Verified for its size (December 2025). Provider: Mistral. Released 2025-12-09. Access: Open.
Aggregate Rating 1584 ± 15, rank #495 of 1656 rated models, from 154 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Enkokilish Bench (English) | 84.85 | Riddles Solved (%) | 100 |
| Konkur 1404 - Art | 55.17 | Accuracy (%, text-only) | 90.9 |
| Konkur 1404 - Humanities | 45.7 | Accuracy (%, text-only) | 90.9 |
| PinchBench - 123 Tasks - OpenClaw 2026.4.29 (a448042) | 73.58 | Best Official Run Score (%) | 88 |
| CringeBench | 0.74 | Cringe Score (0-10, lower is better) | 84.8 |
| UGI Leaderboard | 45.28 | UGI Score | 79.9 |
| Konkur 1404 - Overall | 43.8 | Accuracy (%, text-only) | 77.3 |
| UGI - Willingness (W/10) | 6.8 | W/10 Score | 67.6 |
| Konkur 1404 - Mathematics | 44.35 | Accuracy (%, text-only) | 65.9 |
| ClaimDB: A Fact Verification Benchmark over Large Structured Data | 0.59 | Accuracy | 65.5 |
| AA Omniscience - Software Engineering (SWE) - Kotlin | 20 | Accuracy (%) | 63 |
| Konkur 1404 - Foreign Language | 37.5 | Accuracy (%, text-only) | 61.4 |
Interactive version: theaggregate.ai/model?slug=devstral-small-2 · How It Works · Data refreshed daily, snapshot 2026-10-20.