Devstral 2: benchmark results

Provider: Mistral. Released 2025-12-09. Access: Open.

Unified ELO 1575 ± 1, rank #338 of 1392 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AA Omniscience - Software Engineering (SWE) - Kotlin28Accuracy (%)80.5
AA Omniscience - Software Engineering (SWE) - HTML40Accuracy (%)75.9
AA Omniscience - Software Engineering (SWE) - PHP32Accuracy (%)75.9
AA Omniscience - Software Engineering (SWE) - Go24Accuracy (%)74.1
AA Omniscience - Software Engineering (SWE) - Java20Accuracy (%)74.1
AA Omniscience - Software Engineering (SWE) - C44Accuracy (%)73.4
AA Omniscience - Software Engineering (SWE) - Dart24Accuracy (%)72.2
AA Omniscience - Software Engineering (SWE) - JavaScript33.64Accuracy (%)69.1
AA Omniscience - Software Engineering (SWE) - Rust54Accuracy (%)68.9
AA Omniscience - Software Engineering (SWE) - Julia16Accuracy (%)68.8
AA Omniscience - Software Engineering (SWE) - Python22.5Accuracy (%)65.7
AA Omniscience - Software Engineering (SWE) - R12Accuracy (%)62.1

Interactive version: theaggregate.ai/model?slug=devstral-2 · How It Works · Data refreshed daily, snapshot 2026-09-05.