Devstral Small: benchmark results
Provider: Mistral. Released 2025-05-01.
Aggregate Rating 1508 ± 36, rank #2234 of 10916 rated models, from 11 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AI Chess Leaderboard (Continuation) | 487 | Elo | 29.6 |
| Tinybird AI SQL Benchmark - First-Attempt Success Rate | 84 | Questions answered with a valid query on the first attempt ( | 23.5 |
| THOR Finding Triage - Balanced OTS | 47.6 | Class-balanced operational triage score (%) | 18.2 |
| THOR Finding Triage - Critical Miss Rate | 5.5 | True positives suppressed as false positives (%, lower is be | 18.2 |
| Tinybird AI SQL Benchmark - Exactness | 39.58 | Result exactness vs human reference queries (0-100) | 17.7 |
| Tinybird AI SQL Benchmark - Success Rate | 92 | Questions answered with a valid query within 3 retries (%) | 15.8 |
| THOR Finding Triage - CW% | 44.1 | Confidence-weighted classification score (%) | 14.8 |
| Kagi LLM Benchmark | 34.2 | Accuracy (%) | 13.7 |
| AI Chess Leaderboard (Reasoning) | 506 | Elo | 13.5 |
| THOR Finding Triage - False Review Load | 71.1 | False positives not suppressed (%, lower is better) | 11.4 |
| LisanBench | 0 | Mean Path Length / Current Maximum | 5 |
Interactive version: theaggregate.ai/model?slug=devstral-small · How It Works · Data refreshed daily, snapshot 2026-11-08.