stablelm-2-12B-chat — benchmark results
Stability AI's 12B instruction-tuned chat model (April 2024), trained on 2T tokens in seven languages; free for non-commercial use, commercial via membership. Provider: Stability AI. Released 2024-04-04. Access: Open.
Unified ELO 1417 ± 33, rank #1144 of 1776 rated models, from 12 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| RewardBench Chat | 96.65 | Accuracy (%) | 77.8 |
| RewardBench | 76.42 | Score (%) | 71.6 |
| RewardBench Reasoning | 89.45 | Accuracy (%) | 70.4 |
| Open LLM Leaderboard - IFEval | 40.82 | Score | 41.2 |
| RewardBench Safety | 78.11 | Accuracy (%) | 39.7 |
| Open LLM Leaderboard - BBH | 25.25 | Score | 38.6 |
| Open LLM Leaderboard - MuSR | 7.73 | Score | 36 |
| RewardBench Chat Hard | 55.48 | Accuracy (%) | 34.7 |
| Open LLM Leaderboard - MATH Level 5 | 5.36 | Score | 29.8 |
| Open LLM Leaderboard - MMLU-Pro | 19.27 | Score | 29.5 |
| Open LLM Leaderboard - GPQA | 2.24 | Score | 21.2 |
| RewardBench Prior Sets (0.5 weight) | 48.39 | Score (%) | 17.3 |
Interactive version: theaggregate.ai/model?slug=stablelm-2-12b-chat · How the rankings work · Data refreshed daily, snapshot 2026-07-22.