Mistral Nemo: benchmark results
Mistral's 12B Apache-2.0 model built with NVIDIA, with a 128K context, designed as a drop-in upgrade for Mistral 7B. Provider: Mistral. Released 2024-07-18. Access: Open.
Aggregate Rating 1433 ± 11, rank #1085 of 1656 rated models, from 327 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AGC-Bench - puntuguese | 1.32 | Dataset z-score | 97.6 |
| AGC-Bench - hypobench | 0.43 | Dataset z-score | 96.3 |
| AGC-Bench - creatset | 1.3 | Dataset z-score | 86.6 |
| AGC-Bench - c3_crosstalk | 0.89 | Dataset z-score | 79.3 |
| AGC-Bench - humor_transfer | 0.88 | Dataset z-score | 77.2 |
| AGC-Bench - pun_eval | 0.66 | Dataset z-score | 76.8 |
| AGC-Bench - ocw_connections | 0.88 | Dataset z-score | 75.6 |
| AGC-Bench - slang_generation | 0.55 | Dataset z-score | 68.3 |
| AGC-Bench - grapheval_review_advisor | 0.36 | Dataset z-score | 67.1 |
| AGC-Bench - metaphoric_analogies | 0.11 | Dataset z-score | 64.6 |
| AGC-Bench - simile_generation | 0.26 | Dataset z-score | 63.7 |
| MERA - ruDetox | 25.12 | Joint Score (%) | 61.7 |
Interactive version: theaggregate.ai/model?slug=mistral-nemo · How It Works · Data refreshed daily, snapshot 2026-10-20.