Mistral-Nemo-Base-2407 — benchmark results
Provider: Mistral. Released 2024-07-18. Access: Open.
Unified ELO 1385 ± 38, rank #1285 of 1776 rated models, from 22 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| GSM8K | 84.2 | Accuracy (%) | 81.9 |
| PIQA | 83.5 | Accuracy (%) | 81.7 |
| Open PL LLM - Generative | 54.82 | Average Generative Score (%) | 60.1 |
| Open PL LLM Leaderboard | 47.28 | Average Score (%) | 55.9 |
| BoolQ | 82.5 | Accuracy (%) | 55.8 |
| Open PL LLM - RAG | 59.26 | Average RAG Score (%) | 55.6 |
| Greek MMLU - Humanities | 59.45 | Accuracy (%) | 54.3 |
| INCLUDE-base-44 European Languages | 49.55 | Average Accuracy (%) | 52.9 |
| Open LLM Leaderboard - MMLU-Pro | 27.46 | Score | 50.5 |
| Open LLM Leaderboard - BBH | 29.37 | Score | 49.5 |
| Greek MMLU - Greek-Specific | 61.17 | Accuracy (%) | 49.4 |
| Open LLM Leaderboard - GPQA | 5.82 | Score | 48.6 |
Interactive version: theaggregate.ai/model?slug=mistral-nemo-base-2407 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.