Mistral Nemo 12B: benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1359 ± 28, rank #1357 of 1645 rated models, from 25 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Klu LLM Leaderboard79Klu Index47.5
GSMA Open-Telco - 3GPP39.55Score (%)42.7
GSMA Open-Telco - TeleLogs14.2Score (%)29.2
GSMA Open-Telco - TeleTables27.8Score (%)28.1
BALSAM - Reading Comprehension42.83Overall score (0-100, LLM-judged generation and multiple cho22.6
GSMA Open-Telco LLM Leaderboard41.77Average Score (%)22.5
GSMA Open-Telco - ORAN-Bench66.11Score (%)19.1
GSMA Open-Telco - TeleQnA64.22Score (%)15.7
ClaimDB: A Fact Verification Benchmark over Large Structured Data0.39Accuracy13.8
BALSAM - Factuality16Overall score (0-100, LLM-judged generation and multiple cho12.9
GSMA Open-Telco - srsRAN-Bench70Score (%)12.4
GSMA Open-Telco - TeleMath10.53Score (%)11.2

Interactive version: theaggregate.ai/model?slug=mistral-nemo-12b · How It Works · Data refreshed daily, snapshot 2026-10-10.