Mistral-7B-v0.3: benchmark results

Provider: Mistral. Released 2024-05-22. Access: Open.

Unified ELO 1394 ± 1, rank #1160 of 1392 rated models, from 110 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Finnish NLU - Tydiqa FI69.63Reading comprehension Score (%)83.6
EuroEval Portuguese NLU - MultiWikiQA PT74.69Reading comprehension Score (%)83.4
EuroEval Spanish NLU - MLQA ES64.36Reading comprehension Score (%)79.1
EuroEval Dutch NLU - DBRD90.5Sentiment classification Score (%)76.2
LA Leaderboard - PIQA Catalan65.13Accuracy (%)75.7
EuroEval Portuguese NLU - SST-2 PT80.72Sentiment classification Score (%)70.7
MERA - ruHumanEval19.15pass@1 (%)63.9
MERA - ruCodeEval19.39pass@1 (%)63.2
EuroEval Italian NLU - SQuAD IT69.12Reading comprehension Score (%)63
LA Leaderboard - EusExams Basque31.68Accuracy (%)59.6
Open Italian LLM - MMLU-Pro (IT)24.9Accuracy (%)57.1
EuroEval Finnish NLU - Scandisent FI89.52Sentiment classification Score (%)54.5

Interactive version: theaggregate.ai/model?slug=mistral-7b-v0-3 · How It Works · Data refreshed daily, snapshot 2026-09-05.