Mistral Large 2 (Nov) Instruct (2411): benchmark results

November 2024 Mistral Large 2 Instruct snapshot. Provider: Mistral. Released 2024-11-18. Access: API.

Aggregate Rating 1593 ± 8, rank #465 of 1656 rated models, from 582 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EVALITA - admission-test76.28CPS100
EVALITA - relation-extraction66.82CPS100
EVALITA - sentiment-analysis80.94CPS100
EVALITA LLM Leaderboard62.28Average CPS100
MOEVE - Question Answering70.4Mean overall question-answering score x 100 (0-100) over thr100
Open PL LLM - Belebele (generative, 5-shot)93.78Accuracy (%)100
Open PL LLM - DYK (multiple choice, 5-shot)74.61Binary F1 (%)100
Open PL LLM - Generative73.07Average Generative Score (%)100
Open PL LLM - KLEJ NER (generative, 5-shot)64.92Accuracy (%)100
Open PL LLM - KLEJ NER (multiple choice, 5-shot)65.16Accuracy (%)100
Open PL LLM - Multiple Choice65.64Average Multiple-Choice Score (%)100
Open PL LLM - PSC (generative, 5-shot)99Binary F1 (%)100

Interactive version: theaggregate.ai/model?slug=mistral-large-2-nov-instruct-2411 · How It Works · Data refreshed daily, snapshot 2026-10-20.