mistral-orpo-mix-7k: benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1461 ± 20, rank #1629 of 2928 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - HellaSwag85.51Normalized accuracy (%) (10-shot)74.9
Open LLM Leaderboard v1 - WinoGrande79.72Accuracy (%) (5-shot)70.7
Open LLM Leaderboard v1 - MMLU62.89Accuracy (%) (5-shot)57.3
Open LLM Leaderboard v1 - GSM8K41.24Accuracy (%) (5-shot)56.3
Open LLM Leaderboard v1 - ARC Challenge61.95Normalized accuracy (%) (25-shot)55.2
Open Portuguese LLM - OAB Exams42.69Accuracy (%)52.9
Open Portuguese LLM - FaQuAD NLI65.88Macro F1 (%)51.2
Open Portuguese LLM - BLUEX51.6Accuracy (%)50
Open Portuguese LLM - ENEM61.51Accuracy (%)49.6
Open Portuguese LLM - ASSIN2 RTE87.95Macro F1 (%)43
Open LLM Leaderboard v1 - TruthfulQA MC246.91MC2 (%) (0-shot)35.8

Interactive version: theaggregate.ai/model?slug=mistral-orpo-mix-7k · How It Works · Data refreshed daily, snapshot 2026-09-23.