mistral-7B-sft-beta: benchmark results

Provider: Mistral. Access: Open.

Aggregate Rating 1384 ± 31, rank #6744 of 10916 rated models, from 7 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Hallucinations Leaderboard46.8Average Task Score (score)76.3
Open LLM Leaderboard v1 - WinoGrande77.58Accuracy (%) (5-shot)57
Open LLM Leaderboard v1 - GSM8K36.47Accuracy (%) (5-shot)51.8
Open LLM Leaderboard v1 - MMLU61.42Accuracy (%) (5-shot)51.7
Open LLM Leaderboard v1 - HellaSwag82.23Normalized accuracy (%) (10-shot)49.7
Open LLM Leaderboard v1 - ARC Challenge57.42Normalized accuracy (%) (25-shot)37.5
Open LLM Leaderboard v1 - TruthfulQA MC243.58MC2 (%) (0-shot)24.1

Interactive version: theaggregate.ai/model?slug=mistral-7b-sft-beta · How It Works · Data refreshed daily, snapshot 2026-11-08.