Mistral-7B-length-100000: benchmark results

Provider: Mistral.

Aggregate Rating 1345 ± 33, rank #7840 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - WinoGrande76.72Accuracy (%) (5-shot)50.1
Open LLM Leaderboard v1 - GSM8K19.56Accuracy (%) (5-shot)40.7
Open LLM Leaderboard v1 - MMLU55.75Accuracy (%) (5-shot)37.3
Open LLM Leaderboard v1 - HellaSwag78.32Normalized accuracy (%) (10-shot)33.5
Open LLM Leaderboard v1 - TruthfulQA MC244.95MC2 (%) (0-shot)29.1
Open LLM Leaderboard v1 - ARC Challenge51.71Normalized accuracy (%) (25-shot)26.2

Interactive version: theaggregate.ai/model?slug=mistral-7b-length-100000 · How It Works · Data refreshed daily, snapshot 2026-11-08.