Mistral-7B-sumz-dpo-3h [Adapter]: benchmark results

Provider: Mistral. Access: Open.

Aggregate Rating 1466 ± 42, rank #2971 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - ARC Challenge73.04Normalized accuracy (%) (25-shot)95.2
Open LLM Leaderboard v1 - HellaSwag88.67Normalized accuracy (%) (10-shot)93.5
Open LLM Leaderboard v1 - GSM8K70.36Accuracy (%) (5-shot)92.7
Open LLM Leaderboard v1 - WinoGrande84.21Accuracy (%) (5-shot)92.4
Open LLM Leaderboard v1 - TruthfulQA MC271.53MC2 (%) (0-shot)91.9
Open LLM Leaderboard v1 - MMLU64.78Accuracy (%) (5-shot)76.5

Interactive version: theaggregate.ai/model?slug=mistral-7b-sumz-dpo-3h-adapter · How It Works · Data refreshed daily, snapshot 2026-11-08.