Mistral-7B-sumz-dpo-4h [Adapter]: benchmark results

Provider: Mistral. Access: Open.

Aggregate Rating 1465 ± 42, rank #3024 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - ARC Challenge72.95Normalized accuracy (%) (25-shot)94.5
Open LLM Leaderboard v1 - HellaSwag88.81Normalized accuracy (%) (10-shot)94.2
Open LLM Leaderboard v1 - TruthfulQA MC271.74MC2 (%) (0-shot)92.2
Open LLM Leaderboard v1 - WinoGrande83.98Accuracy (%) (5-shot)91.5
Open LLM Leaderboard v1 - GSM8K69.52Accuracy (%) (5-shot)89.5
Open LLM Leaderboard v1 - MMLU64.8Accuracy (%) (5-shot)76.8

Interactive version: theaggregate.ai/model?slug=mistral-7b-sumz-dpo-4h-adapter · How It Works · Data refreshed daily, snapshot 2026-11-08.