Mixtral-7Bx2-truthy: benchmark results

Provider: Mistral. Access: Open.

Aggregate Rating 1454 ± 39, rank #3588 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - TruthfulQA MC274.68MC2 (%) (0-shot)95.1
Open LLM Leaderboard v1 - ARC Challenge72.18Normalized accuracy (%) (25-shot)91.2
Open LLM Leaderboard v1 - HellaSwag87.88Normalized accuracy (%) (10-shot)88.5
Open LLM Leaderboard v1 - GSM8K67.25Accuracy (%) (5-shot)83.3
Open LLM Leaderboard v1 - MMLU65.2Accuracy (%) (5-shot)82.9
Open LLM Leaderboard v1 - WinoGrande80.66Accuracy (%) (5-shot)75

Interactive version: theaggregate.ai/model?slug=mixtral-7bx2-truthy · How It Works · Data refreshed daily, snapshot 2026-11-08.