Nous-Hermes-2-Mixtral-8x7B-SFT [chat template]: benchmark results

Provider: Nous Research. Access: Open.

Aggregate Rating 1475 ± 33, rank #2732 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU72.21Accuracy (%) (5-shot)95.4
Open LLM Leaderboard v1 - GSM8K69.6Accuracy (%) (5-shot)89.8
Open LLM Leaderboard v1 - WinoGrande82.95Accuracy (%) (5-shot)86.4
Open LLM Leaderboard v1 - ARC Challenge69.71Normalized accuracy (%) (25-shot)84
Open LLM Leaderboard v1 - HellaSwag86.74Normalized accuracy (%) (10-shot)82.6
Open LLM Leaderboard v1 - TruthfulQA MC251.22MC2 (%) (0-shot)51.1

Interactive version: theaggregate.ai/model?slug=nous-hermes-2-mixtral-8x7b-sft-chat-template · How It Works · Data refreshed daily, snapshot 2026-11-08.