Nous-Hermes-llama-2-7B: benchmark results

Nous Research's Nous-Hermes-Llama2-7b, a Llama 2 7B fine-tune on over 300,000 mostly GPT-4-generated instructions, using the same dataset as the original Llama-1 Hermes for consistency. Provider: Nous Research. Released 2023-07-25. Access: Open.

Aggregate Rating 1301 ± 10, rank #1462 of 1635 rated models, from 91 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Business Ethics57Accuracy (%)81.2
MMLU-by-task - Professional Medicine54.41Accuracy (%)78.1
MMLU-by-task - Electrical Engineering49.66Accuracy (%)73.9
Hallucinations Leaderboard46.65Average Task Score (score)73.7
MMLU-by-task - TruthfulQA MC133.41Accuracy (%)73
MMLU-by-task - Machine Learning37.5Accuracy (%)71.9
MMLU-by-task - TruthfulQA MC249.01Accuracy (%)71.6
MMLU-by-task - Abstract Algebra32Accuracy (%)68.1
MMLU-by-task - College Computer Science44Accuracy (%)67.6
Open LLM Leaderboard - MuSR42.57Score66.1
MMLU-by-task - College Medicine45.66Accuracy (%)63.6
MMLU-by-task - Human Aging59.64Accuracy (%)63.6

Interactive version: theaggregate.ai/model?slug=nous-hermes-llama-2-7b · How It Works · Data refreshed daily, snapshot 2026-10-15.