Hermes 4 70B: benchmark results
Nous Research's Hermes 4 hybrid-reasoning fine-tune of Llama 3.1 70B with toggleable think traces (August 2025). Provider: Nous Research. Released 2025-08-26. Access: Open.
Aggregate Rating 1582 ± 17, rank #506 of 1656 rated models, from 168 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AGC-Bench - story_quality | 1.24 | Dataset z-score | 96.3 |
| AGC-Bench - twistlist | 1.56 | Dataset z-score | 96.3 |
| AGC-Bench - futuregen | 1.33 | Dataset z-score | 95 |
| AGC-Bench - science_analogies | 2 | Dataset z-score | 95 |
| AGC-Bench - historical_analogy | 1.41 | Dataset z-score | 91.2 |
| SpeechMap Compliance | 89.1 | % Requests Completed | 90.6 |
| AGC-Bench - lcc_metaphor | 1.02 | Dataset z-score | 85.2 |
| AGC-Bench - creatset | 1.22 | Dataset z-score | 84.1 |
| Medmarks - MedHallu Hard | 52 | Score (%) | 79.5 |
| PhysAI-Bench | 45.87 | Decision accuracy (%; four-option choice of the next action | 78.6 |
| AGC-Bench - metaphoric_analogies | 0.44 | Dataset z-score | 78 |
| AGC-Bench - ocw_connections | 0.9 | Dataset z-score | 78 |
Interactive version: theaggregate.ai/model?slug=hermes-4-70b · How It Works · Data refreshed daily, snapshot 2026-10-20.