Hermes-3-Llama-3.1-405B: benchmark results

Provider: Nous Research. Released 2024-08-13. Access: Open.

Unified ELO 1643 ± 25, rank #479 of 2656 rated models, from 92 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AgentDrive - Physics57.5Accuracy (%)95
AGC-Bench - proparalogy0.86Dataset z-score93.2
AGC-Bench - science_analogies1.58Dataset z-score92.5
AGC-Bench - puntuguese0.94Dataset z-score91.5
AGC-Bench - sdat0.61Dataset z-score91.4
AGC-Bench - story_quality1.13Dataset z-score91.4
AGC-Bench - permpst1.26Dataset z-score90.2
UGI - Natural Intelligence43.48NatInt Score87.4
AGC-Bench - meta4xnli0.78Dataset z-score87.2
AGC-Bench - ocw_connections1.01Dataset z-score86.6
AGC-Bench - story_generation_rocstories0.89Dataset z-score85.4
UGI Leaderboard47.27UGI Score84.1

Interactive version: theaggregate.ai/model?slug=hermes-3-llama-3-1-405b · How It Works · Data refreshed daily, snapshot 2026-09-19.