Hermes7b_ITA: benchmark results

Provider: raicrits. Access: Open.

Aggregate Rating 1269 ± 37, rank #9072 of 10916 rated models, from 8 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Pinocchio Italian - Cultura36.36Accuracy (%)11.4
Pinocchio Italian - Diritto32.69Accuracy (%)11.4
Pinocchio Italian - Generale34.97Accuracy (%)11.4
Pinocchio Italian - Lingua Straniera41.99Accuracy (%)11.4
Pinocchio Italian - Logica31.53Accuracy (%)11.4
Pinocchio Italian - Matematica E Scienze31.25Accuracy (%)11.4
Pinocchio Italian Leaderboard34.8Average Accuracy (%)11.4
Open Italian LLM - MMLU-Pro (IT)12.9Accuracy (%)10.7

Interactive version: theaggregate.ai/model?slug=hermes7b-ita · How It Works · Data refreshed daily, snapshot 2026-11-08.