Llama 3.1 8B Ita — benchmark results

Michele Montebovi's (DeepMount00) Italian-language fine-tune of Llama 3.1 8B Instruct. Provider: Meta. Released 2024-07-23. Access: Open.

Unified ELO 1494 ± 28, rank #825 of 1776 rated models, from 14 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval79.17Score96.4
Pinocchio Italian - Cultura64.67Accuracy (%)88.6
Pinocchio Italian - Diritto57.96Accuracy (%)88.6
Pinocchio Italian - Generale61.27Accuracy (%)88.6
Open Korean LLM Leaderboard503.25Average Score (%)87.8
Pinocchio Italian Leaderboard58.5Average Accuracy (%)86.4
Open LLM Leaderboard - MuSR15.16Score81.6
Pinocchio Italian - Logica45.8Accuracy (%)79.5
Pinocchio Italian - Matematica E Scienze52.65Accuracy (%)79.5
Open LLM Leaderboard - MMLU-Pro32.89Score72.8
Pinocchio Italian - Lingua Straniera68.64Accuracy (%)65.9
Open LLM Leaderboard - MATH Level 517.07Score65.6

Interactive version: theaggregate.ai/model?slug=llama-3-1-8b-ita · How the rankings work · Data refreshed daily, snapshot 2026-07-22.