Llama 3 8B 4bit UltraChat Ita — benchmark results
FairMind's Italian-language fine-tune of Meta's Llama 3 8B, trained in 4-bit with Unsloth on Italian-translated chat data. Provider: Meta. Released 2024-04-18. Access: Open.
Unified ELO 1413 ± 11, rank #1166 of 1776 rated models, from 19 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EVALITA - word-in-context | 66.22 | CPS | 70.2 |
| Open Italian LLM - MMLU-Pro (IT) | 26.01 | Accuracy (%) | 67.9 |
| Pinocchio Italian - Cultura | 51.6 | Accuracy (%) | 40.9 |
| EVALITA - faq | 52.88 | CPS | 40.4 |
| EVALITA - sentiment-analysis | 69.44 | CPS | 38.3 |
| Pinocchio Italian - Diritto | 44 | Accuracy (%) | 36.4 |
| Pinocchio Italian - Matematica E Scienze | 42.4 | Accuracy (%) | 36.4 |
| EVALITA - summarization-fanpage | 24.17 | CPS | 36.2 |
| Pinocchio Italian - Generale | 48.3 | Accuracy (%) | 34.1 |
| Pinocchio Italian - Lingua Straniera | 58.12 | Accuracy (%) | 34.1 |
| Pinocchio Italian - Logica | 37.72 | Accuracy (%) | 34.1 |
| EVALITA - evalita NER | 29.77 | CPS | 34 |
Interactive version: theaggregate.ai/model?slug=llama-3-8b-4bit-ultrachat-ita · How the rankings work · Data refreshed daily, snapshot 2026-07-22.