zagreus-0.4B-ita: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1184 ± 42, rank #9695 of 10916 rated models, from 54 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Portuguese NLU - ScaLA PT | 2.57 | Matthews correlation coefficient (%) | 27.3 |
| EuroEval Italian NLU - ScaLA IT | 3.36 | Matthews correlation coefficient (%) | 25.4 |
| EuroEval Portuguese Common Sense Reasoning | 2.78 | Common Sense Reasoning Average Score (%) | 24 |
| EuroEval Italian Summarization - Ilpost SUM | 30.09 | chrF3++ (%) | 22 |
| EuroEval Italian NLU - SQuAD IT | 29.8 | Character F1 (%) | 20.6 |
| EuroEval Catalan NLU - ScaLA CA | 0 | Matthews correlation coefficient (%) | 19 |
| EuroEval French Common Sense Reasoning | 3.68 | Common Sense Reasoning Average Score (%) | 18.4 |
| EuroEval French NLU - ScaLA FR | 2.11 | Matthews correlation coefficient (%) | 17.3 |
| EuroEval Italian Knowledge | 3.4 | Knowledge Average Score (%) | 16.2 |
| EuroEval Spanish Knowledge | 3.67 | Knowledge Average Score (%) | 15.6 |
| EuroEval Spanish Summarization - Mlsum ES | 18.89 | chrF3++ (%) | 15.6 |
| EuroEval Portuguese Knowledge | 1.83 | Knowledge Average Score (%) | 13.8 |
Interactive version: theaggregate.ai/model?slug=zagreus-0-4b-ita · How It Works · Data refreshed daily, snapshot 2026-11-08.