EuroLLM-1.7B: benchmark results
Provider: EuroLLM. Released 2024-09-24. Access: Open.
Aggregate Rating 1208 ± 17, rank #9405 of 10524 rated models, from 178 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| LA Leaderboard - XCOPA Basque | 52.2 | Accuracy (%) | 71.3 |
| LA Leaderboard - HumorQA | 58.82 | Accuracy (%) | 70.6 |
| LA Leaderboard - xStoryCloze Galician | 60.62 | Accuracy (%) | 70.6 |
| LA Leaderboard - WNLI Spanish | 59.15 | Accuracy (%) | 69.9 |
| LA Leaderboard - WiC Basque | 50 | Accuracy (%) | 64.7 |
| Lara Mini Base Report (base-model protocol) - Global PIQA (non-parallel), All Languages (0-shot) | 56.5 | Accuracy (%) averaged over all languages/variants of the ben | 62 |
| LA Leaderboard - MGSM Catalan | 3.2 | Exact Match (%) | 60 |
| LA Leaderboard - MGSM Galician | 2.8 | Exact Match (%) | 60 |
| LA Leaderboard - QNLI Basque | 51.26 | Accuracy (%) | 58.8 |
| LA Leaderboard - caBREU Catalan | 11.78 | BLEU | 58.8 |
| LA Leaderboard - XNLI Spanish | 48.35 | Accuracy (%) | 57.4 |
| Lara Mini Base Report (base-model protocol) - T-HellaSwag, All Languages (0-shot) | 38 | Accuracy normalized by answer length (%) averaged over all l | 57.4 |
Interactive version: theaggregate.ai/model?slug=eurollm-1-7b · How It Works · Data refreshed daily, snapshot 2026-11-22.