EuroLLM-1.7B: benchmark results

Provider: EuroLLM. Access: Open.

Unified ELO 1201 ± 20, rank #1562 of 1632 rated models, from 152 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LA Leaderboard - XCOPA Basque52.2Accuracy (%)71.3
LA Leaderboard - HumorQA58.82Accuracy (%)70.6
LA Leaderboard - xStoryCloze Galician60.62Accuracy (%)70.6
LA Leaderboard - WNLI Spanish59.15Accuracy (%)69.9
LA Leaderboard - WiC Basque50Accuracy (%)64.7
LA Leaderboard - MGSM Catalan3.2Exact Match (%)60
LA Leaderboard - MGSM Galician2.8Exact Match (%)60
LA Leaderboard - QNLI Basque51.26Accuracy (%)58.8
LA Leaderboard - caBREU Catalan11.78BLEU58.8
LA Leaderboard - XNLI Spanish48.35Accuracy (%)57.4
LA Leaderboard - XNLI Galician45.48Accuracy (%)55.1
LA Leaderboard - CoQCat51.28F1 (%)52.3

Interactive version: theaggregate.ai/model?slug=eurollm-1-7b · How It Works · Data refreshed daily, snapshot 2026-10-08.