LA Leaderboard - XNLI Spanish: leaderboard

XNLI natural language inference in Spanish (SpanishBench). From the LA Leaderboard, which evaluates models on Spanish, Catalan, Basque and Galician tasks with the lm-evaluation-harness; accuracy (%), higher is better. Each model result file is a separate run.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 69 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 2 9B53.17#924
2occiglot-7B-eu552.61
3Llama 3.1 8B52.57#1130
4occiglot-7B-eu5-instruct51.89
5EuroLLM-9B51.81#1238
6Gemma 2 2B51.81#1466
7salamandra-7B50.76#1446
8Mistral-7B-v0.350.32#1321
9Mistral 7B Instruct (v0.3)50.28#1255
10Llama 3.1 8B Instruct50.2#1017
11Qwen 2.5 7B50.2#895
12EuroLLM-9B-Instruct49.88#1047
13Gemma 2 9B (IT)49.52#795
14salamandra-7B-instruct49.52#1392
15Teuken-7B-Instruct-v0.449.4#1408

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=la-leaderboard-xnli-spanish · How It Works · Data refreshed daily, snapshot 2026-11-05.