EuroEval Spanish NLU - MLQA ES: leaderboard

The "MLQA ES" subtask of EuroEval Spanish NLU. Spanish-language EuroEval natural-language-understanding suite, separating NLU task performance from the broader all-task EuroEval aggregate.

Metric: Character F1 (%). Source: euroeval.com. Saturation forecast: Not forecast. 411 models tracked.

Top models

#ModelScoreOverall rank
1Bielik-11B-v2.3-Instruct72.14#693
2Llama 3.1 405B70.79#466
3SOLAR-10.7B-v1.070.14#1253
4Yi 1.5 34B69.63#807
5Ministral-3-14B-Reasoning-251269.56#540
6Magistral Small 1.269.43#570
7Qwen3.5-4B-Base69.36#798
8Gemma 2 27B69.34#806
9OLMo-2-1124-7B69.06#1401
10Llama 3 70B68.93#631
11Llama 2 70B Base68.79#1025
12Qwen 3 32B (Non-reasoning)68.67#443 (Qwen 3 32B)
13Mistral Small 3.268.58#605
14Llama 3.1 70B68.51#592
15Qwen 3 14B (Non-reasoning)68.1#537 (Qwen 3 14B)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=euroeval-spanish-nlu-mlqa-es · How It Works · Data refreshed daily, snapshot 2026-10-20.