EuroEval Portuguese NLU - HAREM — leaderboard
Metric: Named entity recognition Score (%). Source: euroeval.com. 438 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 4 31B (IT) | 63.85 |
| 2 | Gemma 4 26B A4B (IT) | 63.12 |
| 3 | Qwen 3 4B 2507 (Thinking) | 62.2 |
| 4 | Claude Sonnet 4.5 (Thinking) | 61.29 |
| 5 | Llama 3.1 70B | 61.1 |
| 6 | Qwen 3 Next 80B A3B (Thinking) | 60.81 |
| 7 | Mistral Small 3.1 | 60.73 |
| 8 | OLMo 3.1 32B (Thinking) | 60.41 |
| 9 | Llama 3 70B | 59.36 |
| 10 | Mistral Small 3.2 | 59.09 |
| 11 | QwQ-32B | 58.1 |
| 12 | O3 Mini (2025-01-31) | 57.18 |
| 13 | Magistral Small | 56.9 |
| 14 | Llama 3 8B Instruct | 56.38 |
| 15 | Qwen 3 30B A3B | 56.08 |
Interactive version: theaggregate.ai/benchmark?slug=euroeval-portuguese-nlu-harem · How the rankings work · Data refreshed daily, snapshot 2026-07-22.