EVALITA - evalita NER — leaderboard
Metric: CPS. Source: huggingface.co. 48 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Llama 3.3 70B Instruct | 44.58 |
| 2 | Llama 3.1 8B Instruct | 40.3 |
| 3 | Llama-3.1-SuperNova-Lite | 39.49 |
| 4 | Qwen 2.5 72B Instruct | 38.91 |
| 5 | Mistral Large 2 (Nov) Instruct (2411) | 38.79 |
| 6 | Gemma 3 27B (IT) | 38.76 |
| 7 | calme-3.2-instruct-78B | 38.52 |
| 8 | Gemma 2 27B (IT) | 38.33 |
| 9 | Mistral Small 3 | 38.16 |
| 10 | Gemma 2 9B (IT) | 38.03 |
| 11 | Gemma 3 12B (IT) | 37.86 |
| 12 | Qwen 2.5 VL 32B Instruct | 37.81 |
| 13 | DeepSeek R1 Distill Llama 70B | 37.76 |
| 14 | Gemma 3 4B (IT) | 36 |
| 15 | GLM-4.1V-9B (Thinking) | 35.94 |
Interactive version: theaggregate.ai/benchmark?slug=evalita-evalita-ner · How the rankings work · Data refreshed daily, snapshot 2026-07-22.