Open PL LLM - KLEJ NER (generative, 5-shot): leaderboard

Named-entity category classification of Polish text fragments from the KLEJ benchmark (NKJP-NER). Open PL LLM Leaderboard (SpeakLeash), 5-shot, generative variant: the answer is extracted from generated text; accuracy (%), higher is better. Runs not available on the Hugging Face Hub are excluded.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around February 2027. 319 models tracked.

Top models

#ModelScoreOverall rank
1Mistral Large 2 (Nov) Instruct (2411)64.92#480
2Llama 3.1 405B Instruct FP864.09#400
3Mistral Large 2 (Jul)63.36#490
4Qwen 2.5 32B61.9#544
5Qwen 2.5 7B Instruct61.37#863
6QwQ 32B-Preview61.22#671
7Llama 3.3 70B Instruct60.88#541
8Qwen 3 14B60.88#542
9Qwen 3 32B60.79#449
10Qwen 2.5 32B Instruct60.79#509
11QwQ-32B60.5#422
12Qwen 2.5 72B60.25#512
13Llama 3.1 Nemotron 70B Instruct59.77#563
14WizardLM-2 8x22B59.33#723
15Llama 3.1 70B Instruct59.28#567

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-pl-llm-klej-ner-generative-5-shot · How It Works · Data refreshed daily, snapshot 2026-11-05.