Open PL LLM - KLEJ NER (multiple choice, 5-shot): leaderboard

Metric: Accuracy (%). Source: huggingface.co. 321 models tracked.

Top models

#ModelScore
1Mistral Large 2 (Nov) Instruct (2411)65.16
2internlm2-chat-20B64.67
3Qwen 3 32B64.29
4Mistral Large 2 (Jul)63.51
5Qwen 2.5 32B Instruct63.07
6QwQ 32B-Preview62.68
7Llama 3.1 405B Instruct FP862.63
8Qwen 2.5 32B62.54
9Qwen 2 72B Instruct62.2
10Phi-461.27
11Qwen 2.5 72B Instruct61.03
12Qwen 1.5 32B60.54
13Llama 3 70B Instruct60.3
14Qwen 3 14B60.3
15Qwen 1.5 72B59.77

Interactive version: theaggregate.ai/benchmark?slug=open-pl-llm-klej-ner-multiple-choice-5-shot · How It Works · Data refreshed daily, snapshot 2026-09-19.