Open PL LLM - DYK (generative, 5-shot): leaderboard

Did You Know: deciding whether a candidate answer to a Polish Wikipedia question is correct. Open PL LLM Leaderboard (SpeakLeash), 5-shot, generative variant: the answer is extracted from generated text; binary F1 (%), higher is better. Runs not available on the Hugging Face Hub are excluded.

Metric: Binary F1 (%). Source: huggingface.co. Saturation forecast: Around February 2027. 319 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 72B Instruct78.05#469
2Mistral Large 2 (Jul)75.86#490
3Mistral Large 2 (Nov) Instruct (2411)74.19#480
4Qwen 2.5 32B74.15#544
5Llama 3.1 405B Instruct FP873.71#400
6QwQ 32B-Preview72.2#671
7Llama 3.1 Nemotron 70B Instruct71.82#563
8Bielik-11B-v2.2-Instruct71.53#669
9Llama 3.3 70B Instruct71.46#541
10Bielik-11B-v2.1-Instruct71.26#679
11Qwen 3 32B71.07#449
12Qwen 2 72B Instruct71.07#579
13Qwen 2.5 72B70.98#512
14Llama 3.1 70B Instruct70.95#567
15Bielik-11B-v2.3-Instruct70.35#700

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-pl-llm-dyk-generative-5-shot · How It Works · Data refreshed daily, snapshot 2026-11-05.