Open PL LLM - DYK (multiple choice, 5-shot): leaderboard
Metric: Binary F1 (%). Source: huggingface.co. 326 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Mistral Large 2 (Nov) Instruct (2411) | 74.61 |
| 2 | Qwen 2.5 72B Instruct | 73.81 |
| 3 | Mistral Large 2 (Jul) | 73.8 |
| 4 | Qwen 2.5 32B | 73.03 |
| 5 | Qwen 2.5 72B | 71.58 |
| 6 | Mixtral 8x22B Instruct (v0.1) | 70.93 |
| 7 | QwQ 32B-Preview | 70.89 |
| 8 | Llama 3.1 405B Instruct FP8 | 70.67 |
| 9 | Bielik-11B-v2.3-Instruct | 70.26 |
| 10 | Bielik-11B-v2.2-Instruct | 70.24 |
| 11 | Qwen 2 72B Instruct | 70.08 |
| 12 | Bielik-11B-v2.1-Instruct | 70.05 |
| 13 | Qwen 3 32B | 69.61 |
| 14 | MSH-v1-Bielik-v2.3-Instruct-MedIT-merge | 69.61 |
| 15 | Llama 3.3 70B Instruct | 69.41 |
Interactive version: theaggregate.ai/benchmark?slug=open-pl-llm-dyk-multiple-choice-5-shot · How It Works · Data refreshed daily, snapshot 2026-09-19.