Llama-PLLuM-8B-chat: benchmark results
CYFRA/PLLuM's Llama-PLLuM-8B-chat, a Llama-3.1-based 8B chat model specialized for Polish and other Slavic/Baltic languages, instruction-tuned on a curated Polish 'organic instructions' dataset. Provider: PLLuM. Released 2025-02-24. Access: Open.
Aggregate Rating 1403 ± 20, rank #1216 of 1656 rated models, from 25 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MT-Bench PL - Humanities | 9.5 | Judge Score (0-10) | 67.3 |
| Open LLM Leaderboard - MuSR | 41.99 | Score | 60.4 |
| LLMZSZL Leaderboard | 47.68 | Score | 59.2 |
| MT-Bench PL - Reasoning | 5.35 | Judge Score (0-10) | 49 |
| Polish EQ-Bench | 46.2 | EQ-Bench Score (parseability-adjusted) | 36.6 |
| MT-Bench PL - Overall | 6.05 | Judge Score (0-10) | 35.7 |
| Open LLM Leaderboard - IFEval | 35.15 | Score | 33.5 |
| MT-Bench PL - STEM | 7.5 | Judge Score (0-10) | 32.7 |
| MT-Bench PL - Writing | 7.2 | Judge Score (0-10) | 32.7 |
| Open LLM Leaderboard - MMLU-Pro | 27.19 | Score | 29.2 |
| CPTU Bench | 2.92 | Average Score (1-5) | 25.7 |
| Open LLM Leaderboard - BBH | 40.77 | Score | 25.5 |
Interactive version: theaggregate.ai/model?slug=llama-pllum-8b-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.