Pleias-350m-Preview: benchmark results
Provider: Pleias. Released 2024-11-19. Access: Open.
Aggregate Rating 1225 ± 30, rank #9445 of 10916 rated models, from 264 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Norwegian Knowledge - Idioms NO | 1.19 | MCC (x100) | 38.1 |
| EuroEval Dutch Simplification - Duidelijke Taal | 45 | Score (%) | 35.5 |
| EuroEval Serbian Summarization - LR SUM SR | 16.91 | chrF3++ (%) | 28.6 |
| EuroEval Polish Summarization - PSC | 18.38 | chrF3++ (%) | 25.2 |
| EuroEval Catalan Common Sense Reasoning | 1.75 | Common Sense Reasoning Average Score (%) | 21.8 |
| EuroEval Icelandic Knowledge | 1.35 | Knowledge Average Score (%) | 21.1 |
| EuroEval Lithuanian NLU - ScaLA LT | 0.81 | Matthews correlation coefficient (%) | 21 |
| EuroEval Ukrainian Common Sense Reasoning | 0.98 | Common Sense Reasoning Average Score (%) | 20.7 |
| EuroEval Finnish NLU - ScaLA FI | 1.46 | Matthews correlation coefficient (%) | 20.5 |
| EuroEval Albanian Common Sense Reasoning | 0.03 | Common Sense Reasoning Average Score (%) | 20.3 |
| EuroEval Hungarian Common Sense Reasoning | 0.89 | Common Sense Reasoning Average Score (%) | 20 |
| EuroEval French NLU - Eltec | 35.91 | Micro F1 excluding MISC (%) | 19.5 |
Interactive version: theaggregate.ai/model?slug=pleias-350m-preview · How It Works · Data refreshed daily, snapshot 2026-11-08.