Pleias-1.2B-Preview: benchmark results
Provider: Pleias. Released 2024-11-27. Access: Open.
Aggregate Rating 1264 ± 29, rank #9133 of 10916 rated models, from 264 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Dutch Simplification - Duidelijke Taal | 46.85 | Score (%) | 44.3 |
| EuroEval Albanian NLU - ScaLA SQ | 2.43 | Matthews correlation coefficient (%) | 38.7 |
| EuroEval Norwegian Knowledge - Idioms NO | 0.96 | MCC (x100) | 35.8 |
| EuroEval Catalan NLU - MultiWikiQA CA | 33.06 | Character F1 (%) | 32.2 |
| EuroEval Icelandic NLU - NQII | 32.08 | Character F1 (%) | 32.2 |
| EuroEval Bulgarian NLU - Cinexio | 22.79 | Matthews correlation coefficient (%) | 30.8 |
| EuroEval Romanian NLU - MultiWikiQA RO | 27.7 | Character F1 (%) | 30.6 |
| EuroEval Serbian Summarization - LR SUM SR | 17.22 | chrF3++ (%) | 29.3 |
| EuroEval Slovene NLU - Sentinews | 25.57 | Matthews correlation coefficient (%) | 29.1 |
| EuroEval Spanish NLU - MLQA ES | 44.01 | Character F1 (%) | 28.4 |
| EuroEval Finnish NLU - Tydiqa FI | 47.75 | Character F1 (%) | 28.2 |
| EuroEval French NLU - FQuAD | 45 | Character F1 (%) | 28.2 |
Interactive version: theaggregate.ai/model?slug=pleias-1-2b-preview · How It Works · Data refreshed daily, snapshot 2026-11-08.