plamo-2-1B: benchmark results
Preferred Elements' PLaMo 2 1B, an English-and-Japanese base model using a hybrid Samba architecture combining Mamba state-space layers with sliding window attention, trained on 4 trillion tokens, not instruction-tuned. Provider: Preferred Elements. Released 2025-02-05. Access: Open.
Aggregate Rating 1249 ± 45, rank #1515 of 1635 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| pfgen-bench - Completion Mode - Fluency | 0.6 | Fluency Score | 57.8 |
| pfgen-bench - Completion Mode - Truthfulness | 0.77 | Truthfulness Score | 57.7 |
| pfgen-bench - Completion Mode - Score | 0.5 | pfgen Score (mean of three) | 56.2 |
| pfgen-bench - Completion Mode - Helpfulness | 0.12 | Helpfulness Score | 50.5 |
| Swallow - Pre-trained Japanese - WMT20 En-Ja | 23.6 | BLEU | 44.9 |
| Swallow - Pre-trained Japanese - JEMHopQA | 46.3 | Character F1 (%) | 37.8 |
| Swallow - Pre-trained Japanese - NIILC | 43.4 | Character F1 (%) | 34.7 |
| Swallow - Pre-trained English - SQuAD2 | 50.1 | Exact Match (%) | 14.3 |
| Swallow - Pre-trained English - MATH | 3.4 | Exact Match (%) | 13.3 |
| Swallow - Pre-trained Japanese - WMT20 Ja-En | 11.9 | BLEU | 13.3 |
| Swallow - Pre-trained English - GSM8K | 7.2 | Exact Match (%) | 10.2 |
| Swallow - Pre-trained English - HumanEval | 8 | Pass@1 (%) | 10.2 |
Interactive version: theaggregate.ai/model?slug=plamo-2-1b · How It Works · Data refreshed daily, snapshot 2026-11-05.