granite-3.1-2B-base: benchmark results
Provider: IBM. Released 2024-12-18. Access: Open.
Aggregate Rating 1329 ± 31, rank #8193 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Wiki NER SET F1 | 7.96 | Score (%) | 67.4 |
| Open Japanese LLM - Xlsum JA Bleu JA | 2.71 | Score (%) | 57.1 |
| Open Japanese LLM - Xlsum JA Rouge1 | 26.38 | Score (%) | 56 |
| Open Japanese LLM - Xlsum JA RougeLsum | 22.18 | Score (%) | 51.7 |
| Open Japanese LLM - SUM | 9.27 | Score (%) | 44.1 |
| Open Japanese LLM - Xlsum JA Rouge2 | 9.26 | Score (%) | 44 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 68.57 | Score (%) | 42.5 |
| Open LLM Leaderboard - IFEval | 35.22 | Score | 33.6 |
| Open LLM Leaderboard - GPQA | 27.77 | Score | 32.6 |
| Open Japanese LLM - Wiki PAS SET F1 | 4.43 | Score (%) | 32.3 |
| Open LLM Leaderboard - MATH Level 5 | 5.66 | Score | 31.2 |
| Open Japanese LLM - Jnli Exact Match | 70.21 | Score (%) | 29.6 |
Interactive version: theaggregate.ai/model?slug=granite-3-1-2b-base · How It Works · Data refreshed daily, snapshot 2026-11-08.