granite-3.1-1B-a400m-base: benchmark results
Provider: IBM. Released 2024-12-18. Access: Open.
Aggregate Rating 1199 ± 35, rank #9626 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Mbpp Pylint Check | 25.9 | Score (%) | 47.4 |
| Open Japanese LLM - CG | 3.41 | Score (%) | 43.5 |
| Open LLM Leaderboard - IFEval | 25.19 | Score | 20.9 |
| Open Japanese LLM - Jemhopqa Char F1 | 39.93 | Score (%) | 19.5 |
| Open LLM Leaderboard - MATH Level 5 | 2.72 | Score | 17.4 |
| Open Japanese LLM - Wiki NER SET F1 | 0.88 | Score (%) | 17.2 |
| Open Japanese LLM - Jamp Exact Match | 41.38 | Score (%) | 16.7 |
| Open Japanese LLM - Xlsum JA Rouge1 | 16.15 | Score (%) | 16.7 |
| Open Japanese LLM - Jsem Exact Match | 67.11 | Score (%) | 16 |
| Open LLM Leaderboard - BBH | 32.99 | Score | 15.8 |
| Open Japanese LLM - Xlsum JA RougeLsum | 13.56 | Score (%) | 14.7 |
| Open Japanese LLM - Xlsum JA Bleu JA | 1.45 | Score (%) | 14.5 |
Interactive version: theaggregate.ai/model?slug=granite-3-1-1b-a400m-base · How It Works · Data refreshed daily, snapshot 2026-11-08.