granite-3.1-8B-instruct — benchmark results
IBM's 8B Apache-2.0 enterprise model with a 128K context, from the Granite 3.1 release of December 2024. Provider: IBM. Released 2024-12-06. Access: Open.
Unified ELO 1432 ± 17, rank #1080 of 1776 rated models, from 80 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EVALITA - faq | 54.7 | CPS | 95.7 |
| EVALITA - summarization-fanpage | 32.88 | CPS | 93.6 |
| Open LLM Leaderboard - MuSR | 19.01 | Score | 92.4 |
| Open LLM Leaderboard - IFEval | 72.08 | Score | 85.9 |
| Open Japanese LLM - Xlsum JA Rouge1 | 29.87 | Score (%) | 79.7 |
| Open Japanese LLM - Xlsum JA Bleu JA | 3.15 | Score (%) | 78.8 |
| EVALITA - relation-extraction | 39.91 | CPS | 78.7 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.99 | Score (%) | 75.5 |
| Open Japanese LLM - Xlsum JA RougeLsum | 24.85 | Score (%) | 75.2 |
| Open Japanese LLM - SUM | 10.68 | Score (%) | 74.6 |
| Open LLM Leaderboard - MATH Level 5 | 21.98 | Score | 74.5 |
| Open Japanese LLM - Xlsum JA Rouge2 | 10.68 | Score (%) | 73.1 |
Interactive version: theaggregate.ai/model?slug=granite-3-1-8b-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.