granite-3.1-2B-instruct: benchmark results

IBM's Granite 3.1 2B Instruct model, a long-context fine-tune of Granite-3.1-2B-Base using supervised fine-tuning, reinforcement learning and model merging, supporting 12 languages. Provider: IBM. Released 2024-12-18. Access: Open.

Aggregate Rating 1350 ± 18, rank #1385 of 1656 rated models, from 125 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Enkrypt AI - Toxicity Risk0.18Risk Score94.7
Open Japanese LLM - Xlsum JA Rouge132.31Score (%)89.2
Open Japanese LLM - Xlsum JA RougeLsum26.48Score (%)88
Open Japanese LLM - Xlsum JA Bert Score JA F170.25Score (%)82
Open LLM Leaderboard - IFEval62.86Score75
Open PL LLM - PSC (multiple choice, 5-shot)72.49Binary F1 (%)63.6
Open Japanese LLM - SUM10.18Score (%)63.1
Open Japanese LLM - Wiki NER SET F17.08Score (%)62.7
Open Japanese LLM - Xlsum JA Rouge210.18Score (%)62.6
Enkrypt AI - Jailbreak Risk7.43Risk Score62.4
Open LLM Leaderboard - MATH Level 515.26Score62.4
Enkrypt AI - Safety Risk24.76Risk Score59.2

Interactive version: theaggregate.ai/model?slug=granite-3-1-2b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.