granite-3.0-3B-a800m-instruct: benchmark results

IBM's Granite 3.0 3B-A800M Instruct, a mixture-of-experts model (3B total, about 800M active) fine-tuned from its 4K-context base with supervised fine-tuning, reinforcement learning and model merging. Provider: IBM. Released 2024-10-21. Access: Open.

Aggregate Rating 1334 ± 28, rank #1418 of 1656 rated models, from 54 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Enkrypt AI - Toxicity Risk0.09Risk Score96.1
Enkrypt AI - Safety Risk22.78Risk Score70.7
EuroEval Spanish NLU - MLQA ES62.81Character F1 (%)68.1
EuroEval Portuguese NLU - SST-2 PT79.46Matthews correlation coefficient (%)62.7
EuroEval Dutch NLU - DBRD88.43Matthews correlation coefficient (%)58.7
Enkrypt AI - Jailbreak Risk8.88Risk Score52.9
EuroEval Italian NLU - SQuAD IT65.67Character F1 (%)49.4
Open LLM Leaderboard - IFEval42.98Score44.9
Enkrypt AI - Insecure Code Risk34.22Risk Score41.2
EuroEval Spanish NLU - ScaLA ES4.87Matthews correlation coefficient (%)39.3
EuroEval Italian NLU - Sentipolc1644.07Matthews correlation coefficient (%)37.6
Open LLM Leaderboard - MATH Level 57.02Score37.5

Interactive version: theaggregate.ai/model?slug=granite-3-0-3b-a800m-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.