granite-3.0-1B-a400m-instruct — benchmark results

Provider: IBM. Released 2024-10-03. Access: Open.

Unified ELO 1206 ± 29, rank #1684 of 1776 rated models, from 50 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Spanish NLU - ScaLA ES3.03Linguistic acceptability Score (%)35.8
EuroEval Portuguese NLU - ScaLA PT4.04Linguistic acceptability Score (%)33
EuroEval Italian NLU - SQuAD IT48.99Reading comprehension Score (%)31.9
Open LLM Leaderboard - IFEval33.32Score31.2
EuroEval Spanish NLU - MLQA ES46.39Reading comprehension Score (%)30.3
EuroEval French NLU - FQuAD48.49Reading comprehension Score (%)29.8
EuroEval Icelandic Knowledge2.23Knowledge Average Score (%)27.4
EuroEval Spanish NLU - Sentiment Headlines ES27.37Sentiment classification Score (%)26.7
EuroEval Italian NLU - Sentipolc1634.15Sentiment classification Score (%)24.5
EuroEval Dutch NLU - DBRD64.57Sentiment classification Score (%)24.3
EuroEval Portuguese NLU - SST-2 PT60.5Sentiment classification Score (%)24.3
EuroEval Spanish NLU28.86NLU Average Score (%)22.4

Interactive version: theaggregate.ai/model?slug=granite-3-0-1b-a400m-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.