granite-3.0-1B-a400m-base — benchmark results
Provider: IBM. Released 2024-10-03. Access: Open.
Unified ELO 1141 ± 40, rank #1746 of 1776 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Portuguese NLU - SST-2 PT | 67.57 | Sentiment classification Score (%) | 33 |
| EuroEval Spanish NLU - MLQA ES | 50.48 | Reading comprehension Score (%) | 32.5 |
| EuroEval Spanish NLU - ScaLA ES | 1.94 | Linguistic acceptability Score (%) | 32 |
| EuroEval Spanish NLU - Sentiment Headlines ES | 29.8 | Sentiment classification Score (%) | 31.3 |
| EuroEval Italian NLU - SQuAD IT | 46.83 | Reading comprehension Score (%) | 30.4 |
| EuroEval Dutch NLU - DBRD | 73.42 | Sentiment classification Score (%) | 29.4 |
| EuroEval French NLU - FQuAD | 45.64 | Reading comprehension Score (%) | 28.7 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 43.08 | Reading comprehension Score (%) | 27 |
| EuroEval Portuguese NLU - ScaLA PT | 1.2 | Linguistic acceptability Score (%) | 21.1 |
| EuroEval Portuguese NLU | 31.53 | NLU Average Score (%) | 20.3 |
| EuroEval Spanish NLU | 26.97 | NLU Average Score (%) | 20 |
| EuroEval French NLU - Allocine | 63 | Sentiment classification Score (%) | 18.1 |
Interactive version: theaggregate.ai/model?slug=granite-3-0-1b-a400m-base · How the rankings work · Data refreshed daily, snapshot 2026-07-22.