gemma-2B: benchmark results
Google's Gemma 2B base pretrained model, released under the Gemma license in February 2024; the linked model card provides no further architecture or training details. Provider: Google. Released 2024-02-21. Access: Open.
Aggregate Rating 1213 ± 13, rank #1575 of 1656 rated models, from 178 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Finnish NLU - Scandisent FI | 89.49 | Matthews correlation coefficient (%) | 53.7 |
| Open Japanese LLM - Mbpp Pylint Check | 32.73 | Score (%) | 51.3 |
| Open Japanese LLM - Wiki NER SET F1 | 5.31 | Score (%) | 51.2 |
| EuroEval Dutch NLU - DBRD | 86.49 | Matthews correlation coefficient (%) | 49.2 |
| AI Energy Score (Text Generation) | 4 | Energy Score (1-5) | 47.5 |
| EuroEval Faroese NLU - FoSent | 23.93 | Matthews correlation coefficient (%) | 45.6 |
| EuroEval Italian NLU - Sentipolc16 | 47.86 | Matthews correlation coefficient (%) | 45.5 |
| URIAL-Bench - Math | 3.3 | Judge Score (0-10) | 44.4 |
| Open LLM Leaderboard - MuSR | 39.78 | Score | 40.2 |
| EuroEval English NLU - SQuAD | 76.66 | Character F1 (%) | 38.3 |
| EuroEval Danish NLU - Angry Tweets | 38.91 | Matthews correlation coefficient (%) | 36.6 |
| EuroEval Faroese NLU - FoQA | 30.06 | Character F1 (%) | 36.5 |
Interactive version: theaggregate.ai/model?slug=gemma-2b · How It Works · Data refreshed daily, snapshot 2026-10-20.