Gemma 2 2B: benchmark results
Google's open-weight Gemma 2 2B, the smallest Gemma 2 tier (July 2024). Provider: Google. Released 2024-07-31. Access: Open.
Aggregate Rating 1298 ± 14, rank #1487 of 1656 rated models, from 291 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| LA Leaderboard - caBREU Catalan | 17 | BLEU | 88.2 |
| LA Leaderboard - XNLI Spanish | 51.81 | Accuracy (%) | 86 |
| LA Leaderboard - WNLI Basque | 56.34 | Accuracy (%) | 77.9 |
| LA Leaderboard - xStoryCloze Basque | 52.81 | Accuracy (%) | 77.9 |
| LA Leaderboard - CoQCat | 66.57 | F1 (%) | 75.4 |
| LA Leaderboard - EusExams Basque | 34.02 | Accuracy (%) | 74.5 |
| LA Leaderboard - Belebele Basque | 41.78 | Accuracy (%) | 74.3 |
| LA Leaderboard - XNLI Catalan | 48.84 | Accuracy (%) | 73.5 |
| IKP - T7 | 11.63 | Accuracy (%) | 72.1 |
| EuroEval Swedish NLU - Swerec | 77.06 | Matthews correlation coefficient (%) | 72 |
| LA Leaderboard - XQuAD Spanish | 65.83 | F1 (%) | 70.8 |
| LA Leaderboard - EusProficiency Basque | 26.37 | Accuracy (%) | 70.6 |
Interactive version: theaggregate.ai/model?slug=gemma-2-2b · How It Works · Data refreshed daily, snapshot 2026-10-20.