Gemma 1.1 2B (IT) — benchmark results
Provider: Google. Released 2024-04-09. Access: Open.
Unified ELO 1250 ± 27, rank #1617 of 1776 rated models, from 79 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT J TO E Bleu EN | 31.18 | Score (%) | 98.6 |
| Open Japanese LLM - Wikicorpus J TO E Bleu EN | 50.65 | Score (%) | 98.3 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 59.7 | Score (%) | 97.4 |
| Open Japanese LLM - ALT E TO J Bleu JA | 27.83 | Score (%) | 96.2 |
| Open Chinese LLM - TruthfulQA MC | 54.49 | Accuracy (%) | 57.6 |
| Open Japanese LLM - Wiki NER SET F1 | 5.31 | Score (%) | 51.2 |
| OpenEval - Omni-MATH | 3.97 | Accuracy (%) | 45 |
| OpenEval - IFEval Strict | 32.69 | Strict Accuracy (%) | 41.7 |
| Open Japanese LLM - Xlsum JA Rouge1 | 24.54 | Score (%) | 41.1 |
| BiGGen-Bench | 3.07 | Average Score (1-5) | 34.3 |
| Open Japanese LLM - Xlsum JA RougeLsum | 19.63 | Score (%) | 33.9 |
| OpenEval - BBQ | 36.64 | Exact Match (%) | 29.3 |
Interactive version: theaggregate.ai/model?slug=gemma-1-1-2b-it · How the rankings work · Data refreshed daily, snapshot 2026-07-22.