Gemma 1.1 2B (IT): benchmark results
Provider: Google. Released 2024-04-09. Access: Open.
Unified ELO 1348 ± 1, rank #1272 of 1392 rated models, from 86 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Chinese LLM - TruthfulQA MC | 54.49 | Accuracy (%) | 57.6 |
| Open Japanese LLM - Wiki NER SET F1 | 5.31 | Score (%) | 51.2 |
| Open Japanese LLM - Xlsum JA Rouge1 | 24.54 | Score (%) | 41.8 |
| Open Japanese LLM - Xlsum JA RougeLsum | 19.63 | Score (%) | 34.6 |
| BiGGen-Bench | 3.07 | Average Score (1-5) | 34.3 |
| Open LLM Leaderboard - IFEval | 30.67 | Score | 28.3 |
| Open LLM Leaderboard - GPQA | 2.57 | Score | 23.9 |
| Open PL LLM - Generative | 16.14 | Average Generative Score (%) | 23.1 |
| Open PL LLM Leaderboard | 11.3 | Average Score (%) | 22.7 |
| Open PL LLM - Multiple Choice | 5.01 | Average Multiple-Choice Score (%) | 22.4 |
| Open PL LLM - RAG | 31.28 | Average RAG Score (%) | 22.4 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 65.55 | Score (%) | 19.7 |
Interactive version: theaggregate.ai/model?slug=gemma-1-1-2b-it · How It Works · Data refreshed daily, snapshot 2026-09-05.