Gemma 1.1 2B (IT): benchmark results
Google's Gemma 1.1 2B instruction-tuned model, released under the Gemma license; the linked model card provides no further architecture or training details. Provider: Google. Released 2024-04-05. Access: Open.
Aggregate Rating 1242 ± 16, rank #1550 of 1656 rated models, from 133 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Chinese LLM - TruthfulQA MC | 54.49 | Accuracy (%) | 57.4 |
| Open Japanese LLM - Wiki NER SET F1 | 5.31 | Score (%) | 51.2 |
| Open PL LLM - EQ-Bench | 23.69 | EQ-Bench Score | 44.6 |
| Open Japanese LLM - Xlsum JA Rouge1 | 24.54 | Score (%) | 41.8 |
| Open Japanese LLM - Xlsum JA RougeLsum | 19.63 | Score (%) | 34.6 |
| BiGGen-Bench | 3.07 | Average Score (1-5) | 34.3 |
| pfgen-bench - Completion Mode - Truthfulness | 0.63 | Truthfulness Score | 30.8 |
| Open LLM Leaderboard - IFEval | 30.67 | Score | 28.3 |
| Open Portuguese LLM - FaQuAD NLI | 45.1 | Macro F1 (%) | 27.3 |
| Open Portuguese LLM - OAB Exams | 30.75 | Accuracy (%) | 26.9 |
| Open PL LLM - DYK (multiple choice, 5-shot) | 29.63 | Binary F1 (%) | 24 |
| Open LLM Leaderboard - GPQA | 26.93 | Score | 23.8 |
Interactive version: theaggregate.ai/model?slug=gemma-1-1-2b-it · How It Works · Data refreshed daily, snapshot 2026-10-20.