Gemma 1.1 7B (IT) — benchmark results
Provider: Google. Released 2024-04-09. Access: Open.
Unified ELO 1269 ± 28, rank #1588 of 1776 rated models, from 102 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT J TO E Bleu EN | 36.64 | Score (%) | 99.3 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 66.93 | Score (%) | 98.6 |
| Open Japanese LLM - Wikicorpus J TO E Bleu EN | 52.51 | Score (%) | 98.6 |
| Open Japanese LLM - ALT E TO J Bleu JA | 24.25 | Score (%) | 95 |
| ChineseSafe Benchmark | 71.7 | Accuracy (%) | 83.3 |
| OpenEval - GPQA CoT | 28.7 | CoT Correctness (%) | 69 |
| OpenEval - IFEval Strict | 50.18 | Strict Accuracy (%) | 64.3 |
| OpenEval - MMLU-Pro CoT | 27.98 | CoT Correctness (%) | 64.3 |
| Open LLM Leaderboard - MuSR | 11.51 | Score | 61 |
| Open LLM Leaderboard - IFEval | 50.39 | Score | 59.6 |
| OpenEval - Omni-MATH | 9.41 | Accuracy (%) | 57.5 |
| BiGGen-Bench | 3.41 | Average Score (1-5) | 51 |
Interactive version: theaggregate.ai/model?slug=gemma-1-1-7b-it · How the rankings work · Data refreshed daily, snapshot 2026-07-22.