Gemma 1.1 7B (IT): benchmark results
Provider: Google. Released 2024-04-09. Access: Open.
Unified ELO 1378 ± 1, rank #1200 of 1392 rated models, from 96 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| ChineseSafe Benchmark | 71.7 | Accuracy (%) | 83.3 |
| Open LLM Leaderboard - MuSR | 11.51 | Score | 61 |
| Open LLM Leaderboard - IFEval | 50.39 | Score | 59.6 |
| BiGGen-Bench | 3.41 | Average Score (1-5) | 51 |
| European LLM Leaderboard - FLORES200 | 10.49 | Average FLORES200 Score | 50 |
| European LLM Leaderboard - FLORES200 Target | 10.49 | FLORES200 Target Score | 50 |
| Open LLM Leaderboard - GPQA | 5.82 | Score | 48.7 |
| European LLM Leaderboard - FLORES200 Source | 10.49 | FLORES200 Source Score | 46.7 |
| European LLM Leaderboard - Zero-Shot Accuracy | 42.04 | Average Accuracy (%) | 34.1 |
| Open Medical LLM - PubMedQA | 72.4 | Accuracy (%) | 34.1 |
| EvalPlus (HumanEval+ & MBPP+) | 40.2 | Pass@1 avg (%) | 33.1 |
| Open Medical LLM - MMLU College Biology | 68.75 | Accuracy (%) | 33 |
Interactive version: theaggregate.ai/model?slug=gemma-1-1-7b-it · How It Works · Data refreshed daily, snapshot 2026-09-05.