gemma-7B — benchmark results
Provider: Google. Released 2024-02-21. Access: Open.
Unified ELO 1249 ± 29, rank #1618 of 1776 rated models, from 225 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT J TO E Bleu EN | 42.39 | Score (%) | 99.5 |
| Open Japanese LLM - Wikicorpus J TO E Bleu EN | 54.2 | Score (%) | 98.8 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 50.33 | Score (%) | 96.9 |
| Open Japanese LLM - ALT E TO J Bleu JA | 25.85 | Score (%) | 95.7 |
| European LLM Leaderboard - Zero-Shot Accuracy | 56.69 | Average Accuracy (%) | 95.1 |
| EuroEval Icelandic NLU - NQII | 56.97 | Reading comprehension Score (%) | 90.1 |
| EuroEval French NLU - FQuAD | 72.77 | Reading comprehension Score (%) | 87.7 |
| EuroEval German NLU - Germanquad | 64.31 | Reading comprehension Score (%) | 87.2 |
| Open Medical LLM - MMLU College Biology | 79.86 | Accuracy (%) | 85.5 |
| EuroEval Norwegian NLU - Norquad | 72.02 | Reading comprehension Score (%) | 85.1 |
| EuroEval Spanish NLU - MLQA ES | 65.03 | Reading comprehension Score (%) | 83.1 |
| EuroEval Dutch NLU - SQuAD NL | 77.24 | Reading comprehension Score (%) | 82.7 |
Interactive version: theaggregate.ai/model?slug=gemma-7b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.