gemma-7B: benchmark results
Google's Gemma 7B, the base pretrained checkpoint in the original Gemma family, released under Google's Gemma license. Provider: Google. Released 2024-02-21. Access: Open.
Aggregate Rating 1352 ± 10, rank #1384 of 1656 rated models, from 360 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| European LLM Leaderboard - Zero-Shot Accuracy | 56.69 | Average Accuracy (%) | 95.1 |
| EuroEval Icelandic NLU - NQII | 56.97 | Character F1 (%) | 90.1 |
| EuroEval French NLU - FQuAD | 72.77 | Character F1 (%) | 87.7 |
| EuroEval German NLU - Germanquad | 64.31 | Character F1 (%) | 87.2 |
| EuroEval Norwegian NLU - Norquad | 72.02 | Character F1 (%) | 85.1 |
| EuroEval Spanish NLU - MLQA ES | 65.03 | Character F1 (%) | 83.1 |
| EuroEval Dutch NLU - SQuAD NL | 77.24 | Character F1 (%) | 82.7 |
| EuroEval Swedish NLU - Swerec | 78.08 | Matthews correlation coefficient (%) | 82.5 |
| OpenBookQA | 78.6 | Accuracy (%) | 81 |
| EuroEval English NLU - SST-5 | 67.79 | Matthews correlation coefficient (%) | 77.2 |
| EuroEval Faroese NLU - FoQA | 72.16 | Character F1 (%) | 76.8 |
| European LLM Leaderboard - Accuracy | 53.55 | Average Accuracy (%) | 76.5 |
Interactive version: theaggregate.ai/model?slug=gemma-7b · How It Works · Data refreshed daily, snapshot 2026-10-20.