Gemma 2 27B: benchmark results
Google's open-weight Gemma 2 27B, the flagship of the Gemma 2 family (June 2024). Provider: Google. Released 2024-06-27. Access: Open.
Aggregate Rating 1493 ± 9, rank #806 of 1656 rated models, from 487 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| LLM Stats (Natural Questions) | 34.5 | Score (%) | 100 |
| MIMIC-CDM - Cholecystitis | 70.2 | Accuracy (%) | 100 |
| EuroEval Norwegian NLU - Norec | 65.57 | Matthews correlation coefficient (%) | 99.5 |
| EuroEval German NLU - Germanquad | 69.98 | Character F1 (%) | 99.4 |
| HELM MMLU - World Religions | 92.4 | EM | 99.4 |
| EuroEval Finnish NLU - Tydiqa FI | 77.11 | Character F1 (%) | 98.8 |
| Swallow - Pre-trained English - XWINO | 92.1 | Accuracy (%) | 98 |
| EuroEval Icelandic NLU - NQII | 62.06 | Character F1 (%) | 97.4 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 78.36 | Character F1 (%) | 97 |
| EuroEval Dutch NLU - SQuAD NL | 82.44 | Character F1 (%) | 96.6 |
| EuroEval Finnish NLU - Scandisent FI | 93.12 | Matthews correlation coefficient (%) | 96.5 |
| EuroEval French NLU - FQuAD | 75.88 | Character F1 (%) | 96.5 |
Interactive version: theaggregate.ai/model?slug=gemma-2-27b · How It Works · Data refreshed daily, snapshot 2026-10-20.