Gemma 2 27B: benchmark results
Google's open-weight Gemma 2 27B, the flagship of the Gemma 2 family (June 2024). Provider: Google. Released 2024-06-27. Access: Open.
Unified ELO 1475 ± 1, rank #812 of 1392 rated models, from 313 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| LLM Stats (Natural Questions) | 34.5 | Score (%) | 100 |
| MIMIC-CDM - Cholecystitis | 70.2 | Accuracy (%) | 100 |
| EuroEval Norwegian NLU - Norec | 65.57 | Sentiment classification Score (%) | 99.5 |
| EuroEval German NLU - Germanquad | 69.98 | Reading comprehension Score (%) | 99.4 |
| EuroEval Finnish NLU - Tydiqa FI | 77.11 | Reading comprehension Score (%) | 98.8 |
| EuroEval Icelandic NLU - NQII | 62.06 | Reading comprehension Score (%) | 97.4 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 78.36 | Reading comprehension Score (%) | 97 |
| EuroEval Dutch NLU - SQuAD NL | 82.44 | Reading comprehension Score (%) | 96.6 |
| EuroEval Finnish NLU - Scandisent FI | 93.12 | Sentiment classification Score (%) | 96.5 |
| EuroEval French NLU - FQuAD | 75.88 | Reading comprehension Score (%) | 96.5 |
| EuroEval English NLU - SQuAD | 88.11 | Reading comprehension Score (%) | 96.3 |
| EuroEval Spanish NLU - MLQA ES | 69.34 | Reading comprehension Score (%) | 96.1 |
Interactive version: theaggregate.ai/model?slug=gemma-2-27b · How It Works · Data refreshed daily, snapshot 2026-09-05.