Gemma-2-Llama-Swallow-27B-it-v0.1: benchmark results
Provider: Google. Access: API.
Aggregate Rating 1465 ± 42, rank #3046 of 10916 rated models, from 52 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 87.36 | Score (%) | 95.9 |
| Open Japanese LLM - ALT E TO J Bleu JA | 13.7 | Score (%) | 86.8 |
| Open Japanese LLM - ALT J TO E Bleu EN | 17.97 | Score (%) | 85.6 |
| Open Japanese LLM - Xlsum JA Rouge1 | 30.85 | Score (%) | 85.1 |
| Open Japanese LLM - AIO Char F1 | 72 | Score (%) | 84.6 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 90.95 | Score (%) | 84.3 |
| Open Japanese LLM v2 - JamC-QA | 55.57 | Exact Match (%) | 83.3 |
| Open Japanese LLM - RC | 91.59 | Score (%) | 82.3 |
| Open Japanese LLM - Xlsum JA RougeLsum | 25.49 | Score (%) | 82.2 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 11.67 | Score (%) | 74.3 |
| Open Japanese LLM - Wikicorpus J TO E Bleu EN | 11.16 | Score (%) | 70 |
| Open Japanese LLM - SUM | 10.44 | Score (%) | 68.6 |
Interactive version: theaggregate.ai/model?slug=gemma-2-llama-swallow-27b-it-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.