kEy-llama3.1-8B-v0.1: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1487 ± 35, rank #2563 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Xlsum JA Bleu JA | 2.92 | Score (%) | 76.7 |
| Open Japanese LLM - Wiki NER SET F1 | 8.85 | Score (%) | 72 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 10.71 | Score (%) | 56.7 |
| Open Japanese LLM - Jemhopqa Char F1 | 53.74 | Score (%) | 52.2 |
| Open Japanese LLM - Wikicorpus E TO J Bert Score JA F1 | 81.59 | Score (%) | 52.2 |
| Open Japanese LLM - Wiki Reading Char F1 | 76.74 | Score (%) | 51.2 |
| Open Japanese LLM - Wikicorpus J TO E Comet Wmt22 | 74.82 | Score (%) | 49.4 |
| Open Japanese LLM - MT | 83.21 | Score (%) | 47.8 |
| Open Japanese LLM - Wikicorpus J TO E Bert Score EN F1 | 90.07 | Score (%) | 47.5 |
| Open Japanese LLM - Wikicorpus E TO J Comet Wmt22 | 81.68 | Score (%) | 47.1 |
| Open Japanese LLM - Wikicorpus J TO E Bleu EN | 10.41 | Score (%) | 44.4 |
| Open Japanese LLM - ALT J TO E Bert Score EN F1 | 94.94 | Score (%) | 43.9 |
Interactive version: theaggregate.ai/model?slug=key-llama3-1-8b-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.