Llama 3.1 70B Japanese Instruct 2407: benchmark results
Provider: Meta. Access: Open.
Aggregate Rating 1586 ± 28, rank #1165 of 10916 rated models, from 58 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT E TO J Bleu JA | 15.3 | Score (%) | 98.8 |
| Open Japanese LLM - Jsem Exact Match | 81.06 | Score (%) | 97.8 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 87.47 | Score (%) | 96.9 |
| Open Japanese LLM - Commonsensemoralja Exact Match | 93.11 | Score (%) | 96.6 |
| Open Japanese LLM - QA | 71.69 | Score (%) | 96.4 |
| Open Japanese LLM - MC | 91.08 | Score (%) | 95.9 |
| Open Japanese LLM - Niilc Char F1 | 66.02 | Score (%) | 95.9 |
| Open Japanese LLM - Jemhopqa Char F1 | 64.32 | Score (%) | 94.5 |
| Open Japanese LLM Leaderboard | 67.05 | Average Score (%) | 94.5 |
| Open Japanese LLM - Kuci Exact Match | 84.24 | Score (%) | 94.2 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 91.23 | Score (%) | 94 |
| Open Japanese LLM - AIO Char F1 | 84.72 | Score (%) | 93.5 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-70b-japanese-instruct-2407 · How It Works · Data refreshed daily, snapshot 2026-11-08.