Mistral-Nemo-Japanese-Instruct-2408: benchmark results
Provider: Mistral. Access: Open.
Aggregate Rating 1475 ± 32, rank #2739 of 10916 rated models, from 57 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Janli Exact Match | 83.75 | Score (%) | 81.7 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 90.87 | Score (%) | 78.7 |
| Open Japanese LLM - RC | 91.42 | Score (%) | 77.8 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 86.45 | Score (%) | 75.5 |
| Open Japanese LLM - ALT E TO J Bleu JA | 12.78 | Score (%) | 64.9 |
| Open Japanese LLM - Xlsum JA RougeLsum | 23.13 | Score (%) | 62.7 |
| Open Japanese LLM - Jsts Pearson | 89.13 | Score (%) | 62.4 |
| Open Japanese LLM - Niilc Char F1 | 51.16 | Score (%) | 61.1 |
| Open Japanese LLM - Jsts Spearman | 86.46 | Score (%) | 60.8 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.34 | Score (%) | 59 |
| Open Japanese LLM - Xlsum JA Rouge1 | 26.8 | Score (%) | 58.7 |
| Open Japanese LLM - AIO Char F1 | 53.93 | Score (%) | 54.4 |
Interactive version: theaggregate.ai/model?slug=mistral-nemo-japanese-instruct-2408 · How It Works · Data refreshed daily, snapshot 2026-11-08.