shisa-v2-mistral-nemo-12B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1514 ± 35, rank #2126 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 91.35 | Score (%) | 95.7 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 87.2 | Score (%) | 94 |
| Open Japanese LLM - ALT E TO J Bleu JA | 14.07 | Score (%) | 91.5 |
| Open Japanese LLM - Wikicorpus E TO J Comet Wmt22 | 84.2 | Score (%) | 84.3 |
| Open Japanese LLM - MT | 84.89 | Score (%) | 83.7 |
| Open Japanese LLM - Jamp Exact Match | 68.39 | Score (%) | 82.7 |
| Open Japanese LLM - Jsick Exact Match | 82.69 | Score (%) | 78.7 |
| Open Japanese LLM - Xlsum JA Bleu JA | 2.93 | Score (%) | 77.5 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.85 | Score (%) | 73.9 |
| Open Japanese LLM - RC | 91.04 | Score (%) | 68.3 |
| Open Japanese LLM - Wikicorpus J TO E Comet Wmt22 | 75.66 | Score (%) | 65.9 |
| Open Japanese LLM - Wikicorpus E TO J Bert Score JA F1 | 82.54 | Score (%) | 64.3 |
Interactive version: theaggregate.ai/model?slug=shisa-v2-mistral-nemo-12b · How It Works · Data refreshed daily, snapshot 2026-11-08.