shisa-v2-llama3.1-8B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1501 ± 30, rank #2336 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT E TO J Bleu JA | 14.02 | Score (%) | 91.1 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 86.89 | Score (%) | 87.9 |
| Open Japanese LLM - Xlsum JA Bleu JA | 3.13 | Score (%) | 85.1 |
| Open Japanese LLM - Jamp Exact Match | 66.95 | Score (%) | 73.7 |
| Open Japanese LLM - Jsem Exact Match | 78.03 | Score (%) | 63.5 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 90.62 | Score (%) | 61.4 |
| Open Japanese LLM - RC | 90.69 | Score (%) | 61.4 |
| Open Japanese LLM - Jnli Exact Match | 83.28 | Score (%) | 61.3 |
| Open Japanese LLM - ALT J TO E Bleu EN | 16.87 | Score (%) | 61.2 |
| Open Japanese LLM - Wiki NER SET F1 | 6.19 | Score (%) | 57.2 |
| JP-TL-Bench - Japanese to English - Hard | 8.56 | LT Score (0-10; Hard items only; anchored pairwise Bradley-T | 57.1 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 10.71 | Score (%) | 56.7 |
Interactive version: theaggregate.ai/model?slug=shisa-v2-llama3-1-8b · How It Works · Data refreshed daily, snapshot 2026-11-08.