shisa-v2-mistral-small-24B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1552 ± 35, rank #1672 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT E TO J Bleu JA | 15.03 | Score (%) | 97.4 |
| Open Japanese LLM - Jamp Exact Match | 72.13 | Score (%) | 96 |
| Open Japanese LLM - Jsts Spearman | 88 | Score (%) | 93.5 |
| Open Japanese LLM - ALT J TO E Bleu EN | 18.72 | Score (%) | 92.5 |
| Open Japanese LLM - RC | 92.17 | Score (%) | 92.1 |
| Open Japanese LLM - Xlsum JA Bleu JA | 3.44 | Score (%) | 91.5 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 87.03 | Score (%) | 90.1 |
| Open Japanese LLM - Wikicorpus E TO J Comet Wmt22 | 84.54 | Score (%) | 88.9 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 90.98 | Score (%) | 86.8 |
| Open Japanese LLM - Wiki Dependency SET F1 | 40.49 | Score (%) | 86.1 |
| Open Japanese LLM - Jsick Exact Match | 83.64 | Score (%) | 85.6 |
| Open Japanese LLM - Jsts Pearson | 90.16 | Score (%) | 85.1 |
Interactive version: theaggregate.ai/model?slug=shisa-v2-mistral-small-24b · How It Works · Data refreshed daily, snapshot 2026-11-08.