Himeyuri-v0.1-12B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1511 ± 35, rank #2193 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Wiki Dependency SET F1 | 38.45 | Score (%) | 79.9 |
| Open Japanese LLM - Mbpp Pylint Check | 87.35 | Score (%) | 74 |
| Open Japanese LLM - Xlsum JA RougeLsum | 24.61 | Score (%) | 74 |
| Open Japanese LLM - Xlsum JA Rouge1 | 28.6 | Score (%) | 72.1 |
| Open Japanese LLM - CG | 47.19 | Score (%) | 69.2 |
| Open Japanese LLM - Wikicorpus E TO J Comet Wmt22 | 83.57 | Score (%) | 67.2 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.68 | Score (%) | 67.1 |
| Open Japanese LLM - SUM | 10.33 | Score (%) | 66.3 |
| Open Japanese LLM - Xlsum JA Rouge2 | 10.32 | Score (%) | 65.6 |
| Open Japanese LLM - MT | 84.4 | Score (%) | 62.6 |
| Open Japanese LLM - Xlsum JA Bleu JA | 2.78 | Score (%) | 62.6 |
| Open Japanese LLM - Wikicorpus J TO E Comet Wmt22 | 75.47 | Score (%) | 61.3 |
Interactive version: theaggregate.ai/model?slug=himeyuri-v0-1-12b · How It Works · Data refreshed daily, snapshot 2026-11-08.