NaturalLM: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1478 ± 35, rank #2683 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Wiki PAS SET F1 | 8.24 | Score (%) | 78.8 |
| Open Japanese LLM - Mbpp Pylint Check | 90.56 | Score (%) | 77.4 |
| Open Japanese LLM - CG | 46.99 | Score (%) | 69 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 10.49 | Score (%) | 52.8 |
| Open Japanese LLM - AIO Char F1 | 53.6 | Score (%) | 52.6 |
| Open Japanese LLM - Wikicorpus E TO J Bert Score JA F1 | 81.32 | Score (%) | 49 |
| Open Japanese LLM - RC | 90.24 | Score (%) | 48.4 |
| Open Japanese LLM - Wiki Dependency SET F1 | 33.44 | Score (%) | 47.4 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 85.53 | Score (%) | 47.1 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 89.88 | Score (%) | 47.1 |
| Open Japanese LLM - Jemhopqa Char F1 | 51.53 | Score (%) | 47.1 |
| Open Japanese LLM Leaderboard | 56.68 | Average Score (%) | 46.6 |
Interactive version: theaggregate.ai/model?slug=naturallm · How It Works · Data refreshed daily, snapshot 2026-11-08.