ChatWaifu_v1.4: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1507 ± 32, rank #2246 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - MuSR | 47.43 | Score | 92.8 |
| Open Japanese LLM - Mbpp Pylint Check | 92.17 | Score (%) | 80.9 |
| Open Japanese LLM - Wiki PAS SET F1 | 8.4 | Score (%) | 80.5 |
| Open Japanese LLM - Xlsum JA RougeLsum | 24.74 | Score (%) | 75.2 |
| Open Japanese LLM - Xlsum JA Rouge1 | 28.62 | Score (%) | 72.4 |
| Open Japanese LLM - CG | 50.8 | Score (%) | 72 |
| Open Japanese LLM - SUM | 10.51 | Score (%) | 70.1 |
| Open Japanese LLM - Wiki Dependency SET F1 | 37.34 | Score (%) | 70 |
| Open Japanese LLM - Xlsum JA Rouge2 | 10.5 | Score (%) | 70 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.75 | Score (%) | 69.8 |
| Open LLM Leaderboard - IFEval | 56.91 | Score | 68.7 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 90.72 | Score (%) | 68.6 |
Interactive version: theaggregate.ai/model?slug=chatwaifu-v1-4 · How It Works · Data refreshed daily, snapshot 2026-11-08.