SniffyOtter-7B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1373 ± 36, rank #7073 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Xlsum JA RougeLsum | 25.58 | Score (%) | 82.9 |
| Open Japanese LLM - Xlsum JA Rouge1 | 30.11 | Score (%) | 82 |
| Open Japanese LLM - SUM | 10.36 | Score (%) | 67.3 |
| Open Japanese LLM - Xlsum JA Rouge2 | 10.36 | Score (%) | 67.3 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.39 | Score (%) | 60.3 |
| Open Japanese LLM - Xlsum JA Bleu JA | 2.72 | Score (%) | 57.8 |
| Open Japanese LLM - Mbpp Pylint Check | 21.29 | Score (%) | 45.9 |
| Open Japanese LLM - CG | 2.41 | Score (%) | 41 |
| Open Japanese LLM - AIO Char F1 | 41.57 | Score (%) | 30.8 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 87.82 | Score (%) | 30.5 |
| Open Japanese LLM - Jemhopqa Char F1 | 45.14 | Score (%) | 30.5 |
| Open Japanese LLM - QA | 41.18 | Score (%) | 27.4 |
Interactive version: theaggregate.ai/model?slug=sniffyotter-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.