SniffyOtter-7B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1373 ± 36, rank #7073 of 10916 rated models, from 50 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Japanese LLM - Xlsum JA RougeLsum25.58Score (%)82.9
Open Japanese LLM - Xlsum JA Rouge130.11Score (%)82
Open Japanese LLM - SUM10.36Score (%)67.3
Open Japanese LLM - Xlsum JA Rouge210.36Score (%)67.3
Open Japanese LLM - Xlsum JA Bert Score JA F169.39Score (%)60.3
Open Japanese LLM - Xlsum JA Bleu JA2.72Score (%)57.8
Open Japanese LLM - Mbpp Pylint Check21.29Score (%)45.9
Open Japanese LLM - CG2.41Score (%)41
Open Japanese LLM - AIO Char F141.57Score (%)30.8
Open Japanese LLM - ALT E TO J Comet Wmt2287.82Score (%)30.5
Open Japanese LLM - Jemhopqa Char F145.14Score (%)30.5
Open Japanese LLM - QA41.18Score (%)27.4

Interactive version: theaggregate.ai/model?slug=sniffyotter-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.