shisa-v2-qwen2.5-7B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1523 ± 35, rank #2026 of 10916 rated models, from 50 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Japanese LLM - ALT E TO J Bert Score JA F186.83Score (%)86.5
Open Japanese LLM - Jnli Exact Match86.85Score (%)84.5
Open Japanese LLM - Jamp Exact Match68.1Score (%)81.1
Open Japanese LLM - Jsts Pearson90.02Score (%)79.8
Open Japanese LLM - ALT E TO J Comet Wmt2290.87Score (%)78.7
Open Japanese LLM - ALT E TO J Bleu JA13.12Score (%)74.3
Open Japanese LLM - NLI78.1Score (%)73
Open Japanese LLM - Jsick Exact Match82.12Score (%)72.8
Open Japanese LLM - Janli Exact Match81.81Score (%)69.8
Open Japanese LLM - Xlsum JA Bert Score JA F169.75Score (%)69.8
Open Japanese LLM - Jsem Exact Match78.6Score (%)69.7
Open Japanese LLM - Jsts Spearman86.66Score (%)62.7

Interactive version: theaggregate.ai/model?slug=shisa-v2-qwen2-5-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.