Qwen2.5-7B-o1-ja-v0.1: benchmark results
Provider: Alibaba. Access: Open.
Aggregate Rating 1504 ± 35, rank #2278 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Jsick Exact Match | 83.48 | Score (%) | 84.4 |
| Open Japanese LLM - Xlsum JA Rouge1 | 30.59 | Score (%) | 83.9 |
| Open Japanese LLM - Xlsum JA RougeLsum | 25.35 | Score (%) | 80.5 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 69.62 | Score (%) | 65.3 |
| Open Japanese LLM - SUM | 10.22 | Score (%) | 63.6 |
| Open Japanese LLM - Xlsum JA Rouge2 | 10.22 | Score (%) | 63.6 |
| Open Japanese LLM - Wiki NER SET F1 | 7.08 | Score (%) | 62.7 |
| Open Japanese LLM - Wiki Dependency SET F1 | 36.04 | Score (%) | 61.5 |
| Open Japanese LLM - Jnli Exact Match | 82 | Score (%) | 55.3 |
| Open Japanese LLM - Wiki PAS SET F1 | 6.37 | Score (%) | 50.2 |
| Open Japanese LLM - MR | 81.8 | Score (%) | 49 |
| Open Japanese LLM - RC | 90.27 | Score (%) | 49 |
Interactive version: theaggregate.ai/model?slug=qwen2-5-7b-o1-ja-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.