DeepSeek-R1-Distill-Qwen-14B-Japanese Benchmark Results

DeepSeek-R1-Distill-Qwen-14B-Japanese: benchmark results

Provider: DeepSeek. Access: Open.

Aggregate Rating 1514 ± 35, rank #2131 of 10916 rated models, from 50 benchmark results.

Benchmark	Score	Metric	Percentile
Open Japanese LLM - Xlsum JA Rouge1	30.92	Score (%)	85.7
Open Japanese LLM - Xlsum JA Bert Score JA F1	70.2	Score (%)	80.9
Open Japanese LLM - SUM	10.72	Score (%)	76.2
Open Japanese LLM - Xlsum JA Rouge2	10.72	Score (%)	76.2
Open Japanese LLM - EL	57.18	Score (%)	73.7
Open Japanese LLM - Wiki NER SET F1	7.96	Score (%)	67.4
Open Japanese LLM - Jnli Exact Match	83.81	Score (%)	63.2
Open Japanese LLM - Jsem Exact Match	77.97	Score (%)	62.7
Open Japanese LLM - Xlsum JA RougeLsum	22.93	Score (%)	60.8
Open Japanese LLM - Jsick Exact Match	80.76	Score (%)	60.3
Open Japanese LLM - Jcommonsenseqa Exact Match	94.28	Score (%)	53
Open Japanese LLM - NLI	75.56	Score (%)	52.9