karakuri-lm-32B-thinking-2501-exp Benchmark Results

karakuri-lm-32B-thinking-2501-exp: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1570 ± 36, rank #1405 of 10916 rated models, from 50 benchmark results.

Benchmark	Score	Metric	Percentile
Open Japanese LLM - RC	92.89	Score (%)	99.5
Open Japanese LLM - CG	67.27	Score (%)	98.7
Open Japanese LLM - Jnli Exact Match	90.26	Score (%)	98
Open Japanese LLM - Wiki NER SET F1	15.93	Score (%)	96.9
Open Japanese LLM - Jmmlu Exact Match	76.28	Score (%)	96.4
Open Japanese LLM - Jsem Exact Match	80.87	Score (%)	96.4
Open Japanese LLM Leaderboard	67.81	Average Score (%)	96.4
Open Japanese LLM - HE	78.27	Score (%)	95.9
Open Japanese LLM - ALT E TO J Comet Wmt22	91.19	Score (%)	93.3
Open Japanese LLM - FA	31.44	Score (%)	92.8
Open Japanese LLM - Mbpp Pylint Check	97.79	Score (%)	92.7
Open Japanese LLM - Kuci Exact Match	83.68	Score (%)	92.2