Chocolatine-2-14B-Instruct-v2.0.3 Benchmark Results

Chocolatine-2-14B-Instruct-v2.0.3: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1570 ± 32, rank #1407 of 10916 rated models, from 60 benchmark results.

Benchmark	Score	Metric	Percentile
Open Japanese LLM - Mbpp Pylint Check	98.59	Score (%)	96.5
Open LLM Leaderboard - GPQA	37.92	Score	94.6
Open LLM Leaderboard - MMLU-Pro	53.74	Score	94.6
Open LLM Leaderboard - MuSR	47.68	Score	93.7
Open LLM Leaderboard - BBH	65.48	Score	92.8
Open LLM Leaderboard - MATH Level 5	42.07	Score	91.6
Open Japanese LLM - Xlsum JA Bert Score JA F1	70.71	Score (%)	89.8
French LLM Leaderboard - IFEval FR	64.32	Score (%)	88.9
Open Japanese LLM - CG	60.44	Score (%)	87.9
Open Japanese LLM - Xlsum JA RougeLsum	26.33	Score (%)	86.7
Open Japanese LLM - SUM	11.32	Score (%)	86.1
Open Japanese LLM - Xlsum JA Rouge2	11.33	Score (%)	85.9