Chocolatine-2-14B-Instruct-v2.0b3 Benchmark Results

Chocolatine-2-14B-Instruct-v2.0b3: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1565 ± 34, rank #1471 of 10916 rated models, from 56 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - GPQA	37.92	Score	94.6
Open LLM Leaderboard - MuSR	47.81	Score	94.1
Open LLM Leaderboard - MMLU-Pro	53.37	Score	93.6
Open Japanese LLM - Mbpp Pylint Check	97.99	Score (%)	93.4
Open Japanese LLM - CG	62.45	Score (%)	92.1
Open LLM Leaderboard - MATH Level 5	41.09	Score	91
Open Japanese LLM - Xlsum JA Bert Score JA F1	70.73	Score (%)	90.4
Open LLM Leaderboard - BBH	64.69	Score	90.3
Open LLM Leaderboard - IFEval	73.23	Score	87.5
Open Japanese LLM - Xlsum JA Rouge2	11.15	Score (%)	84.6
Open Japanese LLM - Xlsum JA RougeLsum	25.75	Score (%)	84.4
Open Japanese LLM - SUM	11.13	Score (%)	84.3