Gemma-2-Ataraxy-Gemmasutra-9B-slerp Benchmark Results

Gemma-2-Ataraxy-Gemmasutra-9B-slerp: benchmark results

Community SLERP merge of Gemma 2 9B fine-tunes (Ataraxy and Gemmasutra). Provider: Other. Released 2024-09-11. Access: Open.

Aggregate Rating 1561 ± 21, rank #578 of 1654 rated models, from 20 benchmark results.

Benchmark	Score	Metric	Percentile
Open Korean LLM - Ko-EQ-Bench	62.53	EQ-Bench score	100
Open Korean LLM Leaderboard	53.14	Average Score (%)	98.9
Open Korean LLM - Ko-IFEval	65.72	Strict accuracy, prompt/instruction mean (%)	98.3
Open Korean LLM - Ko-GSM8K (flexible extract)	69.14	Exact match, flexible extract (%)	97.8
Open LLM Leaderboard - IFEval	76.49	Score	92.1
Open Korean LLM - KorNAT-CKA	33.02	Normalized accuracy (%)	90.3
Open Portuguese LLM - ENEM	75.65	Accuracy (%)	89.5
Open LLM Leaderboard - MuSR	46.07	Score	88
Open Portuguese LLM - ASSIN2 RTE	93.21	Macro F1 (%)	87.3
Open Korean LLM - KorNAT-Helpful	50.35	Normalized accuracy (%)	85.4
Open Portuguese LLM - BLUEX	64.26	Accuracy (%)	84.7
Open Portuguese LLM - OAB Exams	53.76	Accuracy (%)	84.3