Yi-1.5-9B-Chat-16K-abliterated Benchmark Results

Yi-1.5-9B-Chat-16K-abliterated — benchmark results

byroneverson's abliterated (refusal-removed) version of 01.AI's Yi-1.5 9B Chat 16K. Provider: 01.AI. Released 2024-09-03. Access: Open.

Unified ELO 1468 ± 16, rank #917 of 1776 rated models, from 15 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - MuSR	19.68	Score	94.3
Open Korean LLM Leaderboard	485.98	Average Score (%)	86.1
Open Chinese LLM - GSM8K	58.68	Accuracy (%)	81.6
Open Chinese LLM - ARC Challenge	58.11	Accuracy (%)	78.8
Open Chinese LLM - C-Eval Semantic	85.54	Accuracy (%)	77.2
Open Chinese LLM - HellaSwag	64.48	Accuracy (%)	76.3
Open Chinese LLM Leaderboard	63.48	Average Score (%)	76.3
Open Chinese LLM - CMMLU	62.03	Accuracy (%)	71.8
Open LLM Leaderboard - GPQA	8.39	Score	70
Open LLM Leaderboard - IFEval	55.28	Score	66.8
Open LLM Leaderboard - MMLU-Pro	31.37	Score	66.7
Open LLM Leaderboard - BBH	32.84	Score	63.3