Yi-1.5-9B-Chat-16K-abliterated: benchmark results

byroneverson's abliterated (refusal-removed) version of 01.AI's Yi-1.5 9B Chat 16K. Provider: byroneverson. Released 2024-09-03. Access: Open.

Aggregate Rating 1428 ± 18, rank #1106 of 1656 rated models, from 29 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MuSR47.34Score92.6
Open Korean LLM - Ko-EQ-Bench36.3EQ-Bench score86.5
Open Korean LLM - Ko-IFEval41.06Strict accuracy, prompt/instruction mean (%)83.9
Open Chinese LLM - GSM8K58.68Accuracy (%)81.7
Open Chinese LLM - ARC Challenge58.11Accuracy (%)78.8
Open Chinese LLM - C-Eval Semantic85.54Accuracy (%)77.2
Open Chinese LLM Leaderboard63.48Official Nonzero-Task Mean (%)76.9
Open Chinese LLM - HellaSwag64.48Accuracy (%)76.3
Open Chinese LLM - CMMLU62.03Accuracy (%)71.9
Open LLM Leaderboard - GPQA31.29Score70
Open LLM Leaderboard - IFEval55.28Score66.8
Open LLM Leaderboard - MMLU-Pro38.23Score66.7

Interactive version: theaggregate.ai/model?slug=yi-1-5-9b-chat-16k-abliterated · How It Works · Data refreshed daily, snapshot 2026-10-20.