Qwen2.5-7B-Instruct-abliterated: benchmark results

huihui-ai's original abliterated Qwen2.5 7B Instruct with refusals removed, first in a series later revised as v2 and v3. Provider: Alibaba. Released 2024-09-19.

Aggregate Rating 1498 ± 18, rank #790 of 1656 rated models, from 144 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-IFEval62.24Strict accuracy, prompt/instruction mean (%)97.1
Open Korean LLM - KorNAT-Helpful56.28Normalized accuracy (%)96.3
Open Korean LLM - Ko-GSM8K (flexible extract)63.61Exact match, flexible extract (%)96.2
Open Korean LLM - Ko-EQ-Bench52.11EQ-Bench score96
Open Korean LLM - KorNAT-Harmless72.27Normalized accuracy (%)95.4
Open Portuguese LLM - ASSIN2 RTE94.12Macro F1 (%)95
Open Korean LLM Leaderboard47.11Average Score (%)94.6
Open Ko-LLM Leaderboard47.11Average (%)94.5
Open LLM Leaderboard - MATH Level 545.77Score93.9
Open Portuguese LLM - FaQuAD NLI81.54Macro F1 (%)92.3
Open LLM Leaderboard - IFEval75.46Score90.9
Open Portuguese LLM - ENEM74.32Accuracy (%)86.7

Interactive version: theaggregate.ai/model?slug=qwen2-5-7b-instruct-abliterated · How It Works · Data refreshed daily, snapshot 2026-10-20.