Mistral-Small-Instruct-2409-abliterated — benchmark results

byroneverson's abliterated variant of Mistral Small Instruct 2409 (22B) with refusal behavior removed. Provider: Mistral. Released 2024-09-23. Access: Open.

Unified ELO 1479 ± 40, rank #877 of 1776 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard772.39Average Score (%)97.7
Open Chinese LLM - GSM8K59.51Accuracy (%)83.4
Open LLM Leaderboard - IFEval69.71Score82.7
Open LLM Leaderboard - GPQA11.07Score81.7
Open LLM Leaderboard - MATH Level 524.77Score77.9
Open Chinese LLM Leaderboard60.5Average Score (%)71.8
Open LLM Leaderboard - MMLU-Pro32.48Score71.3
Open Chinese LLM - WinoGrande64.8Accuracy (%)69
Open Chinese LLM - C-Eval Semantic74.44Accuracy (%)63.8
Open Chinese LLM - HellaSwag61.38Accuracy (%)62.8
Open Chinese LLM - CMMLU56.71Accuracy (%)62.5
Open Chinese LLM - ARC Challenge53.5Accuracy (%)56.7

Interactive version: theaggregate.ai/model?slug=mistral-small-instruct-2409-abliterated · How the rankings work · Data refreshed daily, snapshot 2026-07-22.