Codestral-22B-v0.1-abliterated-v3: benchmark results

Provider: Mistral. Access: Open.

Aggregate Rating 1424 ± 43, rank #4989 of 10916 rated models, from 13 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Chinese LLM - TruthfulQA MC56.47Accuracy (%)70.4
Open Chinese LLM - HellaSwag60.95Accuracy (%)59.9
Open Portuguese LLM - ENEM62.77Accuracy (%)53.4
Open Chinese LLM - ARC Challenge52.82Accuracy (%)51.2
Open Portuguese LLM - OAB Exams41.32Accuracy (%)46.6
Open Portuguese LLM - BLUEX49.37Accuracy (%)44.9
Open Chinese LLM - GSM8K43.67Accuracy (%)44.4
Open Portuguese LLM - ASSIN2 RTE88.26Macro F1 (%)44
Open Portuguese LLM - FaQuAD NLI56.61Macro F1 (%)39.1
Open Chinese LLM - C-Eval Semantic64.46Accuracy (%)37.6
Open Chinese LLM Leaderboard55.13Official Nonzero-Task Mean (%)34.6
Open Chinese LLM - CMMLU47.66Accuracy (%)26.6

Interactive version: theaggregate.ai/model?slug=codestral-22b-v0-1-abliterated-v3 · How It Works · Data refreshed daily, snapshot 2026-11-08.