NeuralDaredevil-8B-abliterated: benchmark results

mlabonne's abliterated Daredevil-8B Llama 3 merge, DPO-tuned on orpo-dpo-mix-40k to recover the performance lost to abliteration. Provider: mlabonne. Released 2024-05-27. Access: Open.

Aggregate Rating 1469 ± 20, rank #892 of 1656 rated models, from 52 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval75.61Score91.2
Open PL LLM - PSC (generative, 5-shot)97.94Binary F1 (%)90.9
Open PL LLM - PolEmo2-IN (multiple choice, 5-shot)84.35Accuracy (%)83.1
Open Portuguese LLM - ASSIN2 RTE92.73Macro F1 (%)82.8
Open PL LLM - KLEJ NER (multiple choice, 5-shot)54.37Accuracy (%)79.5
Open Portuguese LLM - ENEM71.17Accuracy (%)79.3
Open Portuguese LLM - BLUEX60.22Accuracy (%)78
Open Portuguese LLM - OAB Exams50.48Accuracy (%)77.2
Open PL LLM - CBD (multiple choice, 5-shot)32.83Macro F1 (%)75.5
Open Chinese LLM - GSM8K53.83Accuracy (%)73.2
Open PL LLM - PolEmo2-IN (generative, 5-shot)81.3Accuracy (%)72
Open PL LLM - PoQuAD Open Book (generative, 5-shot)67.49Levenshtein Similarity (%)71.8

Interactive version: theaggregate.ai/model?slug=neuraldaredevil-8b-abliterated · How It Works · Data refreshed daily, snapshot 2026-10-20.