Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 Benchmark Results

Josiefied-Qwen2.5-14B-Instruct-abliterated-v4: benchmark results

Provider: Other. Released 2024-10-21. Access: Open.

Unified ELO 1618 ± 58, rank #560 of 2656 rated models, from 11 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - IFEval	82.92	Score	99.2
Open LLM Leaderboard - MATH Level 5	54.23	Score	98.9
Open Portuguese LLM - ASSIN2 RTE	94.36	Macro F1 (%)	96
Open Portuguese LLM - OAB Exams	61.41	Accuracy (%)	93.7
Open Portuguese LLM - BLUEX	73.16	Accuracy (%)	93.5
Open Portuguese LLM - ENEM	80.06	Accuracy (%)	93.3
Open LLM Leaderboard - MMLU-Pro	50.18	Score	87.8
Open LLM Leaderboard - BBH	63.56	Score	87.6
Open LLM Leaderboard - GPQA	34.23	Score	85.1
Open Portuguese LLM - FaQuAD NLI	78.11	Macro F1 (%)	82.7
Open LLM Leaderboard - MuSR	42.87	Score	69.2