AceCoder-Qwen2.5-Coder-7B-Ins-Rule Benchmark Results

AceCoder-Qwen2.5-Coder-7B-Ins-Rule: benchmark results

Provider: Other. Access: Open.

Unified ELO 1494 ± 59, rank #1148 of 2656 rated models, from 11 benchmark results.

Benchmark	Score	Metric	Percentile
Open Portuguese LLM - FaQuAD NLI	80.72	Macro F1 (%)	90.7
Open LLM Leaderboard - MATH Level 5	36.03	Score	86.4
Open LLM Leaderboard - IFEval	62.22	Score	74.3
Open Portuguese LLM - OAB Exams	48.25	Accuracy (%)	69
Open Portuguese LLM - ENEM	67.46	Accuracy (%)	67.1
Open Portuguese LLM - BLUEX	56.47	Accuracy (%)	66.3
Open LLM Leaderboard - BBH	50.89	Score	52.9
Open Portuguese LLM - ASSIN2 RTE	89.64	Macro F1 (%)	51.6
Open LLM Leaderboard - MMLU-Pro	34.28	Score	49.4
Open LLM Leaderboard - MuSR	40.46	Score	45.9
Open LLM Leaderboard - GPQA	27.77	Score	32.7