CodeNinja-1.0-OpenChat-7B: benchmark results

beowolx's CodeNinja 7B, an SFT fine-tune of OpenChat 3.5 on over 400,000 coding instructions from Glaive and TokenBender datasets. Provider: beowolx. Released 2023-12-20. Access: Open.

Aggregate Rating 1394 ± 15, rank #1248 of 1656 rated models, from 36 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K66.57Accuracy (%) (5-shot)82
Open Portuguese LLM - FaQuAD NLI77.75Macro F1 (%)80.7
Open Korean LLM - Ko-IFEval39.15Strict accuracy, prompt/instruction mean (%)80.6
Open LLM Leaderboard v1 - WinoGrande79.79Accuracy (%) (5-shot)71
Open Portuguese LLM - ASSIN2 RTE91.54Macro F1 (%)67.9
Open LLM Leaderboard - IFEval54.47Score65.6
Open Korean LLM - Ko-GSM8K (flexible extract)31.16Exact match, flexible extract (%)65.5
Open Korean LLM - Ko-EQ-Bench18.99EQ-Bench score65.3
Open LLM Leaderboard - MuSR42.43Score64.7
Open Ko-LLM Leaderboard37.77Average (%)64
Open Korean LLM Leaderboard37.77Average Score (%)64
Open LLM Leaderboard v1 - MMLU63.77Accuracy (%) (5-shot)63.1

Interactive version: theaggregate.ai/model?slug=codeninja-1-0-openchat-7b · How It Works · Data refreshed daily, snapshot 2026-10-20.