zephyr-7B-sft-full-orpo: benchmark results

Provider: HuggingFace. Access: Open.

Unified ELO 1394 ± 17, rank #1954 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Harmless63.21Normalized accuracy (%)57.9
Open Korean LLM - Ko-IFEval30.58Strict accuracy, prompt/instruction mean (%)56.9
Open Korean LLM - KorNAT-Helpful47.23Normalized accuracy (%)54.2
Open Korean LLM - Ko-EQ-Bench5.15EQ-Bench score50.8
Open Korean LLM - Ko-Winogrande59.98Accuracy (%)50.5
Open Korean LLM - Ko-GSM8K (flexible extract)16.45Exact match, flexible extract (%)46.9
Open Korean LLM Leaderboard32.94Average Score (%)36.9
Open Ko-LLM Leaderboard32.94Average (%)36.6
Open Korean LLM - KorNAT-CKA20.64Normalized accuracy (%)30.5
Open Korean LLM - Ko-GPQA-Diamond20.2Normalized accuracy (%)13.9

Interactive version: theaggregate.ai/model?slug=zephyr-7b-sft-full-orpo · How It Works · Data refreshed daily, snapshot 2026-09-19.