Mistral-7B-ko-Y24-DPO_v0.1: benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1312 ± 18, rank #2413 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond23.74Normalized accuracy (%)55.6
Open Korean LLM - Ko-GSM8K (flexible extract)8.95Exact match, flexible extract (%)31.8
Open Korean LLM - KorNAT-CKA20.71Normalized accuracy (%)30.8
Open Korean LLM - KorNAT-Harmless61.54Normalized accuracy (%)30.7
Open Korean LLM - Ko-Winogrande55.96Accuracy (%)23.7
Open Korean LLM - KorNAT-Helpful42.6Normalized accuracy (%)17.6
Open Korean LLM - Ko-IFEval13.84Strict accuracy, prompt/instruction mean (%)9.6
Open Ko-LLM Leaderboard28.21Average (%)5.6
Open Korean LLM Leaderboard28.21Average Score (%)5.6
Open Korean LLM - Ko-EQ-Bench-0.68EQ-Bench score4.3

Interactive version: theaggregate.ai/model?slug=mistral-7b-ko-y24-dpo-v0-1 · How It Works · Data refreshed daily, snapshot 2026-09-19.