Mistral-7B-ko-Y24_v0.1: benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1269 ± 20, rank #2543 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond22.73Normalized accuracy (%)40.9
Open Korean LLM - Ko-EQ-Bench0EQ-Bench score24.5
Open Korean LLM - Ko-GSM8K (flexible extract)1.97Exact match, flexible extract (%)16.9
Open Korean LLM - KorNAT-CKA17.03Normalized accuracy (%)14.1
Open Korean LLM - Ko-Winogrande53.59Accuracy (%)13
Open Korean LLM - KorNAT-Harmless60.12Normalized accuracy (%)11.9
Open Korean LLM - Ko-IFEval14.6Strict accuracy, prompt/instruction mean (%)9.9
Open Korean LLM - KorNAT-Helpful40.88Normalized accuracy (%)9.1
Open Korean LLM Leaderboard26.8Average Score (%)1.4
Open Ko-LLM Leaderboard26.8Average (%)1.3

Interactive version: theaggregate.ai/model?slug=mistral-7b-ko-y24-v0-1 · How It Works · Data refreshed daily, snapshot 2026-09-19.