Mistral-Nemo-Instruct-2407_sft_ver_4.4: benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1479 ± 18, rank #1296 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-Winogrande68.35Accuracy (%)93
Open Korean LLM - Ko-GPQA-Diamond27.27Normalized accuracy (%)92.4
Open Korean LLM - Ko-GSM8K (flexible extract)49.51Exact match, flexible extract (%)83.1
Open Korean LLM - Ko-IFEval38.77Strict accuracy, prompt/instruction mean (%)80.3
Open Korean LLM - Ko-EQ-Bench26.08EQ-Bench score72.7
Open Korean LLM Leaderboard39.39Average Score (%)72.1
Open Ko-LLM Leaderboard39.39Average (%)71.8
Open Korean LLM - KorNAT-CKA25.4Normalized accuracy (%)57.9
Open Korean LLM - KorNAT-Harmless63.07Normalized accuracy (%)54.9
Open Korean LLM - KorNAT-Helpful46.8Normalized accuracy (%)49.4

Interactive version: theaggregate.ai/model?slug=mistral-nemo-instruct-2407-sft-ver-4-4 · How It Works · Data refreshed daily, snapshot 2026-09-19.