juud-Mistral-7B-dpo: benchmark results

Provider: Other. Released 2024-02-07. Access: Open.

Aggregate Rating 1362 ± 15, rank #1361 of 1656 rated models, from 24 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Harmless64.6Normalized accuracy (%)75.3
Open LLM Leaderboard v1 - ARC Challenge66.81Normalized accuracy (%) (25-shot)74.8
Open LLM Leaderboard v1 - HellaSwag84.89Normalized accuracy (%) (10-shot)69.9
Open Korean LLM - KorNAT-CKA27.18Normalized accuracy (%)68
Open Korean LLM - Ko-GSM8K (flexible extract)28.13Exact match, flexible extract (%)62.5
Open LLM Leaderboard v1 - WinoGrande78.3Accuracy (%) (5-shot)62
Open LLM Leaderboard v1 - TruthfulQA MC253.51MC2 (%) (0-shot)59.8
Open Korean LLM - Ko-EQ-Bench12.03EQ-Bench score58
Open LLM Leaderboard v1 - MMLU63.03Accuracy (%) (5-shot)58
Open Korean LLM - Ko-IFEval29.74Strict accuracy, prompt/instruction mean (%)52.6
Open Chinese LLM - TruthfulQA MC53.91Accuracy (%)51.9
Open Korean LLM Leaderboard33.29Average Score (%)40.7

Interactive version: theaggregate.ai/model?slug=juud-mistral-7b-dpo · How It Works · Data refreshed daily, snapshot 2026-10-20.