Mistral-7B-A-u0.5-b2-ver0.4: benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1350 ± 17, rank #2240 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Helpful45.85Normalized accuracy (%)39.8
Open Korean LLM - Ko-IFEval25.77Strict accuracy, prompt/instruction mean (%)36.6
Open Korean LLM - Ko-Winogrande57.77Accuracy (%)34.3
Open Korean LLM - Ko-EQ-Bench0EQ-Bench score24.5
Open Korean LLM - KorNAT-CKA19.12Normalized accuracy (%)22.9
Open Korean LLM Leaderboard30.82Average Score (%)22
Open Ko-LLM Leaderboard30.82Average (%)21.9
Open Korean LLM - KorNAT-Harmless60.95Normalized accuracy (%)21.3
Open Korean LLM - Ko-GSM8K (flexible extract)2.05Exact match, flexible extract (%)17.4
Open Korean LLM - Ko-GPQA-Diamond16.16Normalized accuracy (%)0.2

Interactive version: theaggregate.ai/model?slug=mistral-7b-a-u0-5-b2-ver0-4 · How It Works · Data refreshed daily, snapshot 2026-09-19.