omed-llama3.1-8B: benchmark results

Provider: Other. Access: Open.

Unified ELO 1534 ± 17, rank #921 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard45.58Average Score (%)92.2
Open Ko-LLM Leaderboard45.58Average (%)92.1
Open Korean LLM - Ko-IFEval45.96Strict accuracy, prompt/instruction mean (%)90.5
Open Korean LLM - Ko-GSM8K (flexible extract)56.63Exact match, flexible extract (%)90.4
Open Korean LLM - Ko-EQ-Bench36.64EQ-Bench score87
Open Korean LLM - KorNAT-CKA29.38Normalized accuracy (%)79.3
Open Korean LLM - Ko-GPQA-Diamond24.75Normalized accuracy (%)69.5
Open Korean LLM - Ko-Winogrande59.59Accuracy (%)47.5
Open Korean LLM - KorNAT-Helpful44.38Normalized accuracy (%)29.3
Open Korean LLM - KorNAT-Harmless60.97Normalized accuracy (%)21.5

Interactive version: theaggregate.ai/model?slug=omed-llama3-1-8b · How It Works · Data refreshed daily, snapshot 2026-09-19.