gemma-ko-7B-instruct-v0.50: benchmark results

Provider: Google. Access: API.

Unified ELO 1440 ± 17, rank #1589 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-CKA39.55Normalized accuracy (%)98.5
Open Korean LLM - Ko-Winogrande65.9Accuracy (%)86.8
Open Korean LLM - Ko-GPQA-Diamond24.75Normalized accuracy (%)69.5
Open Korean LLM - Ko-IFEval32.58Strict accuracy, prompt/instruction mean (%)62.9
Open Ko-LLM Leaderboard36.85Average (%)59.5
Open Korean LLM Leaderboard36.85Average Score (%)59.5
Open Korean LLM - Ko-EQ-Bench6.91EQ-Bench score52.9
Open Korean LLM - Ko-GSM8K (flexible extract)13.65Exact match, flexible extract (%)41.5
Open Korean LLM - KorNAT-Harmless61.23Normalized accuracy (%)25.4
Open Korean LLM - KorNAT-Helpful41.15Normalized accuracy (%)10.6

Interactive version: theaggregate.ai/model?slug=gemma-ko-7b-instruct-v0-50 · How It Works · Data refreshed daily, snapshot 2026-09-19.