gemma-ko-7B-instruct-v0.52: benchmark results

Provider: Google. Access: API.

Aggregate Rating 1325 ± 29, rank #8249 of 10916 rated models, from 14 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-CKA36.43Normalized accuracy (%)96.6
Open Korean LLM - Ko-Winogrande65.35Accuracy (%)84
Open Korean LLM - Ko-GPQA-Diamond24.75Normalized accuracy (%)69.5
Open Korean LLM Leaderboard37.59Average Score (%)62.9
Open Korean LLM - Ko-EQ-Bench15.97EQ-Bench score61.4
Open Korean LLM - Ko-GSM8K (flexible extract)15.39Exact match, flexible extract (%)44.9
Open Korean LLM - Ko-IFEval25.41Strict accuracy, prompt/instruction mean (%)35.1
Open LLM Leaderboard v1 - GSM8K11.98Accuracy (%) (5-shot)33.5
Open LLM Leaderboard v1 - MMLU49.57Accuracy (%) (5-shot)28.8
Open Korean LLM - KorNAT-Helpful44.3Normalized accuracy (%)28.5
Open LLM Leaderboard v1 - WinoGrande71.82Accuracy (%) (5-shot)27.4
Open LLM Leaderboard v1 - HellaSwag75.54Normalized accuracy (%) (10-shot)26.7

Interactive version: theaggregate.ai/model?slug=gemma-ko-7b-instruct-v0-52 · How It Works · Data refreshed daily, snapshot 2026-11-08.