gemma-ko-7B-instruct-v0.62: benchmark results

Provider: Google. Released 2024-03-01. Access: Open.

Unified ELO 1451 ± 14, rank #1514 of 2656 rated models, from 26 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Portuguese LLM - FaQuAD NLI80.26Macro F1 (%)89.7
Open Portuguese LLM - ASSIN2 RTE93.13Macro F1 (%)86.6
Open Korean LLM - Ko-GSM8K (flexible extract)42.99Exact match, flexible extract (%)78.4
Open Korean LLM - Ko-EQ-Bench25.93EQ-Bench score72.3
Open Ko-LLM Leaderboard38.43Average (%)67.1
Open Korean LLM Leaderboard38.43Average Score (%)67
Open Portuguese LLM - BLUEX55.49Accuracy (%)63.4
Open Portuguese LLM - ENEM65.71Accuracy (%)62.5
Open Portuguese LLM - OAB Exams43.51Accuracy (%)55.8
Open Korean LLM - Ko-IFEval29.83Strict accuracy, prompt/instruction mean (%)53.1
Open Medical LLM - MMLU Clinical Knowledge71.32Accuracy (%)52.8
Open Medical LLM - MMLU Medical Genetics75Accuracy (%)50.9

Interactive version: theaggregate.ai/model?slug=gemma-ko-7b-instruct-v0-62 · How It Works · Data refreshed daily, snapshot 2026-09-19.