T3Q-ko-gemma2-9B-it-safe-v1: benchmark results

Provider: Other. Released 2024-11-03. Access: Open.

Unified ELO 1593 ± 17, rank #651 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-IFEval68.42Strict accuracy, prompt/instruction mean (%)99.6
Open Korean LLM - Ko-EQ-Bench60.21EQ-Bench score99.2
Open Korean LLM - Ko-GSM8K (flexible extract)69.6Exact match, flexible extract (%)98.2
Open Ko-LLM Leaderboard51.72Average (%)98.1
Open Korean LLM Leaderboard51.72Average Score (%)98.1
Open Korean LLM - KorNAT-CKA33.61Normalized accuracy (%)92.7
Open Korean LLM - KorNAT-Helpful51Normalized accuracy (%)88.5
Open Korean LLM - KorNAT-Harmless66.93Normalized accuracy (%)87.1
Open Korean LLM - Ko-Winogrande64.25Accuracy (%)77.7
Open Korean LLM - Ko-GPQA-Diamond22.73Normalized accuracy (%)40.9

Interactive version: theaggregate.ai/model?slug=t3q-ko-gemma2-9b-it-safe-v1 · How It Works · Data refreshed daily, snapshot 2026-09-19.