jyj_gemmaStudy: benchmark results

Provider: Other. Access: Open.

Unified ELO 1374 ± 17, rank #2097 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Harmless64.03Normalized accuracy (%)69.9
Open Korean LLM - Ko-IFEval33.5Strict accuracy, prompt/instruction mean (%)67.3
Open Korean LLM - Ko-EQ-Bench5.69EQ-Bench score51.3
Open Korean LLM - KorNAT-CKA24.18Normalized accuracy (%)50.1
Open Korean LLM Leaderboard32.01Average Score (%)30.6
Open Ko-LLM Leaderboard32.01Average (%)30.3
Open Korean LLM - Ko-GSM8K (flexible extract)5.84Exact match, flexible extract (%)25.5
Open Korean LLM - Ko-GPQA-Diamond20.2Normalized accuracy (%)13.9
Open Korean LLM - KorNAT-Helpful40.7Normalized accuracy (%)8.7
Open Korean LLM - Ko-Winogrande50.2Accuracy (%)3.1

Interactive version: theaggregate.ai/model?slug=jyj-gemmastudy · How It Works · Data refreshed daily, snapshot 2026-09-19.