Synatra-Zephyr-7B-v0.02: benchmark results

Provider: Other. Access: Open.

Unified ELO 1443 ± 17, rank #1562 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Helpful49Normalized accuracy (%)75.6
Open Korean LLM - Ko-GPQA-Diamond24.75Normalized accuracy (%)69.5
Open Korean LLM - Ko-GSM8K (flexible extract)27.37Exact match, flexible extract (%)61.4
Open Korean LLM - Ko-EQ-Bench14.69EQ-Bench score60.4
Open Korean LLM Leaderboard37Average Score (%)60.3
Open Ko-LLM Leaderboard37Average (%)60.2
Open Korean LLM - KorNAT-Harmless62.79Normalized accuracy (%)50.3
Open Korean LLM - Ko-IFEval28.53Strict accuracy, prompt/instruction mean (%)48.4
Open Korean LLM - KorNAT-CKA23.82Normalized accuracy (%)47.3
Open Korean LLM - Ko-Winogrande58.33Accuracy (%)37.8

Interactive version: theaggregate.ai/model?slug=synatra-zephyr-7b-v0-02 · How It Works · Data refreshed daily, snapshot 2026-09-19.