Synatra-7B-v0.3-QA: benchmark results

Provider: Other. Access: Open.

Unified ELO 1442 ± 17, rank #1574 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond24.75Normalized accuracy (%)69.5
Open Korean LLM - Ko-GSM8K (flexible extract)34.95Exact match, flexible extract (%)68.3
Open Korean LLM - Ko-EQ-Bench22.45EQ-Bench score68.1
Open Korean LLM - KorNAT-CKA26.25Normalized accuracy (%)63.4
Open Korean LLM - Ko-Winogrande61.56Accuracy (%)63
Open Ko-LLM Leaderboard36.25Average (%)56.6
Open Korean LLM Leaderboard36.25Average Score (%)56.6
Open Korean LLM - KorNAT-Helpful46.73Normalized accuracy (%)48.5
Open Korean LLM - Ko-IFEval27.45Strict accuracy, prompt/instruction mean (%)43.1
Open Korean LLM - KorNAT-Harmless61.84Normalized accuracy (%)34.8

Interactive version: theaggregate.ai/model?slug=synatra-7b-v0-3-qa · How It Works · Data refreshed daily, snapshot 2026-09-19.