Synatra-RP-Orca-2-7B-v0.1: benchmark results

Provider: Other. Access: Open.

Unified ELO 1282 ± 18, rank #2510 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Harmless62.68Normalized accuracy (%)48.8
Open Korean LLM - Ko-GSM8K (flexible extract)9.1Exact match, flexible extract (%)32.2
Open Korean LLM - Ko-EQ-Bench0EQ-Bench score24.5
Open Korean LLM - KorNAT-Helpful41.73Normalized accuracy (%)13.7
Open Korean LLM - Ko-Winogrande53.2Accuracy (%)11.8
Open Korean LLM - Ko-GPQA-Diamond19.7Normalized accuracy (%)9.6
Open Korean LLM - KorNAT-CKA14.35Normalized accuracy (%)5.8
Open Ko-LLM Leaderboard27.78Average (%)2.9
Open Korean LLM Leaderboard27.78Average Score (%)2.9
Open Korean LLM - Ko-IFEval0.18Strict accuracy, prompt/instruction mean (%)1.5

Interactive version: theaggregate.ai/model?slug=synatra-rp-orca-2-7b-v0-1 · How It Works · Data refreshed daily, snapshot 2026-09-19.