Synatra-7B-Instruct-v0.3-pre2: benchmark results
Provider: Other. Access: Open.
Unified ELO 1483 ± 17, rank #1251 of 2656 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM - Ko-GPQA-Diamond | 25.76 | Normalized accuracy (%) | 81.3 |
| Open Korean LLM Leaderboard | 40.42 | Average Score (%) | 77 |
| Open Ko-LLM Leaderboard | 40.42 | Average (%) | 76.9 |
| Open Korean LLM - KorNAT-Helpful | 48.7 | Normalized accuracy (%) | 71.5 |
| Open Korean LLM - Ko-EQ-Bench | 25.36 | EQ-Bench score | 71.2 |
| Open Korean LLM - Ko-GSM8K (flexible extract) | 36.54 | Exact match, flexible extract (%) | 70.1 |
| Open Korean LLM - Ko-Winogrande | 62.67 | Accuracy (%) | 69.8 |
| Open Korean LLM - KorNAT-CKA | 25.92 | Normalized accuracy (%) | 61.3 |
| Open Korean LLM - Ko-IFEval | 28.82 | Strict accuracy, prompt/instruction mean (%) | 49.8 |
| Open Korean LLM - KorNAT-Harmless | 62.52 | Normalized accuracy (%) | 45.2 |
Interactive version: theaggregate.ai/model?slug=synatra-7b-instruct-v0-3-pre2 · How It Works · Data refreshed daily, snapshot 2026-09-19.