Synatra-7B-Instruct-v0.3-pre: benchmark results
Provider: Other. Access: Open.
Unified ELO 1465 ± 17, rank #1411 of 2656 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM - KorNAT-Helpful | 50.48 | Normalized accuracy (%) | 86.1 |
| Open Korean LLM - Ko-GSM8K (flexible extract) | 36.32 | Exact match, flexible extract (%) | 69.9 |
| Open Ko-LLM Leaderboard | 38.97 | Average (%) | 69.2 |
| Open Korean LLM Leaderboard | 38.97 | Average Score (%) | 69.2 |
| Open Korean LLM - Ko-EQ-Bench | 21.97 | EQ-Bench score | 67.2 |
| Open Korean LLM - Ko-Winogrande | 61.56 | Accuracy (%) | 63 |
| Open Korean LLM - KorNAT-Harmless | 63.3 | Normalized accuracy (%) | 59.8 |
| Open Korean LLM - Ko-IFEval | 29.53 | Strict accuracy, prompt/instruction mean (%) | 52 |
| Open Korean LLM - Ko-GPQA-Diamond | 23.23 | Normalized accuracy (%) | 48.1 |
| Open Korean LLM - KorNAT-CKA | 23.02 | Normalized accuracy (%) | 42.1 |
Interactive version: theaggregate.ai/model?slug=synatra-7b-instruct-v0-3-pre · How It Works · Data refreshed daily, snapshot 2026-09-19.