Synatra-7B-v0.3-RP: benchmark results

Provider: Other. Released 2023-10-29. Access: Open.

Unified ELO 1366 ± 1, rank #1229 of 1392 rated models, from 9 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard39.92Average Score (%)71.2
Open Chinese LLM - TruthfulQA MC52.71Accuracy (%)39.5
Open Chinese LLM - GSM8K22.14Accuracy (%)14.7
Open Chinese LLM - WinoGrande60.06Accuracy (%)14.2
Open Chinese LLM - C-Eval Semantic52.39Accuracy (%)13.1
Open Chinese LLM - ARC Challenge43.86Accuracy (%)12.5
Open Chinese LLM - HellaSwag52.26Accuracy (%)11
Open Chinese LLM Leaderboard46.74Average Score (%)9.8
Open Chinese LLM - CMMLU43.74Accuracy (%)9.5

Interactive version: theaggregate.ai/model?slug=synatra-7b-v0-3-rp · How It Works · Data refreshed daily, snapshot 2026-09-05.