Llama 3 8B Synthia V3.5: benchmark results

migtissera's Llama-3-8B-Synthia-v3.5, a Llama 3 8B fine-tune on the Synthia-v3.5 dataset of varied system contexts, tuned for instruction following and long-form conversation; uncensored. Provider: migtissera. Released 2024-05-17. Access: Open.

Aggregate Rating 1428 ± 15, rank #1108 of 1656 rated models, from 30 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond27.27Normalized accuracy (%)92.4
Open Ko-LLM Leaderboard41.99Average (%)84.3
Open Korean LLM Leaderboard41.99Average Score (%)84.3
Open Korean LLM - Ko-GSM8K (flexible extract)46.63Exact match, flexible extract (%)80.9
Open LLM Leaderboard v1 - MMLU65.02Accuracy (%) (5-shot)80.5
Open Korean LLM - Ko-IFEval36.79Strict accuracy, prompt/instruction mean (%)76.6
Open LLM Leaderboard v1 - GSM8K63Accuracy (%) (5-shot)76.3
Open Korean LLM - Ko-EQ-Bench18.84EQ-Bench score65.1
Open LLM Leaderboard v1 - TruthfulQA MC254.6MC2 (%) (0-shot)63
Open Chinese LLM - TruthfulQA MC55.3Accuracy (%)62.4
Open Korean LLM - Ko-Winogrande61.48Accuracy (%)62.4
Open Korean LLM - KorNAT-Helpful47.85Normalized accuracy (%)61.8

Interactive version: theaggregate.ai/model?slug=llama-3-8b-synthia-v3-5 · How It Works · Data refreshed daily, snapshot 2026-10-20.