Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge: benchmark results
Community SLERP merge by grimjim of UCLA-AGI's SPPO Iter3 and Princeton NLP's SimPO fine-tunes of Llama 3 8B Instruct. Provider: Meta. Released 2024-06-28. Access: Open.
Unified ELO 1489 ± 1, rank #742 of 1392 rated models, from 15 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Chinese LLM - TruthfulQA MC | 56.61 | Accuracy (%) | 70.9 |
| Open Korean LLM Leaderboard | 39.39 | Average Score (%) | 68.5 |
| Open Chinese LLM - GSM8K | 48.6 | Accuracy (%) | 62.3 |
| Open LLM Leaderboard - MMLU-Pro | 29.17 | Score | 55.9 |
| Open Chinese LLM - C-Eval Semantic | 69.53 | Accuracy (%) | 50.4 |
| Open Chinese LLM Leaderboard | 56.57 | Average Score (%) | 48.7 |
| Open LLM Leaderboard - MATH Level 5 | 9.97 | Score | 47.3 |
| Open LLM Leaderboard - MuSR | 9.54 | Score | 46.6 |
| Open LLM Leaderboard - BBH | 28.26 | Score | 46.1 |
| Open Chinese LLM - ARC Challenge | 51.11 | Accuracy (%) | 45 |
| Open LLM Leaderboard - GPQA | 5.37 | Score | 45 |
| Open Chinese LLM - CMMLU | 52.88 | Accuracy (%) | 44.8 |
Interactive version: theaggregate.ai/model?slug=llama-3-instruct-8b-sppo-iter3-simpo-merge · How It Works · Data refreshed daily, snapshot 2026-09-05.