suzume-llama-3-8B-multilingual-orpo-borda-top75 — benchmark results
Provider: Lightblue. Released 2024-04-26. Access: Open.
Unified ELO 1401 ± 18, rank #1221 of 1776 rated models, from 15 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 514.52 | Average Score (%) | 88.7 |
| Open LLM Leaderboard - IFEval | 66.87 | Score | 78.9 |
| Open LLM Leaderboard - MMLU-Pro | 30.77 | Score | 63.6 |
| Open Chinese LLM - HellaSwag | 60.67 | Accuracy (%) | 56.2 |
| Open Chinese LLM - WinoGrande | 63.38 | Accuracy (%) | 55.8 |
| Open Chinese LLM - GSM8K | 46.17 | Accuracy (%) | 52.7 |
| Open Chinese LLM - CMMLU | 53.47 | Accuracy (%) | 50.6 |
| Open LLM Leaderboard - BBH | 28.06 | Score | 45.4 |
| Open Chinese LLM - C-Eval Semantic | 67.05 | Accuracy (%) | 42.1 |
| Open Chinese LLM Leaderboard | 55.58 | Average Score (%) | 40.4 |
| Open LLM Leaderboard - MATH Level 5 | 7.85 | Score | 40.4 |
| Open Chinese LLM - ARC Challenge | 49.32 | Accuracy (%) | 38.6 |
Interactive version: theaggregate.ai/model?slug=suzume-llama-3-8b-multilingual-orpo-borda-top75 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.