Saka-1.5B — benchmark results
Provider: Other. Released 2025-02-07. Access: Open.
Unified ELO 1378 ± 17, rank #1318 of 1776 rated models, from 179 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - ALT E TO J Bleu JA | 74.62 | Score (%) | 99 |
| Open Japanese LLM - Wikicorpus E TO J Bleu JA | 63.74 | Score (%) | 98.1 |
| Open Japanese LLM - Xlsum JA Bleu JA | 51.76 | Score (%) | 97.1 |
| Open Arabic LLM - Arabic MMLU HT College Mathematics | 31 | Accuracy (%) | 51.9 |
| Open Arabic LLM - Arabic MMLU HT Abstract Algebra | 28 | Accuracy (%) | 48.5 |
| Open Arabic LLM - Arabic MMLU HT High School Mathematics | 28.52 | Accuracy (%) | 48.5 |
| Open Arabic LLM - Arabic MMLU LAW (Professional) | 62.1 | Accuracy (%) | 48.5 |
| Open Japanese LLM - CG | 5.82 | Score (%) | 46.2 |
| Open LLM Leaderboard - GPQA | 5.37 | Score | 44.9 |
| Open Japanese LLM - Mbpp Pylint Check | 13.65 | Score (%) | 41.9 |
| Open Arabic LLM - Arabic MMLU Islamic Studies (High School) | 51.8 | Accuracy (%) | 41.4 |
| Open LLM Leaderboard - MATH Level 5 | 8.01 | Score | 40.9 |
Interactive version: theaggregate.ai/model?slug=saka-1-5b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.