Saba2-Preview: benchmark results
Provider: Sakalti. Access: Open.
Aggregate Rating 1392 ± 35, rank #6461 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Mbpp Pylint Check | 52.61 | Score (%) | 58.8 |
| Open Japanese LLM - CG | 18.88 | Score (%) | 55 |
| Open Japanese LLM - Wiki NER SET F1 | 5.31 | Score (%) | 51.2 |
| Open Japanese LLM - Jnli Exact Match | 69.97 | Score (%) | 28.7 |
| Open Japanese LLM - Jmmlu Exact Match | 44 | Score (%) | 25.1 |
| Open Japanese LLM - Jsick Exact Match | 62.51 | Score (%) | 25.1 |
| Open Japanese LLM - Kuci Exact Match | 52.89 | Score (%) | 23.9 |
| Open Japanese LLM - MC | 67.27 | Score (%) | 23.7 |
| Open Japanese LLM - MMLU EN Exact Match | 54.86 | Score (%) | 23.4 |
| Open Japanese LLM - Jcommonsenseqa Exact Match | 80.43 | Score (%) | 23.1 |
| Open Japanese LLM - MR | 60.4 | Score (%) | 23 |
| Open Japanese LLM - MT | 78.16 | Score (%) | 23 |
Interactive version: theaggregate.ai/model?slug=saba2-preview · How It Works · Data refreshed daily, snapshot 2026-11-08.