Ultiima-52B: benchmark results
Provider: Sakalti. Access: Open.
Aggregate Rating 1555 ± 35, rank #1631 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Wiki PAS SET F1 | 12.93 | Score (%) | 98.1 |
| Open Japanese LLM - Jamp Exact Match | 75 | Score (%) | 97.7 |
| Open Japanese LLM - Janli Exact Match | 92.36 | Score (%) | 97.2 |
| Open Japanese LLM - NLI | 81.92 | Score (%) | 96.4 |
| Open Japanese LLM - Jmmlu Exact Match | 76.19 | Score (%) | 95.9 |
| Open Japanese LLM - Wiki Coreference SET F1 | 10.89 | Score (%) | 95 |
| Open Japanese LLM - HE | 78.2 | Score (%) | 94.4 |
| Open Japanese LLM - Wiki Dependency SET F1 | 45.94 | Score (%) | 92.8 |
| Open Japanese LLM - MMLU EN Exact Match | 80.2 | Score (%) | 91.3 |
| Open Japanese LLM - Jemhopqa Char F1 | 62.32 | Score (%) | 90.5 |
| Open Japanese LLM - FA | 30.03 | Score (%) | 89.7 |
| Open Japanese LLM - Jnli Exact Match | 88.74 | Score (%) | 88.5 |
Interactive version: theaggregate.ai/model?slug=ultiima-52b · How It Works · Data refreshed daily, snapshot 2026-11-08.