Ultiima-14B-v0.4: benchmark results
Provider: Sakalti. Access: Open.
Aggregate Rating 1578 ± 34, rank #1278 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 39.6 | Score | 98.8 |
| Open LLM Leaderboard - MuSR | 48.86 | Score | 96.7 |
| Open Japanese LLM - Jsts Pearson | 90.52 | Score (%) | 94.1 |
| Open LLM Leaderboard - MMLU-Pro | 52.78 | Score | 92 |
| Open Japanese LLM - Jcommonsenseqa Exact Match | 95.98 | Score (%) | 90.5 |
| Open LLM Leaderboard - BBH | 64.2 | Score | 89.1 |
| Open Japanese LLM - RC | 91.93 | Score (%) | 88.2 |
| Open Japanese LLM - CG | 60.44 | Score (%) | 87.9 |
| Open Japanese LLM - Commonsensemoralja Exact Match | 91.06 | Score (%) | 87.4 |
| Open LLM Leaderboard - MATH Level 5 | 35.35 | Score | 85.6 |
| Open Japanese LLM - Jsts Spearman | 87.71 | Score (%) | 84.4 |
| Open Japanese LLM - Mbpp Pylint Check | 93.17 | Score (%) | 82.9 |
Interactive version: theaggregate.ai/model?slug=ultiima-14b-v0-4 · How It Works · Data refreshed daily, snapshot 2026-11-08.