Ultiima-14B-v0.2: benchmark results
Provider: Sakalti. Access: Open.
Aggregate Rating 1567 ± 34, rank #1446 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 38.26 | Score | 95.6 |
| Open LLM Leaderboard - MMLU-Pro | 53.87 | Score | 95.5 |
| Open LLM Leaderboard - MuSR | 47.94 | Score | 94.5 |
| Open Japanese LLM - CG | 63.65 | Score (%) | 94.2 |
| Open LLM Leaderboard - BBH | 64.72 | Score | 90.4 |
| Open LLM Leaderboard - MATH Level 5 | 39.95 | Score | 90 |
| Open Japanese LLM - Mbpp Pylint Check | 95.98 | Score (%) | 87.9 |
| Open Japanese LLM - Wiki Coreference SET F1 | 8.03 | Score (%) | 86.8 |
| Open Japanese LLM - Jsick Exact Match | 83.44 | Score (%) | 83.9 |
| Open LLM Leaderboard - IFEval | 70.7 | Score | 83.9 |
| Open Japanese LLM Leaderboard | 64.67 | Average Score (%) | 77.6 |
| Open Japanese LLM - EL | 57.5 | Score (%) | 77.2 |
Interactive version: theaggregate.ai/model?slug=ultiima-14b-v0-2 · How It Works · Data refreshed daily, snapshot 2026-11-08.