SJT-2.4B-Alpha: benchmark results
Provider: Sakalti. Access: Open.
Aggregate Rating 1311 ± 37, rank #8515 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - CG | 3.21 | Score (%) | 42.9 |
| Open Japanese LLM - Mbpp Pylint Check | 12.45 | Score (%) | 40.5 |
| Open Japanese LLM - Wiki NER SET F1 | 1.77 | Score (%) | 27 |
| Open Japanese LLM - Jsick Exact Match | 61.74 | Score (%) | 22.6 |
| Open Japanese LLM - Commonsensemoralja Exact Match | 70.87 | Score (%) | 19.7 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 81.95 | Score (%) | 17.1 |
| Open Japanese LLM - EL | 39.24 | Score (%) | 17.1 |
| Open Japanese LLM - Wikicorpus E TO J Comet Wmt22 | 68 | Score (%) | 17.1 |
| Open Japanese LLM - Wikicorpus E TO J Bert Score JA F1 | 73.57 | Score (%) | 16.3 |
| Open Japanese LLM - Jnli Exact Match | 56.16 | Score (%) | 16.2 |
| Open Japanese LLM - ALT J TO E Comet Wmt22 | 81.6 | Score (%) | 15.6 |
| Open Japanese LLM - ALT J TO E Bert Score EN F1 | 92.37 | Score (%) | 15.4 |
Interactive version: theaggregate.ai/model?slug=sjt-2-4b-alpha · How It Works · Data refreshed daily, snapshot 2026-11-08.