mergekit-ties-dvjxpbu: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1545 ± 35, rank #1762 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - CG | 64.46 | Score (%) | 96.6 |
| Open Japanese LLM - Mbpp Pylint Check | 98.19 | Score (%) | 94.6 |
| Open Japanese LLM - Wiki Coreference SET F1 | 7.83 | Score (%) | 84.9 |
| Open Japanese LLM Leaderboard | 65.11 | Average Score (%) | 84 |
| Open Japanese LLM - Jemhopqa Char F1 | 58.94 | Score (%) | 78.8 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 70.14 | Score (%) | 78.5 |
| Open Japanese LLM - Wiki Dependency SET F1 | 37.91 | Score (%) | 75 |
| Open Japanese LLM - MT | 84.66 | Score (%) | 74.2 |
| Open Japanese LLM - Jnli Exact Match | 85.87 | Score (%) | 73.9 |
| Open Japanese LLM - Wikicorpus J TO E Comet Wmt22 | 75.82 | Score (%) | 73.7 |
| Open Japanese LLM - Xlsum JA RougeLsum | 24.45 | Score (%) | 72.4 |
| Open Japanese LLM - Jsick Exact Match | 82.06 | Score (%) | 72.2 |
Interactive version: theaggregate.ai/model?slug=mergekit-ties-dvjxpbu · How It Works · Data refreshed daily, snapshot 2026-11-08.