Antler-7B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1352 ± 36, rank #7644 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Xlsum JA Rouge1 | 27.05 | Score (%) | 61.2 |
| Open Japanese LLM - Xlsum JA RougeLsum | 22.82 | Score (%) | 59.1 |
| Open Japanese LLM - Mbpp Pylint Check | 38.15 | Score (%) | 53.4 |
| Open Japanese LLM - SUM | 9.56 | Score (%) | 48 |
| Open Japanese LLM - Xlsum JA Rouge2 | 9.55 | Score (%) | 47.6 |
| Open Japanese LLM - CG | 3.41 | Score (%) | 43.5 |
| Open Japanese LLM - Xlsum JA Bleu JA | 2.46 | Score (%) | 42.5 |
| Open Japanese LLM - AIO Char F1 | 46.21 | Score (%) | 36.5 |
| Open Japanese LLM - Wiki NER SET F1 | 2.65 | Score (%) | 33.5 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 67.63 | Score (%) | 31.7 |
| Open Japanese LLM - QA | 42.17 | Score (%) | 30.3 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 87.56 | Score (%) | 29.8 |
Interactive version: theaggregate.ai/model?slug=antler-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.