calm3-22B-chat: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1534 ± 30, rank #1904 of 10916 rated models, from 64 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - AIO Char F1 | 84.33 | Score (%) | 93.3 |
| Open Japanese LLM - Niilc Char F1 | 64.89 | Score (%) | 93.3 |
| Open Japanese LLM - ALT E TO J Comet Wmt22 | 91.17 | Score (%) | 93 |
| pfgen-bench - Completion Mode - Fluency | 0.82 | Fluency Score | 93 |
| pfgen-bench - Completion Mode - Truthfulness | 0.92 | Truthfulness Score | 93 |
| pfgen-bench - Completion Mode - Score | 0.72 | pfgen Score (mean of three) | 92.3 |
| pfgen-bench - Completion Mode - Helpfulness | 0.43 | Helpfulness Score | 91.4 |
| Open Japanese LLM - ALT E TO J Bert Score JA F1 | 87.05 | Score (%) | 90.6 |
| Open Japanese LLM - Xlsum JA RougeLsum | 26.85 | Score (%) | 89.7 |
| Open Japanese LLM - QA | 66.77 | Score (%) | 89.2 |
| Open Japanese LLM - Xlsum JA Rouge1 | 31.92 | Score (%) | 88.5 |
| pfgen-bench - QA Mode - Fluency | 0.81 | Fluency Score | 88.5 |
Interactive version: theaggregate.ai/model?slug=calm3-22b-chat · How It Works · Data refreshed daily, snapshot 2026-11-08.