Confucius-o1-14B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1564 ± 33, rank #1501 of 10916 rated models, from 56 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - MATH Level 5 | 43.13 | Score | 92.3 |
| Open LLM Leaderboard - MMLU-Pro | 52.65 | Score | 91.7 |
| Open LLM Leaderboard - GPQA | 36.49 | Score | 91.6 |
| Open Japanese LLM - SUM | 11.51 | Score (%) | 89.4 |
| Open Japanese LLM - Xlsum JA Rouge2 | 11.51 | Score (%) | 89.4 |
| Open Japanese LLM - Xlsum JA RougeLsum | 26.69 | Score (%) | 88.7 |
| Open Japanese LLM - Xlsum JA Rouge1 | 31.56 | Score (%) | 87 |
| Open LLM Leaderboard - BBH | 63 | Score | 86.7 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 70.43 | Score (%) | 85.6 |
| Open Japanese LLM - Jnli Exact Match | 87.1 | Score (%) | 85.3 |
| Open Japanese LLM - RC | 91.68 | Score (%) | 84.1 |
| Open Japanese LLM - Wiki Coreference SET F1 | 6.95 | Score (%) | 81.2 |
Interactive version: theaggregate.ai/model?slug=confucius-o1-14b · How It Works · Data refreshed daily, snapshot 2026-11-08.