Llama 3.1 8B Swallow Openmath Dare Ties D5w5: benchmark results
Provider: Meta. Access: Open.
Aggregate Rating 1208 ± 39, rank #9573 of 10916 rated models, from 50 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Japanese LLM - Mbpp Pylint Check | 1.61 | Score (%) | 28.2 |
| Open Japanese LLM - Jsem Exact Match | 67.23 | Score (%) | 19.2 |
| Open Japanese LLM - Jamp Exact Match | 39.66 | Score (%) | 14.7 |
| Open Japanese LLM - NLI | 50.82 | Score (%) | 13.7 |
| Open Japanese LLM - CG | 0 | Score (%) | 13 |
| Open Japanese LLM - Jnli Exact Match | 55.34 | Score (%) | 12.9 |
| Open Japanese LLM - MR | 41.8 | Score (%) | 11.9 |
| Open Japanese LLM - Jsick Exact Match | 41.85 | Score (%) | 11.8 |
| Open Japanese LLM - Wiki Coreference SET F1 | 0.2 | Score (%) | 9.6 |
| Open Japanese LLM - Jmmlu Exact Match | 28.07 | Score (%) | 8.4 |
| Open Japanese LLM - Janli Exact Match | 50 | Score (%) | 7.5 |
| Open Japanese LLM - HE | 28.84 | Score (%) | 7 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-8b-swallow-openmath-dare-ties-d5w5 · How It Works · Data refreshed daily, snapshot 2026-11-08.