llm-jp-4.1-8B (High): benchmark results
Provider: Other. Released 2026-09-28. Access: Open.
Aggregate Rating 1525 ± 14, rank #971 of 2159 rated models, from 95 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| LLM-jp4.1 Release Swallow - WMT20 JA→EN | 0.21 | BLEU (source-normalized 0–1) | 92.3 |
| Nejumi 4 - BFCL - Irrelevance Detection | 93.33 | Accuracy (%) | 91.5 |
| LLM-jp4.1 Release Swallow - IFBench | 0.58 | Score (0–1) | 84.6 |
| LLM-jp4.1 Release Swallow - HumanEval+ @1 | 0.91 | Pass@1 (0–1) | 76.9 |
| LLM-jp4.1 Release Swallow - HumanEval+ @10 | 0.98 | Pass@10 (0–1) | 73.1 |
| LLM-jp4.1 Release Swallow - AIME 2026 @1 | 0.53 | Pass@1 (0–1) | 71.2 |
| LLM-jp4.1 Release Swallow - AIME 2026 @32 | 0.9 | Pass@32 (0–1) | 71.2 |
| LLM-jp4.1 Release Swallow - AIME 2024 @1 | 0.57 | Pass@1 (0–1) | 69.2 |
| LLM-jp4.1 Release Swallow - AIME 2025 @1 | 0.47 | Pass@1 (0–1) | 69.2 |
| LLM-jp4.1 Release Swallow - JEMHopQA | 0.63 | Score (0–1) | 69.2 |
| LLM-jp4.1 Release Swallow - MIFEval JA | 0.73 | Score (0–1) | 67.3 |
| Nejumi 4 - MT-Bench (Japanese) - Coding | 99 | Judge rating (1-10, x10) | 67.3 |
Interactive version: theaggregate.ai/model?slug=llm-jp-4-1-8b-high · How It Works · Data refreshed daily, snapshot 2026-10-18.