llm-jp-4.1-32B-a3B (High): benchmark results

Provider: Other. Released 2026-09-28. Access: Open.

Aggregate Rating 1546 ± 14, rank #894 of 2159 rated models, from 95 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LLM-jp4.1 Release Swallow - MIFEval JA0.8Score (0–1)98.1
Nejumi 4 - jaster (2-shot) - MAWPS99Exact match (%)96.8
Nejumi 4 - BFCL - Irrelevance Detection93.33Accuracy (%)91.5
LLM-jp4.1 Release Swallow - AIME 2026 @320.93Pass@32 (0–1)84.6
LLM-jp4.1 Release Swallow - AIME 2024 @10.64Pass@1 (0–1)82.7
LLM-jp4.1 Release Swallow - GPQA Diamond @10.6Pass@1 (0–1)82.7
LLM-jp4.1 Release Swallow - JHumanEval @10.91Pass@1 (0–1)82.7
LLM-jp4.1 Release Swallow - MCLM Math 100 @40.98Pass@4 (0–1)82.7
LLM-jp4.1 Release Swallow - MMLU-ProX EN0.75Score (0–1)82.7
Nejumi 4 - jaster (0-shot) - CommonsenseMoralJA96Exact match (%)82.7
LLM-jp4.1 Release Swallow - Math 5000.93Score (0–1)80.8
LLM-jp4.1 Release Swallow - JEMHopQA0.64Score (0–1)78.8

Interactive version: theaggregate.ai/model?slug=llm-jp-4-1-32b-a3b-high · How It Works · Data refreshed daily, snapshot 2026-10-18.