ABEJA-QwQ32B-Reasoning-Japanese-v1.0: benchmark results

Provider: Other.

Aggregate Rating 1611 ± 33, rank #918 of 10916 rated models, from 35 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Swallow - Post-trained Japanese - JamC-QA62.5Accuracy (%)83.6
Swallow - English MT-Bench - Coding78.8Judge Score (normalized, %)79.1
Swallow - Post-trained English - HellaSwag90.6Accuracy (%)76.1
Swallow - Post-trained English - MMLU-Pro79.8Accuracy (%)76.1
Swallow - English MT-Bench - Humanities73.6Judge Score (normalized, %)71.6
Swallow - English MT-Bench - Roleplay75.4Judge Score (normalized, %)70.1
Swallow - English MT-Bench - STEM72Judge Score (normalized, %)69.4
Swallow - English MT-Bench - Average78.5Judge Score (normalized, %)67.2
Swallow - Japanese MT-Bench - Roleplay68.6Judge Score (normalized, %)67.2
Swallow - Japanese MT-Bench - Reasoning77.2Judge Score (normalized, %)65.7
Swallow - Japanese MT-Bench - Average72.7Judge Score (normalized, %)64.2
Swallow - Japanese MT-Bench - Writing65.1Judge Score (normalized, %)64.2

Interactive version: theaggregate.ai/model?slug=abeja-qwq32b-reasoning-japanese-v1-0 · How It Works · Data refreshed daily, snapshot 2026-11-08.