Qwen-3-Swallow-8B-CPT-v0.2: benchmark results

Provider: Alibaba.

Aggregate Rating 1500 ± 34, rank #2361 of 10916 rated models, from 35 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Swallow - Post-trained Japanese - WMT20 En-Ja23BLEU38.8
Swallow - Post-trained Japanese - WMT20 Ja-En20.6BLEU35.8
Swallow - Post-trained English - IFBench30.8Instruction-Level Strict Accuracy (%)34.3
Swallow - Post-trained Japanese - PolyMath High and Top20.8Accuracy (%)34.3
Swallow - Japanese MT-Bench - Roleplay60.9Judge Score (normalized, %)31.3
Swallow - Post-trained English - LiveCodeBench34.2Pass@1 (%)31.3
Swallow - Post-trained Japanese - GPQA45.3Accuracy (%)31.3
Swallow - Post-trained Japanese - JHumanEval82.3Pass@1 (%)31.3
Swallow - Post-trained English - AIME40Accuracy (%)30.6
Swallow - Post-trained English - Average54.6Average Score (%)29.9
Swallow - Post-trained Japanese - MMLU-ProX63.6Accuracy (%)29.9
Swallow - Post-trained English - GPQA Diamond49.6Accuracy (%)28.4

Interactive version: theaggregate.ai/model?slug=qwen-3-swallow-8b-cpt-v0-2 · How It Works · Data refreshed daily, snapshot 2026-11-08.