GPT-OSS-Swallow-20B-SFT-v0.1: benchmark results

Provider: OpenAI. Access: API.

Aggregate Rating 1583 ± 36, rank #1217 of 10916 rated models, from 35 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Swallow - Japanese MT-Bench - Coding80.9Judge Score (normalized, %)84.3
Swallow - Japanese MT-Bench - Reasoning77.7Judge Score (normalized, %)73.1
Swallow - Post-trained English - LiveCodeBench58.9Pass@1 (%)73.1
Swallow - Japanese MT-Bench - Math97.6Judge Score (normalized, %)70.9
Swallow - Post-trained English - IFBench48.8Instruction-Level Strict Accuracy (%)70.1
Swallow - English MT-Bench - Reasoning84.1Judge Score (normalized, %)67.2
Swallow - Japanese MT-Bench - Average73.1Judge Score (normalized, %)65.7
Swallow - Post-trained English - GPQA Diamond64.8Accuracy (%)65.7
Swallow - Post-trained English - Average70.5Average Score (%)64.2
Swallow - Post-trained Japanese - WMT20 En-Ja24.6BLEU64.2
Swallow - Post-trained Japanese - JamC-QA52.1Accuracy (%)63.4
Swallow - Japanese MT-Bench - Roleplay68Judge Score (normalized, %)62.7

Interactive version: theaggregate.ai/model?slug=gpt-oss-swallow-20b-sft-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.