GPT-OSS-Swallow-20B-RL-v0.1 (Thinking): benchmark results
Provider: Institute of Science Tokyo. Released 2026-02-20. Access: Open.
Aggregate Rating 1565 ± 15, rank #828 of 2170 rated models, from 101 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Nejumi 4 - BFCL - Non-Live AST | 81.48 | Accuracy (%) | 92 |
| Swallow - Post-trained English - MATH-500 | 98.4 | Accuracy (%) | 89.6 |
| Nejumi 4 - MT-Bench (Japanese) - Extraction | 97.5 | Judge rating (1-10, x10) | 89.2 |
| Swallow - English MT-Bench - Coding | 80.2 | Judge Score (normalized, %) | 86.6 |
| Swallow - Post-trained English - LiveCodeBench | 66.5 | Pass@1 (%) | 86.6 |
| Nejumi 4 - BFCL - Live AST | 73.15 | Accuracy (%) | 83.3 |
| Nejumi 4 - jaster (2-shot) - JSICK | 83 | Exact match (%) | 82.3 |
| Swallow - Post-trained English - AIME | 85.4 | Accuracy (%) | 82.1 |
| Swallow - Post-trained Japanese - PolyMath High and Top | 53.6 | Accuracy (%) | 82.1 |
| Nejumi 4 - jaster (0-shot) - JaMP | 75 | Exact match (%) | 78.5 |
| Swallow - Japanese MT-Bench - Reasoning | 79.3 | Judge Score (normalized, %) | 77.6 |
| Swallow - Post-trained English - Average | 75.2 | Average Score (%) | 76.9 |
Interactive version: theaggregate.ai/model?slug=gpt-oss-swallow-20b-rl-v0-1-thinking · How It Works · Data refreshed daily, snapshot 2026-11-05.