Qwen3-Swallow-8B-RL-v0.2 (Thinking): benchmark results
Provider: Institute of Science Tokyo. Released 2026-02-19. Access: Open.
Aggregate Rating 1522 ± 15, rank #1012 of 2201 rated models, from 101 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Nejumi 4 - jaster (2-shot) - JSICK | 89 | Exact match (%) | 100 |
| Nejumi 4 - jaster (0-shot) - JSICK | 84 | Exact match (%) | 91.8 |
| Nejumi 4 - jaster (0-shot) - JCoLA (in-domain) | 79 | Exact match (%) | 84.6 |
| Swallow - Japanese MT-Bench - Math | 98.4 | Judge Score (normalized, %) | 82.8 |
| Nejumi 4 - jaster (0-shot) - JaNLI | 100 | Exact match (%) | 82.2 |
| Swallow - Post-trained Japanese - PolyMath High and Top | 45.6 | Accuracy (%) | 73.1 |
| Swallow - English MT-Bench - Extraction | 80.1 | Judge Score (normalized, %) | 72.4 |
| Nejumi 4 - BFCL - Relevance Detection | 77.78 | Accuracy (%) | 70.9 |
| Nejumi 4 - MT-Bench (Japanese) - STEM | 99.5 | Judge rating (1-10, x10) | 70.5 |
| Nejumi 4 - BFCL - Non-Live AST | 77.78 | Accuracy (%) | 66.4 |
| Swallow - Post-trained English - AIME | 73.3 | Accuracy (%) | 64.2 |
| Nejumi 4 - BFCL - Irrelevance Detection | 85 | Accuracy (%) | 62 |
Interactive version: theaggregate.ai/model?slug=qwen3-swallow-8b-rl-v0-2-thinking · How It Works · Data refreshed daily, snapshot 2026-11-12.