Qwen3-Coder Original Chart - Multi-SWE-bench flash: leaderboard
Original Qwen3-Coder-30B-A3B-Instruct model-card chart, native six-model comparison. The exact same chart is mirrored by the FP8 card, but its headers identify unqualified 30B-A3B-Instruct and 480B-A35B-Instruct checkpoints; no FP8 or BF16 evaluation precision is stated. The decorative Qwen3-Coder-Flash title does not replace the explicit checkpoint column labels. SWE-bench Verified OpenHands 500-turn, OpenHands 100-turn and private-scaffolding rows stay separate. Private scaffolding does not establish a common implementation across models; those implementations are unreported. For other outcomes the chart supplies no common harness commit, effort, sampling, token budget, benchmark subset/revision or repeat count; none is inferred. BFCL explicitly uses v3. Native chart values are percentage-scale task results; missing cells remain absent. Existing Aider and LLMStats rows have different or unbound protocols/cohorts; matching numbers alone do not establish interchangeable runs or authority to overwrite them. Native outcome: Multi-SWE-bench flash. Metric: Native task result (%).
Metric: Native task result (%). Source: huggingface.co. Saturation forecast: Around December 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3 Coder 480B A35B Instruct | 27 | #308 |
| 2 | Claude Sonnet 4 | 25 | #203 |
| 3 | Kimi K2 | 20.7 | #245 |
| 4 | Qwen 3 Coder 30B A3B Instruct | 19.3 | #391 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=qwen3-coder-original-chart-multi-swe-bench-flash · How It Works · Data refreshed daily, snapshot 2026-10-27.