Qwen 3 235B A22B 2507 Instruct: benchmark results

Dedicated direct-answer checkpoint from the July Qwen3 update. Unlike the original hybrid release, it does not emit thinking blocks; the update targets instruction following and tool use. Provider: Alibaba. Released 2025-07-21. Access: Open.

Aggregate Rating 1656 ± 5, rank #300 of 1656 rated models, from 1051 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BhashaBench - Ayur - Hindi54.78Accuracy (%)100
BhashaBench - Legal76.68Accuracy (%)100
BhashaBench - Legal - English80.15Accuracy (%)100
CVDP-ECov (Agentic)69.9Coverage pass rate (%): share of the 83 hardware repositorie100
Drift-Bench (Service-Oriented, No Clarification) - Expression75.33Success rate (%; 150 StableToolBench G1 API tasks with an ex100
Drift-Bench (Service-Oriented, No Clarification) - Parameter67Success rate (%; 150 StableToolBench G1 API tasks with a par100
Drift-Bench (State-Oriented, No Clarification) - Intention56.16Success rate (%; 200 AgentBench operating-system and databas100
Drift-Bench (State-Oriented, With Clarification) - Expression70.17Success rate (%; 200 AgentBench operating-system and databas100
Drift-Bench (State-Oriented, With Clarification) - Intention66.67Success rate (%; 200 AgentBench operating-system and databas100
Drift-Bench (State-Oriented, With Clarification) - Premise68.67Success rate (%; 200 AgentBench operating-system and databas100
Galileo Agent - Insurance Accuracy74Accuracy (%)100
Kaggle ITBench - FinOps73.33Score (%)100

Interactive version: theaggregate.ai/model?slug=qwen-3-235b-a22b-2507-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.