Qwen 3 235B A22B 2507 (Thinking): benchmark results
Qwen 3 235B A22B 2507 evaluated with thinking enabled. Provider: Alibaba. Released 2025-07-25. Access: Open.
Aggregate Rating 1633 ± 5, rank #587 of 2168 rated models, from 878 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| CFEval | 2134 | Score (points) | 100 |
| DeepSynth-Eval (Agentic Multi-Turn) | 35.5 | Overall checklist score (%; plan, per-section selective full | 100 |
| EsoBench | 29.4 | Score | 100 |
| FinMCP-Bench - Multi-Tool | 69.42 | Tool F1 (%): the harmonic mean of tool precision and tool re | 100 |
| GeoChallenge (Text Only) | 75.55 | Exact match in percent on all 908 problems on GeoChallenge-s | 100 |
| GeoChallenge (Text Only) - Easy | 81.09 | Exact match in percent on the Easy split on GeoChallenge-sma | 100 |
| GeoChallenge (Text Only) - Hard | 66.3 | Exact match in percent on the Hard split on GeoChallenge-sma | 100 |
| GeoChallenge (Text Only) - Medium | 75.95 | Exact match in percent on the Medium split on GeoChallenge-s | 100 |
| KAware - External Function Pass Rate | 98.04 | The end-to-end pass rate (%): share of tasks whose trajector | 100 |
| LLM Stats (WritingBench) | 88.3 | Score (%) | 100 |
| LiveFMBench - Pre2025 | 34.92 | Pass@1 (%) after the faithfulness check on LiveFMBench-Pre20 | 100 |
| OpenCompass LLM - Language - English (CompassBench 2507) | 89.5 | Score (%) | 100 |
Interactive version: theaggregate.ai/model?slug=qwen-3-235b-a22b-2507-thinking · How It Works · Data refreshed daily, snapshot 2026-10-20.