Qwen 3 4B 2507 Instruct: benchmark results

Dedicated direct-answer checkpoint from the July Qwen3 update. Does not emit thinking blocks; post-training targets instruction following, tool use and multilingual knowledge. Provider: Alibaba. Released 2025-08-06. Access: Open.

Aggregate Rating 1510 ± 8, rank #747 of 1635 rated models, from 671 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Industrial-Instruction Panasonic QA28.5Set-match accuracy (%; share of the 1,000 held-out multi-sel100
Kurakurai French LLM - AIME 202538Accuracy (%)100
Kurakurai French LLM - MATH-50092.46Accuracy (%)100
Kurakurai French LLM - MBPP76.03pass@1 (%)100
Kurakurai French LLM - MGSM93.08Accuracy (%)100
Kurakurai French LLM - MultiIF71.35Accuracy (%)100
Plan-RewardBench - Multi-Turn Planning (Easy)75Pairwise accuracy (%) on the 109 easy multi-turn planning pa100
SAHARA - Paraphrase36.29spBLEU-1K100
SciEval (K-12) - Evidence Match Rate36.04Evidence match rate (%): share of predicted evidence sentenc100
SciEval (K-12) - Macro-F129.5Macro-F1 (%) of the predicted criterion score (0 not address100
SciEval (K-12) - Quadratic Weighted Kappa16.23Quadratic weighted kappa (x100, -100 to 100) between the pre100
Kurakurai French LLM - AIME 202453.33Accuracy (%)97.6

Interactive version: theaggregate.ai/model?slug=qwen-3-4b-2507-instruct · How It Works · Data refreshed daily, snapshot 2026-10-15.