Qwen 3 4B 2507 (Thinking): benchmark results

Qwen 3 4B 2507 evaluated with thinking enabled. Provider: Alibaba. Released 2025-08-06. Access: Open.

Aggregate Rating 1510 ± 9, rank #1037 of 2168 rated models, from 498 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Slovak NLU - UNER SK73.36Micro F1 excluding MISC (%)100
FinMCP-Bench - Multi-Turn47.65Tool F1 (%): the harmonic mean of tool precision and tool re100
FinMCP-Bench - Single-Tool68.55Tool F1 (%): the harmonic mean of tool precision and tool re100
htkgh-polecat (Entity-Filtered History)40.6Relation prediction accuracy (%; choose the relation of a he100
EuroEval German NLU - GermEval78.27Micro F1 excluding MISC (%)99.4
EuroEval Dutch NLU - CoNLL NL80.14Micro F1 excluding MISC (%)98.8
EuroEval Italian NLU - MultiNERD IT87.46Micro F1 excluding MISC (%)98.8
EuroEval Spanish NLU60.1NLU Average Score (%)97.3
EuroEval Latvian NLU - Fullstack NER LV73.2Micro F1 excluding MISC (%)97
EuroEval Ukrainian NLU - NER UK79.05Micro F1 excluding MISC (%)97
MERA Code - ruHumanEval78.11pass@1 (%)96.9
EuroEval Norwegian NLU - NorNE NB86.13Micro F1 excluding MISC (%)96.7

Interactive version: theaggregate.ai/model?slug=qwen-3-4b-2507-thinking · How It Works · Data refreshed daily, snapshot 2026-10-20.