Qwen 3.5 397B A17B Instruct: benchmark results

Provider: Alibaba. Released 2026-02-16.

Aggregate Rating 1721 ± 33, rank #265 of 10916 rated models, from 13 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ProactBench - Emergent72.9Pass rate (%) on the Emergent triggers (turns 1-3: inferring100
ProactBench - Weighted Score60.6Weighted score (%): Pass counts 1, Partial 0.5 and Fail 0, a90
Video-MME-v2 - Level 3 Complex Reasoning (w/o subs)16.15Level 3 Score w/o sub (%)85.4
LUNAR - Curated Context3.98Personalization score (1-5; mean of coverage and depth, GPT-83.3
ProactBench - Critical63Pass rate (%) on the Critical triggers (turns 4-7: synthesis80
ProactBench - Recovery17Pass rate (%) on the Recovery triggers (turns 8-10: grounded80
LUNAR - Agentic Memory2.83Personalization score (1-5; mean of coverage and depth, GPT-77.8
LUNAR - Full Context3.54Personalization score (1-5; mean of coverage and depth, GPT-77.8
LUNAR - RAG3.05Personalization score (1-5; mean of coverage and depth, GPT-77.8
Video-MME-v235Avg Accuracy w/o sub (%)75
Video-MME-v2 - Level 2 Temporal Understanding (w/o subs)18.07Level 2 Score w/o sub (%)75
Video-MME-v2 - Non-Lin Score (w/o subs)16.9Non-Lin Score w/o sub (%)75

Interactive version: theaggregate.ai/model?slug=qwen-3-5-397b-a17b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.