Qwen 3.5 397B A17B (Non-reasoning): benchmark results

Qwen 3.5 397B A17B evaluated with reasoning disabled. Provider: Alibaba. Released 2026-02-16. Access: Open.

Aggregate Rating 1651 ± 9, rank #518 of 2168 rated models, from 197 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Chronicles-OCR - Mature Text Parsing0.73Paragraph-level normalized edit similarity (0-1: one minus t100
EPIC-Bench - Ground Detection51.94Navigation score (0-100) on ground detection (localizing tra100
IndustryBench - Russian2.19Final (SV) score (out of 3): mean 0-3 rubric score from a Qw100
LongDocBench - Source Relationship Recovery85Source relationship similarity (%; the model reads fixed Tex100
PerSo - Behavioral76Accuracy (%)100
Chronicles-OCR - Archaic Text Parsing0.22Paragraph-level normalized edit similarity (0-1: one minus t96.4
EPIC-Bench - Embodied Compositional Attributes43.45Target localization score (0-100) on the embodied compositio94.3
Chronicles-OCR - Archaic Character Spotting9.7Text-spotting H-mean (0-100) of predicted character boxes wi92.9
LiT (Lost in Translation) - Humanities Abstracts71.2MQM>=80 rate (%): share of round-trip translations whose bac92.9
PerSo - Belief80.5Accuracy (%)92.9
VAMPS - Persian88.5Accuracy (%) on the original Persian versions of the 218 Kon91.2
IndustryBench - Safety and Compliance2.37Final (SV) score (out of 3): mean 0-3 rubric score from a Qw90.6

Interactive version: theaggregate.ai/model?slug=qwen-3-5-397b-a17b-non-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-20.