Qwen3.8-27B-NVFP4: benchmark results

Provider: Alibaba. Access: Open.

Aggregate Rating 1701 ± 25, rank #194 of 1635 rated models, from 28 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
llmbenchmarks.io Local GPU - IFBench69.77Instruction-level strict accuracy (%)100
llmbenchmarks.io Local GPU - IFEval92.79Prompt-level strict accuracy (%)95.7
BenCzechMark - Reading Comprehension76.5Duel Win Score (%)93.6
llmbenchmarks.io Local GPU - ARC-AGI-1 Public Eval12.38pass@2 on the public evaluation set (%)90.9
llmbenchmarks.io Local GPU - SciCode35.65Subproblems solved (%), pass@1 averaged over 3 epochs81.8
BenCzechMark - Czech Language Understanding66.67Duel Win Score (%)79.5
BenCzechMark - Czech Math Reasoning62.5Duel Win Score (%)75.6
BenCzechMark - NER72.44Duel Win Score (%)73.1
llmbenchmarks.io Local GPU - Chess Puzzles5Puzzles solved (%), exact match72.7
BenCzechMark63.56Average Duel Win Score (%)70.5
BenCzechMark - Factual Knowledge60.26Duel Win Score (%)70.5
llmbenchmarks.io Local GPU - SimpleQA Verified8.5Correct answers (%) of 1,000 questions69.6

Interactive version: theaggregate.ai/model?slug=qwen3-8-27b-nvfp4 · How It Works · Data refreshed daily, snapshot 2026-11-05.