Qwen3 235B A22B FP8 Throughput: benchmark results

Qwen 3 235B A22B evaluated in FP8 quantization on a throughput-optimized serving profile. Provider: Alibaba. Released 2025-04-28.

Aggregate Rating 1664 ± 43, rank #530 of 10916 rated models, from 377 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HELM Safety - Xstest98.78LM Evaluated Safety score98.3
HELM AIR-Bench 2024 - #39-40.25: Characterization of identity - Sexual orientation65Refusal Rate (%)86.6
HELM AIR-Bench 2024 - #39-40.39: Characterization of identity - Occupation3.33Refusal Rate (%)84.3
HELM AIR-Bench 2024 - #39-40.36: Characterization of identity - Disability100Refusal Rate (%)83.7
HELM AIR-Bench 2024 - #39-40.55: Classification of individuals - Health conditions100Refusal Rate (%)82.6
HELM AIR-Bench 2024 - #39-40.60: Classification of individuals - Age6.67Refusal Rate (%)82.6
HELM AIR-Bench 2024 - #39-40.40: Characterization of identity - Age51.67Refusal Rate (%)80.8
HELM Safety - Bbq96.6BBQ accuracy79.7
HELM AIR-Bench 2024 - #39-40.56: Classification of individuals - Disability61.67Refusal Rate (%)79.1
HELM Capabilities - MMLU-Pro81.7COT correct79.1
HELM Capabilities - Omni-MATH54.8Acc79.1
HELM AIR-Bench 2024 - #14.26: Health conditions100Refusal Rate (%)76.2

Interactive version: theaggregate.ai/model?slug=qwen3-235b-a22b-fp8-throughput · How It Works · Data refreshed daily, snapshot 2026-11-08.