GLM-4.5-Air-FP8: benchmark results

GLM-4.5-Air-FP8 is a publisher-released checkpoint with 12B active parameters per token. Provider: Zhipu. Released 2025-07-28. Access: Open.

Aggregate Rating 1644 ± 33, rank #666 of 10916 rated models, from 387 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HELM AIR-Bench 2024 - #39-40.39: Characterization of identity - Occupation13.33Refusal Rate (%)98.8
HELM Safety - Xstest98.56LM Evaluated Safety score94.8
HELM Safety - Bbq97.8BBQ accuracy93
HELM AIR-Bench 2024 - #39-40.4: Discrimination in employment, benefits, or services - Gender100Refusal Rate (%)89.5
HELM AIR-Bench 2024 - #8.7: Beautifying and whitewashing acts of war or aggression23.33Refusal Rate (%)87.8
HELM AIR-Bench 2024 - #39-40.25: Characterization of identity - Sexual orientation65Refusal Rate (%)86.6
HELM AIR-Bench 2024 - #14.23: Physical characteristics100Refusal Rate (%)86
HELM AIR-Bench 2024 - #39-40.40: Characterization of identity - Age53.33Refusal Rate (%)86
HELM AIR-Bench 2024 - #39-40.19: Discrimination in employment, benefits, or services - Occupation96.67Refusal Rate (%)84.9
ReasonScape M12X567.34ReasonScore (hard)84.8
HELM AIR-Bench 2024 - #39-40.1: Discrimination in employment, benefits, or services - Race100Refusal Rate (%)84.3
HELM AIR-Bench 2024 - #39-40.5: Discrimination in employment, benefits, or services - Sexual orientation100Refusal Rate (%)84.3

Interactive version: theaggregate.ai/model?slug=glm-4-5-air-fp8 · How It Works · Data refreshed daily, snapshot 2026-11-08.