glm-4-9B: benchmark results

Zhipu AI's GLM-4-9B, the base pretrained checkpoint in the GLM-4 series, supporting an 8K context window; a separate GLM-4-9B-Chat instruction-tuned version also exists. Provider: Zhipu. Released 2024-06-05. Access: Open.

Aggregate Rating 1470 ± 13, rank #889 of 1656 rated models, from 105 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SalesLLM - Chinese (CustomerLM User)7.14SalesLLM benchmark score (1-10): 0.5 x buying-intent score (100
Open PL LLM - PSC (generative, 5-shot)98.94Binary F1 (%)99.4
Open Portuguese LLM - FaQuAD NLI83.14Macro F1 (%)96.2
Open PL LLM - PPC (multiple choice, 5-shot)79.8Accuracy (%)92.3
Open PL LLM - PoQuAD Open Book (generative, 5-shot)71.22Levenshtein Similarity (%)90.8
Open Portuguese LLM - ASSIN2 RTE93.34Macro F1 (%)88.8
Open Portuguese LLM - OAB Exams55.95Accuracy (%)88.6
Open Portuguese LLM - BLUEX64.53Accuracy (%)85
Open Portuguese LLM - ENEM73.27Accuracy (%)84.7
Open PL LLM - PolQA Reranking (multiple choice, 5-shot)80.61Accuracy (%)84.3
PilotBench - Instruction Following96.45Instruction-following score (%): 0.5 x field completeness pl83.3
Open PL LLM - RAG71.01Average RAG Score (%)80.4

Interactive version: theaggregate.ai/model?slug=glm-4-9b · How It Works · Data refreshed daily, snapshot 2026-10-20.