ArmBench-LLM - Generation: leaderboard

Metric: BLEU (0-100). Source: huggingface.co. 27 models tracked.

Top models

#ModelScore
1Gemini 2.5 Flash14.37
2Claude 3.7 Sonnet12.89
3GPT-5.4 Mini12.13
4Claude Sonnet 411.8
5GPT-5.4 Nano11.52
6Grok 4.1 Fast11.32
7Gemma 3 12B (IT)11.31
8GPT-5.2 Pro11.08
9Gemma 4 31B (IT)10.87
10Grok 4 Fast10.72
11Gemma 3 27B (IT)10.19
12GLM-59.93
13Mistral Large 39.7
14GLM-4.7 Flash9.52
15Gemini 3 Pro (Preview)9.42

Interactive version: theaggregate.ai/benchmark?slug=armbench-llm-generation · How It Works · Data refreshed daily, snapshot 2026-09-19.