ArmBench-LLM - Reading Comprehension: leaderboard

ArmBench-LLM category: Armenian reading comprehension, the mean of five tasks: SQuAD and MS MARCO scored by BLEU (divided by 100 before averaging) and Belebele, DREAM and Hartak public-services multiple choice scored by accuracy. 0-100, higher is better.

Metric: Mean of accuracy and BLEU tasks (0-100). Source: huggingface.co. Saturation forecast: Around April 2028. 27 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 Mini62.28#228
2GPT-5.2 Pro60.96#70
3Qwen 3.5 27B60.65#192
4Grok 4 Fast60.37#266
5Claude 3.7 Sonnet59.66#259
6Gemini 3 Pro (Preview)59.01#71
7Gemini 2.5 Pro58.99#159
8Gemma 4 31B (IT)58.43#178
9GLM-4.7 Flash58.17#543
10GPT-5.4 Nano56.47#359
11Gemini 3.1 Pro (Preview)54.12#64
12Claude Sonnet 453.25#207
13Gemini 3 Flash (Preview)52.54#90
14GLM-552.52#149
15Qwen 3.5 35B A3B52.08#268

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=armbench-llm-reading-comprehension · How It Works · Data refreshed daily, snapshot 2026-11-05.