ArmBench-LLM v2 - Overall: leaderboard
ArmBench-LLM 5-category edition (Metric AI Lab, Yerevan; 2026-11-20 reorganization): Armenian-language benchmark run with Metric's lighteval fork, regrouping the 24 tasks into five equal-weight categories (Knowledge, Reading, Analysis, Generation, Correction). Unweighted mean of the five category scores (BLEU/100, national exams / 20), 0-100, higher is better. The site excludes Claude 4.5 and 4.6 models, citing evaluation reliability issues.
Metric: Mean of 5 category scores (0-100; BLEU/100, exams/20). Source: huggingface.co. Saturation forecast: Around December 2027. 32 models tracked. Updated 22 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6.1 Sol | 65.14 | #15 |
| 2 | DeepSeek V4.1 Flash | 62.86 | #69 |
| 3 | Ayb-0.5-9B | 61.64 | |
| 4 | GPT-5.2 Pro | 60.17 | #139 |
| 5 | Gemini 3 Flash (Preview) | 59.51 | #156 |
| 6 | Claude 3.7 Sonnet | 59.1 | #455 |
| 7 | Gemma 4 31B (IT) | 58.71 | #354 |
| 8 | Ayb-0.5-4B | 58.28 | |
| 9 | Grok 4 Fast | 57.88 | #446 |
| 10 | Gemini 2.5 Flash | 57.35 | #466 |
| 11 | Claude Sonnet 4 | 57.29 | #414 |
| 12 | Gemini 3 Pro (Preview) | 56.65 | #123 |
| 13 | GPT-5.4 Mini | 56.12 | #409 |
| 14 | Qwen 3.5 27B | 55.03 | #380 |
| 15 | Grok 4.1 Fast | 54.6 | #431 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=armbench-llm-v2-overall · How It Works · Data refreshed daily, snapshot 2026-11-22.