ArmBench-LLM - POS: leaderboard

ArmBench-LLM category: Armenian part-of-speech tagging accuracy, evaluated with Metric AI Lab's lighteval fork. 0-100, higher is better; several otherwise capable models score at or near 0.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around February 2027. 27 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 31B (IT)80#178
2Claude Sonnet 477#207
3GLM-577#149
4Gemini 2.5 Flash76#255
5Gemini 2.5 Pro75#159
6GPT-5.4 Mini75#228
7Gemini 3 Flash (Preview)75#90
8Gemini 3 Pro (Preview)74#71
9Qwen 3.5 27B74#192
10Gemini 3.1 Pro (Preview)73#64
11Claude 3.7 Sonnet72#259
12Grok 4.1 Fast72#227
13Grok 4 Fast71#266
14GPT-5.2 Pro70#70
15GLM-4.7 Flash67#543

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=armbench-llm-pos · How It Works · Data refreshed daily, snapshot 2026-11-05.