Persian Fluency Bench - Grammar: leaderboard

The grammar dimension of the Persian Fluency Bench judge rubric. Higher is better. Source: github.com/mshojaei77/ParsiEval.

Metric: Judge Score (%, judge google/gemini-2.5-flash). Source: github.com. Saturation forecast: Estimated already saturated. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash58.6#255
2Gemma 3 12B (IT)56.1#672
3Qwen 3 Next 80B A3B Instruct51.8#381
4Gemma 3 27B (IT)50.2#528
5Qwen 3 30B A3B 2507 Instruct49.8#492
6Gemma 3 4B (IT)48.5#997
7Gemma 3n E4B (IT)45.1#747
8granite-4.0-h-micro14.9#1078
9Qwen 3 4B10#834
10Llama 3.2 3B Instruct9.3#1327
11Ministral 3B8.4#1273
12Mixtral 8x7B Instruct6.3#1085
13lfm-2.2-6B4.1
14LFM2 8B A1B3.9#1248

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=persian-fluency-bench-grammar · How It Works · Data refreshed daily, snapshot 2026-11-05.