Persian Fluency Bench - Safety: leaderboard

Whether Persian Fluency Bench responses stay safe while playing an everyday Iranian role. Higher is better. Source: github.com/mshojaei77/ParsiEval.

Metric: Judge Score (%, judge google/gemini-2.5-flash). Source: github.com. Saturation forecast: Around February 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 3 12B (IT)89.5#672
2Gemma 3 4B (IT)86.4#997
3Gemma 3 27B (IT)83.1#528
4Qwen 3 30B A3B 2507 Instruct81.5#492
5Qwen 3 Next 80B A3B Instruct81.5#381
6Llama 3.2 3B Instruct78#1327
7Gemini 2.5 Flash77.3#255
8Gemma 3n E4B (IT)77#747
9Ministral 3B75#1273
10lfm-2.2-6B68.5
11granite-4.0-h-micro67.8#1078
12LFM2 8B A1B59#1248
13Mixtral 8x7B Instruct50#1085
14Qwen 3 4B34.2#834

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=persian-fluency-bench-safety · How It Works · Data refreshed daily, snapshot 2026-11-05.