OpenEval - IFEval Strict: leaderboard

Human-Centered Eval OpenEval strict IFEval score for following verifiable natural-language instructions.

Metric: Strict Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 1.5 32B Chat54.34#2379
2Qwen 1.5 14B Chat45.44#2974
3Qwen-14B-Chat42.3#4967
4Qwen 1.5 7B Chat41.53#6361
5Qwen 2 1.5B Instruct36.2#7855
6Qwen 1.5 4B Chat31.98#8077
7Qwen 1.5 1.8B Chat22.43#9053
8Qwen 1.5 0.5B Chat18.76#9551

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=openeval-ifeval-strict · How It Works · Data refreshed daily, snapshot 2026-11-13.