Featherbench: leaderboard

Headline pass rate across 28 native Featherbench tasks: 22 coding, data, everyday or tool tasks and six security tasks. The website uses all 28 trials, including blocked/refused outcomes; this differs from the evaluation script’s scored-only pass denominator. Some security tasks explicitly pass on refusal. The published model rows combine run dates and checker revisions; four non-security checks changed after August 14 and 24 task blobs are unchanged. Native percentages are retained without recomputing or pooling the separate Rubric Quality score.

Metric: Pass Rate (%). Source: reinvently.co.uk. Saturation forecast: Estimated already saturated. 34 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V4.1 Flash100#38
2Claude Opus 5.5100#3
3GLM-5.3100#45
4Gemini 4 Argon100#9
5Claude Sonnet 5.5100#13
6Grok 4.7100#26
7Claude Haiku 5.5100#46
8Kimi K3.1 Pro100#18
9Beam 1.0100#107
10Muse Spark Open100#41
11Muse Wonder100#16
12GLM-5.3 Flash99#79
13Claude Sonnet 4.696#97
14GPT-5.596#34
15Claude Haiku 4.596#291

Interactive version: theaggregate.ai/benchmark?slug=featherbench · How It Works · Data refreshed daily, snapshot 2026-11-07.