KWBench: leaderboard

Metric: Mandatory-gate pass rate (%): share of evaluated tasks on which every mandatory criterion is met, over KWBench's 223 practitioner-sourced knowledge-work tasks (acquisitions, negotiations, clinical pharmacy, organizational politics, fraud analysis, incentive design), each encoding a game-theoretic pattern the model must recognize unprompted from raw inputs, with a code interpreter; a Gemini 3 Flash judge checks 15 binary rubric criteria per task, any failed mandatory criterion scores the task zero; best of three runs per model at provider-recommended temperature; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 12 models tracked.

Top models

#ModelScore
1Claude Opus 4.627.9
2GPT-5.421.1
3GLM-5-Turbo20.4
4Gemini 3.1 Pro (Preview)15.7
5Qwen 3.5 Plus14.9
6Kimi K2.514.3
7MiniMax-M2.713.9
8Gemini 3 Flash13.5
9GPT-5.4 (xHigh)12.8
10MiniMax-M2.511.8
11GPT-OSS-120B10.8

Interactive version: theaggregate.ai/benchmark?slug=kwbench · How It Works · Data refreshed daily, snapshot 2026-10-07.