Condesion-Bench: leaderboard

Condesion-Bench (2026) evaluates conditional decision-making in a compositional action space: for one trading day an LLM allocates quantities across 15 S&P 500 stocks under variable, contextual and allocation conditions, and its single zero-shot action is checked against the conditions. This board is the decision satisfaction rate in percent, the share of actions that satisfy all of their conditions, over trading days from October 2024 to September 2025; higher is better.

Metric: Decision Satisfaction Rate (%, from a 0-1 share times 100): share of actions that satisfy all their conditions, of the single action an LLM generates zero-shot (temperature 0, JSON output) on the 251 Condesion-Bench instances (one per trading day, October 2024 to September 2025: allocate a budget over 15 S&P 500 stocks under variable, contextual and allocation conditions); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-5 Mini (2025-08-07)91.24#352
2GPT-589.24#185
3O3 (2025-04-16)88.84#238
4O4 Mini (2025-04-16)86.06#375
5GPT-OSS-120B75.3#712
6GPT-OSS-20B70.52#1188
7Claude 3.5 Sonnet (20241022)63.75#651
8Claude 3.5 Haiku57.37#1597
9GPT-4.1 Mini52.99#799
10Mistral Large 2 (Jul)51.4#1164
11GPT-4.151.39#506
12Llama 3.3 70B Instruct46.22#1394
13Mistral Small 3.233.07#1647
14Gemini 2.0 Flash (001)32.27#733
15Gemini 2.0 Flash Lite (001)28.69#1122

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=condesion-bench · How It Works · Data refreshed daily, snapshot 2026-11-22.