Condesion-Bench - Allocation Conditions: leaderboard

Metric: Satisfaction rate (%) of allocation conditions (limits on quantities and budget), of the single action an LLM generates zero-shot (temperature 0, JSON output) on the 251 Condesion-Bench instances (one per trading day, October 2024 to September 2025: allocate a budget over 15 S&P 500 stocks under variable, contextual and allocation conditions); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 16 models tracked.

Top models

#ModelScore
1GPT-5100
2GPT-5 Mini100
3O3 (2025-04-16)99.6
4O4 Mini (2025-04-16)98.01
5GPT-OSS-20B91.63
6GPT-OSS-120B87.65
7Mistral Large 2 (Jul)82.47
8GPT-4.1 Mini71.31
9Claude 3.5 Haiku71.31
10Claude 3.5 Sonnet (20241022)70.92
11Llama 3.3 70B Instruct69.72
12GPT-4.169.72
13Gemini 2.0 Flash (001)63.35
14Gemini 2.0 Flash Lite (001)45.42
15Mistral Small 3.245.02

Interactive version: theaggregate.ai/benchmark?slug=condesion-bench-allocation-conditions · How It Works · Data refreshed daily, snapshot 2026-10-07.