Puzzle portfolio ladder
30 generated puzzles in five families: logic grids, knapsacks, document facts, specifications and bug hunts.
Run Aug 29 – Nov 13, 2026, 30 items.
Method
Six items from each of five generators whose answers are fixed by construction: zebra logic grids, knapsack optimisation, fact lookup in a long document, checking an implementation against its specification, and finding a planted bug. Difficulty rises within each family, and the bank is frozen.
Run at each provider's default reasoning effort, like the ladder above.
Results
| # | Model | Accuracy | Items |
|---|---|---|---|
| 1 | GPT-5.2 | 96.7% | 30 |
| 2 | GPT-5.5 | 96.7% | 30 |
| 3 | MiniMax-M3.1-Flash (free route) | 96.7% | 30 |
| 4 | Claude Fable 5.2 | 96.7% | 30 |
| 5 | Particle-1 (free route) | 96.7% | 30 |
| 6 | Ling 3.1 Flash | 96.3% | 27 |
| 7 | GLM-5.3 (Mistral API) | 92.9% | 28 |
| 8 | Nemotron 3.5 Super VL (free route) | 92.6% | 27 |
| 9 | Kimi K2.6 | 90.0% | 30 |
| 10 | Claude Opus 4.8 | 90.0% | 30 |
| 11 | Qwen 3.6 Plus | 86.7% | 30 |
| 12 | DeepSeek V4 Pro | 86.7% | 30 |
| 13 | ERNIE 5.5 Flash Preview (free route) | 86.2% | 29 |
| 14 | GPT-OSS-120B | 83.3% | 30 |
| 15 | Nex N2.5 Pro (free route) | 82.1% | 28 |
| 16 | Nemotron 3 Ultra (free route) | 77.8% | 27 |
| 17 | DeepSeek V4.1 Flash (1017) (Mistral API) | 76.7% | 30 |
| 18 | Gemma 4 31B (IT) (free route) | 73.3% | 30 |
| 19 | Nemotron 3 Super (free route) | 66.7% | 27 |
| 20 | Flint (free route) | 66.7% | 30 |
| 21 | Ling-3.0-flash-VL (free route) | 63.3% | 30 |
| 22 | GPT-5.4 | 60.0% | 30 |
| 23 | Space Bunny Alpha (stealth release) | 60.0% | 30 |
| 24 | Gemma 4 26B A4B (IT) (free route) | 53.3% | 30 |
| 25 | Laguna XS 2.1 (free route) | 44.8% | 29 |
| 26 | Kimi K2 0905 | 43.3% | 30 |
- GPT-5.4 solves 29 of 30 when it is asked for high reasoning effort.
In the main leaderboard
These results are collected for the main leaderboard alongside external benchmarks. New scores enter the rating through the regular audited data updates. Comparisons with that rating therefore share some of its inputs.
Interactive version: theaggregate.ai/our-benchmarks/puzzle-portfolio · How It Works · Data refreshed daily, snapshot 2026-11-14.