LLM2014 Logic 2026-10: leaderboard
The October 2026 table of a personal Chinese tracker that keeps a private, monthly rotating bank of at most 28 logic problems and 270 test cases. Each problem scores out of ten on its scoring points; a guessed answer, surplus answers or a reply that breaks the requested format lose points, and very long reasoning is penalized. Every problem runs three times and the table reports peak and median columns; this board takes the median, higher is better. Source: github.com/llm2014/llm_benchmark.
Metric: Median Score. Source: raw.githubusercontent.com. Saturation forecast: Around November 2027. 41 models tracked. Updated 24 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6 Astra | xHigh | 86.53 | #6 |
| 2 | Claude Opus 5.5 (xhigh ~Estimated) | 77.69 | ||
| 3 | Claude Fable 5.1 (xHigh, Estimated) | 70.47 | ||
| 4 | Gemini 4 Argon | High | 69.13 | #12 |
| 5 | GPT-6.1 Sol | xHigh | 67.79 | #10 |
| 6 | Claude Opus 5.5 (xhigh w/ refuse) | 66.63 | ||
| 7 | Kimi K3.1 Pro | Max | 61.65 | #29 |
| 8 | Muse Wonder | xHigh | 59.64 | #28 |
| 9 | Claude Fable 5.1 | xHigh | 58.69 | #15 |
| 10 | Claude Sonnet 5.5 | xHigh | 57.41 | #19 |
| 11 | DeepSeek V4.1 Flash (1017) | Max | 56.03 | #41 |
| 12 | Kimi K3 | Max | 53.16 | #56 |
| 13 | DeepSeek V4.1 Flash | Max | 52.98 | #62 |
| 14 | Grok 4.7 | xHigh | 52.55 | #47 |
| 15 | MiniMax-M3.1-Flash | Max | 51.76 | #109 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=llm2014-logic-2026-10 · How It Works · Data refreshed daily, snapshot 2026-11-16.