LLMEval-Logic Hard Sub-Q: leaderboard
LLMEval logic-reasoning leaderboard (llmeval.com) — hard set scored on decomposed sub-questions; accuracy (%).
Metric: Accuracy (%). Source: llmeval.com. Saturation forecast: Around January 2027. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 (Thinking) | 76.6 | #63 (Claude Opus 4.6) |
| 2 | Gemini 3.1 Pro (Preview) (Thinking) | 76 | #58 (Gemini 3.1 Pro (Preview)) |
| 3 | Claude Opus 4.6 (Non-reasoning) | 74.4 | #63 (Claude Opus 4.6) |
| 4 | Gemini 3.1 Pro (Preview) (Low) | 71.3 | #58 (Gemini 3.1 Pro (Preview)) |
| 5 | Qwen 3.5 Plus (Thinking) | 70 | #125 (Qwen 3.5 Plus) |
| 6 | Kimi K2.5 (Thinking) | 68.4 | #144 (Kimi K2.5) |
| 7 | Seed 2.0 Pro (Thinking) | 63.3 | #118 (Seed 2.0 Pro) |
| 8 | Hy3-preview (Reasoning) | 62.7 | #157 (Hy3-preview) |
| 9 | Seed 2.0 Pro (Non-reasoning) | 39.4 | #118 (Seed 2.0 Pro) |
| 10 | Qwen 3.5 Plus (Non-reasoning) | 33.7 | #125 (Qwen 3.5 Plus) |
| 11 | Hy3-preview (Non-reasoning) | 27.4 | #157 (Hy3-preview) |
| 12 | Kimi K2.5 (Non-reasoning) | 27 | #144 (Kimi K2.5) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=llmeval-logic-hard-sub-q · How It Works · Data refreshed daily, snapshot 2026-10-20.