LLMEval-Logic Formalization Free: leaderboard
LLMEval logic-reasoning leaderboard (llmeval.com) — formalization track with free-form formalization; accuracy (%).
Metric: Accuracy (%). Source: llmeval.com. Saturation forecast: Around April 2028. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) (Thinking) | 45.1 | #58 (Gemini 3.1 Pro (Preview)) |
| 2 | Gemini 3.1 Pro (Preview) (Low) | 44.3 | #58 (Gemini 3.1 Pro (Preview)) |
| 3 | Claude Opus 4.6 (Non-reasoning) | 43.5 | #63 (Claude Opus 4.6) |
| 4 | Claude Opus 4.6 (Thinking) | 38.6 | #63 (Claude Opus 4.6) |
| 5 | Kimi K2.5 (Thinking) | 36.2 | #144 (Kimi K2.5) |
| 6 | Qwen 3.5 Plus (Thinking) | 36.2 | #125 (Qwen 3.5 Plus) |
| 7 | Seed 2.0 Pro (Thinking) | 35.8 | #118 (Seed 2.0 Pro) |
| 8 | Seed 2.0 Pro (Non-reasoning) | 30.9 | #118 (Seed 2.0 Pro) |
| 9 | Hy3-preview (Reasoning) | 27.6 | #157 (Hy3-preview) |
| 10 | Kimi K2.5 (Non-reasoning) | 27.2 | #144 (Kimi K2.5) |
| 11 | Qwen 3.5 Plus (Non-reasoning) | 25.2 | #125 (Qwen 3.5 Plus) |
| 12 | Hy3-preview (Non-reasoning) | 21.9 | #157 (Hy3-preview) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=llmeval-logic-formalization-free · How It Works · Data refreshed daily, snapshot 2026-10-20.