General365 - Probability & Uncertainty: leaderboard

General365 (Meituan LongCat team, 2026) poses 1,460 general-reasoning problems (365 hand-written seeds and their expansions) that need little expert knowledge; numeric answers are checked with math-verify and the others graded by GPT-4.1. This board covers the problems labelled Probability & Uncertainty (a problem can carry several labels). Accuracy in percent; higher is better.

Metric: Accuracy (%) on the problems labelled Probability & Uncertainty (a problem may carry several challenge labels), out of 1,460 problems (365 hand-written seeds and 1,095 expansions); numeric answers checked with math-verify, choice and text answers graded by GPT-4.1; temperature 1.0 for reasoning and 0.7 for chat models, highest available reasoning effort; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 25 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3 Flash60.2#175
2GPT-5High59.1#178
3Qwen 3.5 397B A17BThinking59.1#264
4GLM-4.7Thinking58#380
5GLM-5Thinking56.8#269
6DeepSeek V3.2 Speciale55.7#273
7Gemini 3 Pro54.5#145
8Kimi K2.5Thinking54.5#266
9DeepSeek V3.2Thinking53.4#419
10Qwen 3 MaxThinking53.4#415
11Kimi K2 (Thinking)52.3
12LongCat-Flash-Thinking-260151.1#494
13DeepSeek V3.1Thinking50#511
14O4 MiniHigh47.7#368
15GPT-5.1High47.7#240

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=general365-probability-uncertainty · How It Works · Data refreshed daily, snapshot 2026-11-21.