General365 - Semantic Interference: leaderboard

General365 (Meituan LongCat team, 2026) poses 1,460 general-reasoning problems (365 hand-written seeds and their expansions) that need little expert knowledge; numeric answers are checked with math-verify and the others graded by GPT-4.1. This board covers the problems labelled Semantic Interference (a problem can carry several labels). Accuracy in percent; higher is better.

Metric: Accuracy (%) on the problems labelled Semantic Interference (a problem may carry several challenge labels), out of 1,460 problems (365 hand-written seeds and 1,095 expansions); numeric answers checked with math-verify, choice and text answers graded by GPT-4.1; temperature 1.0 for reasoning and 0.7 for chat models, highest available reasoning effort; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 25 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5High57.2#185
2Gemini 3 Flash55.7#180
3Gemini 3 Pro55.7#146
4GPT-5.1High53.4#248
5DeepSeek V3.2 Speciale51.5#277
6Grok 4.1 FastReasoning50.8#431
7Qwen 3.5 397B A17BThinking50.8#270
8GLM-4.7Thinking49.6#383
9Qwen 3 235B A22B 2507 (Thinking)49.2#471
10DeepSeek V3.2Thinking49.2#425
11GLM-5Thinking49.2#276
12GLM-4.6Thinking48.5#496
13Gemini 2.5 Pro48.1#280
14Qwen 3 Max Instruct47.7#513
15Claude Sonnet 4.5Thinking47.3#267

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=general365-semantic-interference · How It Works · Data refreshed daily, snapshot 2026-11-22.