OmniaBench - ToC: leaderboard

The consumer-facing (ToC) domain split of OmniaBench (2026), with tasks modelled on app-store application categories. Pass@1 in percent, higher is better.

Metric: Pass@1 (%; tasks from the consumer-facing (ToC) domain split; a task counts as solved only when every rubric item is satisfied (Program tasks by a VerifyCode check); up to 200 tool-call steps; challenging set of 644 tasks evaluated June 29 to July 15, 2026). Source: arxiv.org. Saturation forecast: Around February 2027. 22 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 5 (Max)60.47#111 (Claude Sonnet 5)
2GPT-5.6 Sol (High)59.07#30 (GPT-5.6 Sol)
3GLM-5.2 (Max)55.81#138 (GLM-5.2)
4DeepSeek V4 Pro (Max)54.88#188 (DeepSeek V4 Pro)
5GPT-5.5 (High)53.02#49 (GPT-5.5)
6DeepSeek V4 Flash (Max)51.63#258 (DeepSeek V4 Flash)
7Claude Opus 4.7 (Max)51.63#79 (Claude Opus 4.7)
8Kimi K2.6 (Thinking)49.3#178 (Kimi K2.6)
9Qwen 3.7 Max (Thinking)48.84#145 (Qwen 3.7 Max)
10Gemini 3.5 Flash (High)46.98#101 (Gemini 3.5 Flash)
11Gemini 3.1 Pro (Preview)39.53#94
12Qwen 3.6 27B38.6#341
13GLM-5 (Thinking)37.67#260 (GLM-5)
14Qwen 3.5 397B A17B35.35#246
15Qwen 3.6 35B A3B31.63#462

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=omniabench-toc · How It Works · Data refreshed daily, snapshot 2026-11-13.