BigO(Bench) - Time Complexity Prediction: leaderboard

Each model, zero-shot, must name the time complexity of a given human Code Contests solution; all@1 counts a problem only when every one of its complexity classes is named correctly; each model ran on the 311 problems (640 solutions) of the test set, 20 samples each. These are the original protocol's numbers (paper v1/v2, March 2025, problem statements with their input bounds); the paper's 2026 v3 drops the bounds and re-measures, and is not this board. Llama 3.1 405B, which generated the input parsers that decide which problems enter the test set, is not ranked. Unlike HumanEval-style correctness boards it scores whether code meets a stated algorithmic complexity.

Metric: all@1 (%). Source: facebookresearch.github.io. Saturation forecast: Estimated already saturated. 16 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1DeepSeek R1 Distill Llama 70B41.4#1669
2DeepSeek R1 Distill Qwen 32B41.1#1806
3Llama 3.1 Nemotron Ultra 253B v141.1#1014
4QwQ-32B40.4#908
5Gemma 3 27B (IT)37.6#1339
6openhands-lm-32B-v0.136#2237
7Qwen 2.5 Coder 32B Instruct34.9#1597
8DeepSeek V3 (0324)34.2#722
9Llama 3.1 70B Instruct33.8#1577
10Llama 3.3 70B Instruct33.7#1387
11Codestral-22B-v0.133.5#2680
12Llama 4 Maverick Instruct FP832.8#1022
13DeepSeek-Coder-V2-Instruct-072429.6#1103
14DeepSeek V327.1#734
15Llama 4 Scout Instruct23#1575

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=bigo-bench-time-complexity-prediction · How It Works · Data refreshed daily, snapshot 2026-11-17.