DAYJOB: Data Science: leaderboard

Long-horizon data-science assignments from a brief request and a workspace of files, graded by an agent judge against an expert rubric; the score is the share of attempts meeting at least 95% of criteria. Surge AI supplied these results before publishing the board and has not stated the task count.

Metric: Attempts meeting at least 95% of rubric criteria (%). Source: fireworks.ai. Saturation forecast: Around October 2027. 16 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 5.5Max37.3#5
2Claude Sonnet 5.5Max35.3#19
3Claude Fable 5.1Max26#15
4Gemini 4 ArgonHigh23.3#12
5GPT-6 AstraMax21.3#6
6GPT-6.1 SolMax18.7#10
7Muse WonderMax16.7#28
8Qwen 3.8 MaxxHigh7.3#59
9Grok 4.7xHigh6.7#47
10Muse Spark 1.3Max6#43
11Kimi K3.1 Pro4.7#29
12GLM-5.3Max4#68
13DeepSeek V4.1 Flash (1017)Max3.3#41
14Hy4 previewHigh3.3#71
15Kimi K3Max1.3#56

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=dayjob-data-science · How It Works · Data refreshed daily, snapshot 2026-11-16.