APEX-SWE: leaderboard

Integration and observability engineering tasks in containerized repositories, checked by program; the score is the mean over 4 attempts on Mercor's 200-task held-out set, supplied by Mercor. It targets service wiring and monitoring work rather than issue fixing.

Metric: Mean score over 4 attempts of 200 tasks (%). Source: fireworks.ai. Saturation forecast: Around 2029. 10 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 5.5Max67.62#5
2Claude Opus 5Max63.75#20
3Grok 4.6xHigh57.75#45
4Grok 4.7xHigh53.62#47
5DeepSeek V4.1 FlashMax51.88#62
6GPT-6 AstraMax50#6
7DeepSeek V4 Pro (0813)Max46.92#90
8GPT-6.1 SolMax46.88#10
9GLM-5.3Max45.62#68
10Gemini 3.8 FlashHigh36.62#36

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=apex-swe · How It Works · Data refreshed daily, snapshot 2026-11-16.