AA Omniscience - Software Engineering (SWE) - Python: leaderboard

Python-language slice of AA Omniscience SWE, testing factual knowledge of Python syntax, libraries, tooling, and engineering practice.

Metric: Accuracy (%). Source: artificialanalysis.ai. Saturation forecast: Around April 2027. 294 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.5 (Thinking)74.5#88 (Claude Opus 4.5)
2Kimi K3 (Max)71.5#35 (Kimi K3)
3Gemini 3 Pro (Preview) (High)66.5#72 (Gemini 3 Pro (Preview))
4Kimi K3 (Low)64.5#35 (Kimi K3)
5Claude Opus 4.5 (Non-reasoning)64#88 (Claude Opus 4.5)
6Kimi K2.7 Code55.5#95
7Claude Sonnet 4.5 (Non-reasoning)53#148 (Claude Sonnet 4.5)
8Claude Sonnet 4.5 (Thinking)52.5#148 (Claude Sonnet 4.5)
9Kimi K2.5 (Thinking)47#153 (Kimi K2.5)
10Hy346.5#97
11GPT-5 (High)45.5#106 (GPT-5)
12Inkling (xHigh)45#144 (Inkling)
13DeepSeek V4 Pro (Reasoning, Max Effort)45#112 (DeepSeek V4 Pro)
14GPT-5 (Medium)44.5#106 (GPT-5)
15GPT-5 (Low)44#106 (GPT-5)

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=aa-omniscience-software-engineering-swe-python · How It Works · Data refreshed daily, snapshot 2026-11-06.