PLE Dev - electrical - pi: leaderboard

PLE evaluates agents on its separate 29-task development set from professional engineering work. Results distinguish the agent tools and engineering discipline. Mean task reward (0–1).

Metric: Mean task reward (0–1). Source: ple-bench.com. Saturation forecast: Around May 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 4 Argon0.59#9
2Claude Opus 5.50.5#3
3Claude Sonnet 5.50.49#12
4Claude Opus 50.35#15
5Grok 4.70.34#27
6Gemini 3.8 Flash0.23#25
7DeepSeek V4.1 Flash0.2#38
8Claude Fable 50.19#19
9GLM-5.20.18#77
10Gemini 3.1 Pro (Preview)0.11#61
11GPT-OSS-120B0.07#341
12Kimi K2 (Thinking)0.06#246 (Kimi K2)
13Qwen 3 Coder 480B A35B0.05#279
14MiniMax-M20.05#322
15Gemma 4 26B0.04#313

No result here: #5 GPT-6 Astra, #7 GPT-6.1 Sol, #10 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=ple-dev-electrical-pi · How It Works · Data refreshed daily, snapshot 2026-10-29.