PLE Dev - electrical - openhands: leaderboard

PLE evaluates agents on its separate 29-task development set from professional engineering work. Results distinguish the agent tools and engineering discipline. Mean task reward (0–1).

Metric: Mean task reward (0–1). Source: ple-bench.com. Saturation forecast: Around June 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.50.56#3
2Claude Sonnet 5.50.48#12
3Claude Opus 50.43#15
4Gemini 4 Argon0.37#9
5Claude Fable 50.3#19
6Gemini 3.8 Flash0.22#25
7GLM-5.20.2#77
8Gemini 3.1 Pro (Preview)0.13#61
9Grok 4.70.11#27
10Kimi K2 (Thinking)0.09#246 (Kimi K2)
11DeepSeek V4.1 Flash0.07#38
12Gemma 4 26B0.07#313
13Qwen 3 Coder 480B A35B0.05#279
14GPT-OSS-120B0.04#341
15Qwen 3 Next 80B A3B Instruct0.04#375

No result here: #5 GPT-6 Astra, #7 GPT-6.1 Sol, #10 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=ple-dev-electrical-openhands · How It Works · Data refreshed daily, snapshot 2026-10-29.