OpenHarmony Bench - New Features: leaderboard

Coding agents complete OpenHarmony software-development tasks under the paper’s evaluation harness. The original paper reports eight models over 153 tasks, with separate new-feature, specification-driven and bug-fix populations. Scores are mean task-completion percentages; interval endpoints are not treated as additional scores. This board reports OpenHarmony Bench - New Features using Mean Task Completion (%).

Metric: Mean Task Completion (%). Source: arxiv.org. Saturation forecast: Around January 2028. 8 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5.263.54#80
2GLM-5.156.25#109
3Kimi K2.7 Code56.25#95
4DeepSeek V4 Pro55.21#112
5Qwen 3.7 Max55.21#85
6MiniMax-M353.13#151
7Kimi K353.13#35

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=openharmony-bench-new-features · How It Works · Data refreshed daily, snapshot 2026-11-05.