ERPBench (ERPNext) - Single-Record Tasks: leaderboard
Metric: Success rate (%; tier-1 single-record tasks on a self-hosted ERPNext instance: 20 tasks (text edits, selects and toggles, simple record creation), five runs each, 100 runs; the agent sees only 1280x720 screenshots and acts with pixel-coordinate mouse and keyboard actions in the authors' harness with auto-approval; a run succeeds when every target field read back from the ERPNext database matches the ground truth). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.6 | 94 |
| 2 | uitars-1.5-7B | 9 |
Interactive version: theaggregate.ai/benchmark?slug=erpbench-erpnext-single-record-tasks · How It Works · Data refreshed daily, snapshot 2026-09-26.