Software World Model Baselines - invoiceninja - clean - create_client: leaderboard
Native Phase0 zero-shot app-control tasks; 30-step budget and one run per task. GPT-6 Luna API uses accessibility tree+screenshot/element IDs; UI-TARS-1.5-7B uses screenshots/native coordinates via adapter and vLLM A100. Nine skills, nominal eight tasks each; UI-TARS other apps four per skill. Exact native n per row retained.12 InvoiceNinja Luna episodes affected by fallback bug are excluded; other affected episodes were rerun, originals superseded. This is source failure policy, not complete-cohort success. App train/held-out labels refer to the separate world-model track, not LLM training. Exact per-skill native success/attempt denominator: GPT-6 Luna 8/8; UI-TARS-1.5-7B 0/8 Metric: Task success fraction (0–1). Source: https://raw.githubusercontent.com/shubhamjoshipromail-svg/software-world-model/7fa10cf4f7d294ba80e8d6c357f77d3a6340c3ce/reports/phase0_results.md
Metric: Task success fraction (0–1). Source: raw.githubusercontent.com. Saturation forecast: Around February 2027. 2 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Luna | 1 | #105 |
| 2 | uitars-1.5-7B | 0 | #7798 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=software-world-model-baselines-invoiceninja-clean-create-client · How It Works · Data refreshed daily, snapshot 2026-11-17.