Software World Model Baselines - odoo17 - clean - find_record: leaderboard

Native Phase0 zero-shot app-control tasks; 30-step budget and one run per task. GPT-6 Luna API uses accessibility tree+screenshot/element IDs; UI-TARS-1.5-7B uses screenshots/native coordinates via adapter and vLLM A100. Nine skills, nominal eight tasks each; UI-TARS other apps four per skill. Exact native n per row retained.12 InvoiceNinja Luna episodes affected by fallback bug are excluded; other affected episodes were rerun, originals superseded. This is source failure policy, not complete-cohort success. App train/held-out labels refer to the separate world-model track, not LLM training. Exact per-skill native success/attempt denominator: GPT-6 Luna 8/8; UI-TARS-1.5-7B 3/4 Metric: Task success fraction (0–1). Source: https://raw.githubusercontent.com/shubhamjoshipromail-svg/software-world-model/7fa10cf4f7d294ba80e8d6c357f77d3a6340c3ce/reports/phase0_results.md

Metric: Task success fraction (0–1). Source: raw.githubusercontent.com. Saturation forecast: Around February 2027. 2 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1GPT-6 Luna1#105
2uitars-1.5-7B0.75#7798

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=software-world-model-baselines-odoo17-clean-find-record · How It Works · Data refreshed daily, snapshot 2026-11-17.