OSWorld-G: leaderboard
A model sees a desktop screenshot with a plain-language instruction and must click inside the annotated target element, or refuse when the element is absent; the score is accuracy over all 564 samples with the original instructions. Unlike ScreenSpot it tags each sample by capability and includes fine-grained and infeasible targets; the refined-instruction version is OSWorld-G-R. The paper's authors ran every model; the Jedi models are their own, trained for GUI grounding.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Jedi-7B-1080p | 54.1 | |
| 2 | Jedi 3B-1080p | 50.9 | |
| 3 | Qwen 2.5 VL 32B Instruct | 46.5 | #1074 |
| 4 | UGround-V1-7B | 36.4 | |
| 5 | Qwen 2.5 VL 7B Instruct | 31.4 | #1893 |
| 6 | Qwen 2.5 VL 3B Instruct | 27.3 | #2648 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=osworld-g · How It Works · Data refreshed daily, snapshot 2026-11-17.