MobileGym-Bench - Hybrid Tasks: leaderboard

Metric: Success rate (%; 38 of the 256 test tasks, state-checked; open models: mean of four runs with re-sampled task parameters; proprietary models: one run (two for Gemini 3.1 Pro)). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)60.5
2Qwen 3.6 Plus60.5
3Seed 2.0 Pro50
4uitars-1.5-7B4.6
5Qwen 3 VL 4B Instruct0.7

Interactive version: theaggregate.ai/benchmark?slug=mobilegym-bench-hybrid-tasks · How It Works · Data refreshed daily, snapshot 2026-09-25.