ParaGUIBench - File Search: leaderboard
Metric: Success rate (%; 12 file-search tasks; single serial GUI agent (one perception-decision-action loop, no planner) on a Docker desktop with 4 GiB RAM and 2 vCPUs, each model under its official visual-history setting; verdict read from the final environment state by task-specific checks). Source: arxiv.org. Saturation forecast: Around August 2027. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.6 | 33.3 |
| 2 | Qwen 3 VL 235B A22B Instruct | 16.7 |
| 3 | Seed 1.8 | 8.3 |
Interactive version: theaggregate.ai/benchmark?slug=paraguibench-file-search · How It Works · Data refreshed daily, snapshot 2026-09-29.