RiskWebWorld - Merchant Risk Profile: leaderboard

RiskWebWorld (2026) gives web GUI agents e-commerce risk-management tasks from a production risk-control pipeline, run on real, often uncooperative websites within 20 steps. Task success rate over the 194 merchant risk profile tasks (legal registration, business licences), in percent; higher is better.

Metric: Task success rate (%) over the 194 merchant risk profile tasks (legal registration, business licences), for web GUI agents in RiskWebWorld's Browser Use style loop (DOM tree, screenshot and history each step, 1920x1080 viewport, at most 20 steps, stopped after three consecutive failed actions), default model settings; exact match for exact fields, an LLM judge for free-text fields; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro38.7#145
2GPT-5.235.6#185
3Kimi K2.534#266
4Qwen 3 VL 235B A22B31#485
5Claude Sonnet 4.530.9#261
6Qwen 3.5 35B A3B28.4#492
7Qwen 3.5 397B A17B27.8#264
8BU-30B26.3
9Qwen 3 VL 30B A3B22.7#784
10GLM-4.6V10.3#710
11InternVL3.5-38B3.1#1021
12uitars-1.5-7B0#7905
13ShowUI-2B0
14GUI-G1-3B0
15UI-TARS-72B (RiskWebWorld checkpoint unspecified)0

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=riskwebworld-merchant-risk-profile · How It Works · Data refreshed daily, snapshot 2026-11-21.