Visa Agentic Commerce Benchmark: leaderboard
Visa Agentic Commerce Benchmark (Visa Research, October 2026 results snapshot, released November 5) evaluates whether a shopping assistant can uncover a customer's hidden requirements and select a suitable offer in a fixed simulated market, or correctly decline when nothing fits. Twenty-two models each complete 15 episodes three times, for 45 scored runs per model and 990 total. This series reports Pass rate (%) across all 45 scored runs: correct offer fit and every necessary customer requirement established, or a justified no-purchase when nothing fits. Reasoning effort, the exact third-party access service, customer/judge models and harness version are not reported; native model IDs preserve dated and preview variants. Announced tool/format limits count as failure. Nine unannounced-limit truncations were each replaced once; every replacement outcome counts. The separate public demo replays are not part of the scored pool.
Metric: Pass rate (%) across all 45 scored runs: correct offer fit and every necessary customer requirement established, or a justified no-purchase when nothing fits; October 2026 snapshot, higher is better. Source: www.visapaymentsfrontier.io. Saturation forecast: Rough model projection: around 2026. 22 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 4 Argon (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=google%2Fgemini-4-argon; effort=unreported; service=third-party) | 82.22 | |
| 2 | Muse Wonder (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=meta%2Fmuse-wonder; effort=unreported; service=third-party) | 82.22 | |
| 3 | Claude Fable 5.1 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=anthropic%2Fclaude-fable-5.1; effort=unreported; service=third-party) | 75.56 | |
| 4 | GLM-5.3 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=z-ai%2Fglm-5.3; effort=unreported; service=third-party) | 66.67 | |
| 5 | Claude Sonnet 5.5 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=anthropic%2Fclaude-sonnet-5.5; effort=unreported; service=third-party) | 64.44 | |
| 6 | GPT-6 Astra (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=openai%2Fgpt-6-astra; effort=unreported; service=third-party) | 64.44 | |
| 7 | Muse Spark 1.3 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=meta%2Fmuse-spark-1.3; effort=unreported; service=third-party) | 64.44 | |
| 8 | Claude Opus 5.5 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=anthropic%2Fclaude-opus-5.5; effort=unreported; service=third-party) | 62.22 | |
| 9 | GPT-6.1 Sol (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=openai%2Fgpt-6.1-sol; effort=unreported; service=third-party) | 62.22 | |
| 10 | Grok 4.7 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=x-ai%2Fgrok-4.7; effort=unreported; service=third-party) | 60 |
Interactive version: theaggregate.ai/benchmark?slug=visa-agentic-commerce-benchmark · How It Works · Data refreshed daily, snapshot 2026-11-06.