Visa Agentic Commerce Benchmark - Hidden Facts Uncovered: leaderboard
Visa Agentic Commerce Benchmark (Visa Research, October 2026 results snapshot, released November 5) evaluates whether a shopping assistant can uncover a customer's hidden requirements and select a suitable offer in a fixed simulated market, or correctly decline when nothing fits. Twenty-two models each complete 15 episodes three times, for 45 scored runs per model and 990 total. This series reports Hidden customer facts uncovered (%): native research-report average of the share of locked customer facts released; opening-request facts excluded. Reasoning effort, the exact third-party access service, customer/judge models and harness version are not reported; native model IDs preserve dated and preview variants. Announced tool/format limits count as failure. Nine unannounced-limit truncations were each replaced once; every replacement outcome counts. The separate public demo replays are not part of the scored pool.
Metric: Hidden customer facts uncovered (%): native research-report average of the share of locked customer facts released; opening-request facts excluded; October 2026 snapshot, higher is better. Source: www.visapaymentsfrontier.io. Saturation forecast: Rough model projection: around 2026. 22 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Muse Wonder (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=meta%2Fmuse-wonder; effort=unreported; service=third-party) | 75.66 | |
| 2 | Gemini 4 Argon (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=google%2Fgemini-4-argon; effort=unreported; service=third-party) | 72.45 | |
| 3 | Claude Sonnet 5.5 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=anthropic%2Fclaude-sonnet-5.5; effort=unreported; service=third-party) | 69.99 | |
| 4 | Beam 1.0 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=reflection%2Fbeam-1.0-501b-a23b; effort=unreported; service=third-party) | 69.98 | |
| 5 | GLM-5.3 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=z-ai%2Fglm-5.3; effort=unreported; service=third-party) | 69.04 | |
| 6 | Claude Fable 5.1 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=anthropic%2Fclaude-fable-5.1; effort=unreported; service=third-party) | 67.73 | |
| 7 | GPT-6 Astra (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=openai%2Fgpt-6-astra; effort=unreported; service=third-party) | 65.4 | |
| 8 | GPT-6.1 Sol (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=openai%2Fgpt-6.1-sol; effort=unreported; service=third-party) | 65.1 | |
| 9 | Qwen 3.8 Max (0902) (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=qwen%2Fqwen3.8-max-0902; effort=unreported; service=third-party) | 65.1 | |
| 10 | Claude Opus 5.5 (Benchmark Sweep Run: Visa Commerce; snapshot=results-2026-11-03; source-model=anthropic%2Fclaude-opus-5.5; effort=unreported; service=third-party) | 59.25 |
Interactive version: theaggregate.ai/benchmark?slug=visa-agentic-commerce-benchmark-hidden-facts-uncovered · How It Works · Data refreshed daily, snapshot 2026-11-06.