AhaBench - Vending (Incident): leaderboard

Metric: Mean profit in US dollars over five seeds (incident setting with refunds, phishing, machine issues and delayed procurement; open-source 365-day vending-machine business simulator inspired by Vending-Bench; the agent orders inventory, reads supplier messages, stocks slots, sets prices and collects cash, each decision a fresh request with the current observation and at most eight recent transitions; a run ends at 365 days, at bankruptcy or after 20 days without a successful order, and its last profit is carried to the end; starting profit zero, fixed model weights). Source: arxiv.org. Saturation forecast: Around August 2027. 10 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=ahabench-vending-incident · How It Works · Data refreshed daily, snapshot 2026-09-26.