DexHoldem Agentic Perception - Robot Chip Inventory: leaderboard

Metric: Field accuracy (%; exact per-denomination count of the robot's chips, 16 problems; 36 tabletop states from real games, mean of three runs; the perceiver parses the image with its harness at a medium thinking budget). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.

Top models

#ModelScore
1GPT-5.5 (Codex, Medium)62.5
2GPT-5.4 (Codex, Medium)56.2
3Claude Opus 4.7 (Claude Code, Medium)37.5
4GPT-5.4 mini (Codex, Medium)29.2
5Claude Sonnet 4.6 (Claude Code, Medium)29.2
6Gemini 3 Flash (Gemini CLI, Medium)29.2
7Claude Haiku 4.5 (Claude Code, Medium)25
8Gemini 3.1 Flash-Lite (Gemini CLI, Medium)22.9

Interactive version: theaggregate.ai/benchmark?slug=dexholdem-agentic-perception-robot-chip-inventory · How It Works · Data refreshed daily, snapshot 2026-09-26.