AgentRewardBench (Accessibility Tree) - AssistantBench: leaderboard

AgentRewardBench judge precision (%) on AssistantBench trajectories, with the authors' simplified judge reading the final accessibility tree: the share of trajectories it calls successful that experts also marked successful; higher is better (McGill NLP, 2025).

Metric: Precision (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 5 models tracked.

Top models

#ModelScoreOverall rank
1Claude 3.7 Sonnet87.5#455
2GPT-4o Mini (2024-07-18)80#1512
3GPT-4o (2024-11-20)77.8#864
4Llama 3.3 70B Instruct75#1353
5Qwen 2.5 VL 72B Instruct72.7#845

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=agentrewardbench-accessibility-tree-assistantbench · How It Works · Data refreshed daily, snapshot 2026-11-12.