Agent Arena - Tool Hallucination — leaderboard

Metric: Tool Hallucination (%). Source: arena.ai. 38 models tracked.

Top models

#ModelScore
1Gemini 3 Flash0.03
2Nemotron 3 Ultra0.09
3Claude Opus 4.8 (Thinking)0.22
4Grok Build 0.10.78
5Qwen 3.7 Max0.83
6Hy30.89
7Gemini 3.5 Flash (Medium)0.91
8Claude Sonnet 5 (High)1.25
9Claude Opus 4.7 (Thinking)1.28
10Gemini 3.1 Pro (Preview)1.32
11Claude Opus 4.71.33
12Claude Sonnet 4.61.35
13GPT-5.51.39
14Claude Opus 4.61.39
15GLM-5.11.39

Interactive version: theaggregate.ai/benchmark?slug=agent-arena-tool-hallucination · How the rankings work · Data refreshed daily, snapshot 2026-07-22.