CRMArena - HTU (ReAct): leaderboard

Metric: Exact match (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked.

Top models

#ModelScore
1O1 (2024-12-17)51.5
2GPT-4o (2024-08-06)39.2
3GPT-4o Mini36.9
4Claude 3 Sonnet (20240229)24.6
5DeepSeek R123.1
6Llama 3.1 405B Instruct22.3
7Llama 3.1 70B Instruct20
8Claude 3.5 Sonnet (20240620)20
9Llama 3.1 8B Instruct0

Interactive version: theaggregate.ai/benchmark?slug=crmarena-htu-react · How It Works · Data refreshed daily, snapshot 2026-10-09.