Hear2Act (Text, Explicit Feedback): leaderboard

Hear2Act (2026) runs task-oriented assistants through 480 persona-grounded consumer-service scenarios with a hidden user concern and verifiable outcomes. On this board the concern is stated in the user words and a text LLM reads the transcript; the score is the percent of dialogues ending with the best option, higher is better.

Metric: Optimal-solution rate (%; share of dialogues ending with the first-tier option, using the final recommendation if the turn budget runs out; 480 persona-grounded consumer-service scenarios with a hidden user concern and verifiable outcomes; explicit lexical feedback: the concern is stated in the user's words; text LLM reading the dialogue transcript only, two runs per scenario). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.674.9#102
2Kimi K2.569.4#256
3GLM-567.3#260
4Qwen 3 32B64.3#960
5DeepSeek V3.254.8#406

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=hear2act-text-explicit-feedback · How It Works · Data refreshed daily, snapshot 2026-11-13.