AWARE-US (Local Weighting) - S2 Two Constraints: leaderboard
Metric: Car match (%; share of the 41 persona-grounded car-search dialogues, two preference constraints, either of which can be dropped to make the query feasible, in which the agent relaxes the oracle's least important constraint and recommends the oracle's car; local weighting: each clarification answer yields a constraint and an importance weight, and the lowest-weight constraint is relaxed first). Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3 8B | 58.5 |
| 2 | Gemma 2 9B (IT) | 53.7 |
| 3 | Llama 3 8B Instruct | 34.1 |
Interactive version: theaggregate.ai/benchmark?slug=aware-us-local-weighting-s2-two-constraints · How It Works · Data refreshed daily, snapshot 2026-09-26.