AWARE-US (Global Weighting) - S3 Any Repair: leaderboard
Metric: Car match (%; share of the 40 persona-grounded car-search dialogues, four preference constraints, any one of which can be dropped to make the query feasible, in which the agent relaxes the oracle's least important constraint and recommends the oracle's car; global one-shot weighting: after the whole dialogue the model assigns normalised weights to all constraints and relaxes the lowest). Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 2 9B (IT) | 30 |
| 2 | Qwen 3 8B | 25 |
| 3 | Llama 3 8B Instruct | 20 |
Interactive version: theaggregate.ai/benchmark?slug=aware-us-global-weighting-s3-any-repair · How It Works · Data refreshed daily, snapshot 2026-09-26.