Ambig-DS - Target (Ambiguous): leaderboard

Metric: Normalized task score (0-100) in the Ambiguous condition (no clarification channel) on the 51 target-ambiguity tasks of Ambig-DS (DSBench data-modeling tasks whose prompt and data no longer fix the prediction target), scored by the original DSBench evaluator as the relative performance gap normalized to 0-1 (times 100, so 0-100; invalid and timed-out runs score 0), code agents in the OpenCode harness with a 2-hour budget; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 5 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)49
2Gemini 3 Flash44
3GPT-5.4 Nano39
4GPT-5.432
5Claude Haiku 4.532

Interactive version: theaggregate.ai/benchmark?slug=ambig-ds-target-ambiguous · How It Works · Data refreshed daily, snapshot 2026-10-07.