DTBench - Source-aware Resolution: leaderboard

Metric: Sub-capability-specific success rate (%) on DTBench: the share of ground-truth cells labelled source-aware conflict resolution (conflicting values resolved by source reliability) that the model extracts exactly (after normalization and row alignment) when filling a target table schema from a long synthesized document; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 7 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V3.250.08#198
2GPT-545.69#91
3Qwen 3 4B44.67#823
4GPT-5 Mini38.92#176
5Qwen 3 32B21.15#424

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=dtbench-source-aware-resolution · How It Works · Data refreshed daily, snapshot 2026-10-11.