NGDBench - NGD-Prime Non-Aggregation: leaderboard

Metric: F1 (x100) between the result set of the model's Cypher query, executed on the perturbed (noisy, incomplete) NGD-Prime graph, and the result of the reference query on the clean graph, for non-aggregation analytical queries; the model translates each natural-language question into Cypher (text-to-Cypher); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 3 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V3.244.6#198
2Qwen 3 Coder 480B A35B Instruct41#302

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=ngdbench-ngd-prime-non-aggregation · How It Works · Data refreshed daily, snapshot 2026-10-11.