Text2GraphQuery-Bench (Zero-Shot) - Cypher: leaderboard
Metric: Execution accuracy (%) of the generated Cypher query with zero-shot prompting; Text2GraphQuery-Bench's 2,783 test questions executable on all three engines (6 held-out graph databases in 5 domains), the model given the graph schema and the question, every model in non-thinking mode; the predicted query is executed (Cypher on TuGraph-DB, GQL on Spanner Graph, SQL/PGQ on Oracle Database) and counts when its result equals the gold query's; higher is better. Source: arxiv.org. Saturation forecast: Around August 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.7 Max (Non-reasoning) | 53.8 | #71 (Qwen 3.7 Max) |
| 2 | GPT-5.5 (Non-reasoning) | 53.3 | #26 (GPT-5.5) |
| 3 | Kimi K2.6 (Non-reasoning) | 52.9 | #99 (Kimi K2.6) |
| 4 | Claude Opus 4.8 | 51.2 | #33 |
| 5 | DeepSeek V4 Pro (Non-reasoning) | 48 | #96 (DeepSeek V4 Pro) |
| 6 | Qwen 3 8B (Non-reasoning) | 26.3 | #667 (Qwen 3 8B) |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=text2graphquery-bench-zero-shot-cypher · How It Works · Data refreshed daily, snapshot 2026-10-11.