GraphInstruct (Generation) - L0 Format Generation: leaderboard

Metric: Level quality score (0-100; the paper's 0-1 score times 100) on the 100 GraphInstruct instructions of level L0, which requires format generation (node and edge counts, syntax); zero-shot prompting; five generations per instruction at temperature 0.7 with the InstructGraph code-style prefix; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.695.8
2Qwen 3.5 397B A17B95.2
3Qwen 3.5 122B A10B94.7
4GPT-4o94.2
5Claude Sonnet 4 (20250514)93.9
6Qwen 3.5 35B A3B92.4
7GPT-4.192.3
8Llama 3.3 70B Instruct90.5
9Llama 3.1 8B Instruct89.6
10GPT-4o Mini85.2
11GPT-3.5 Turbo85

Interactive version: theaggregate.ai/benchmark?slug=graphinstruct-generation-l0-format-generation · How It Works · Data refreshed daily, snapshot 2026-10-07.