GraphInstruct (Generation, Few-Shot CoT): leaderboard

GraphInstruct (Generation, Few-Shot CoT) scores instruction-following graph generation on the 800 GraphInstruct (2026) instructions under few-shot chain-of-thought prompting. The quality score, 0 to 100 and higher is better, is computed by code from validity, distribution match, reference similarity and constraint satisfaction across six constraint levels.

Metric: Quality S_total (0-100; the paper's 0-1 score times 100): level scores weighted 0.05, 0.10, 0.15, 0.20, 0.25, 0.25 for L0 to L5, each level score a weighted mix of structural validity and distribution match, reference similarity and instruction-constraint satisfaction checked by code (no LLM judge; efficiency excluded), over the 800 instructions of GraphInstruct (instruction-following graph generation in six constraint levels); few-shot chain-of-thought prompting; five generations per instruction at temperature 0.7 with the InstructGraph code-style prefix; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.690.2#173
2Qwen 3.5 397B A17B87.9#264
3Qwen 3.5 122B A10B87.1#346
4Qwen 3.5 35B A3B86.1#492
5GraphInstruct DeepSeek-V3 (checkpoint unspecified)84
6Llama 3.3 70B Instruct83.4#1385
7GPT-4o82.3#751
8GPT-4.181.1#505
9GPT-4o Mini71.5#1667
10GPT-3.5 Turbo71.3#3005
11Llama 3.1 8B Instruct68.2#4600

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=graphinstruct-generation-few-shot-cot · How It Works · Data refreshed daily, snapshot 2026-11-21.