QuanBench+ (Pass@5) - Qiskit: leaderboard

Quantum code generation in Qiskit on QuanBench+ (2026) with five samples per task at temperature 0.8: a task counts as solved when any of the five programs passes the executable functional tests of the 42 framework-aligned tasks. Pass@5 in percent; higher is better.

Metric: Pass@5 (%): any of five Qiskit programs sampled at temperature 0.8 passes, on the 42 framework-aligned QuanBench+ tasks (quantum algorithms, gate decomposition, state preparation), graded by executable functional tests with KL-divergence acceptance for probabilistic outputs; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-5.176.2#240
2DeepSeek R169#482
3Kimi K2 (Thinking)66.7
4GLM-4.766.7#380
5Gemini 3 Pro61.9#145
6MiniMax-M2.154.8#575
7QuanBench+ DeepSeek-Chat (checkpoint unspecified)54.8
8GPT-4.152.4#505
9Claude 3.7 Sonnet50#470
10Llama 4 Maverick47.6#1110
11Gemini 2.5 Flash40.5#463
12Qwen 2.5 7B Instruct23.8#2723

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=quanbench-plus-pass-5-qiskit · How It Works · Data refreshed daily, snapshot 2026-11-21.