PDEAgent-Bench - deal.II: leaderboard
PDEAgent-Bench (Hang et al., 2026) gives a model a structured PDE specification and asks for a complete finite-element solver in one attempt, with no execution feedback, here for the C++ library deal.II: the 313 cases of nine PDE families that the deal.II track supports. A case passes only if the solver runs, returns a valid solution within 10 times the calibration baseline's relative L2 error and finishes within 3 times its runtime; the score is the pass rate in percent, higher is better.
Metric: Case pass rate (%; 313 deal.II C++ cases, single-shot, temperature 0; same pass gates). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 32.3 | #91 |
| 2 | Claude Opus 4.7 | 28.1 | #75 |
| 3 | GPT-5.4 | 19.2 | #121 |
| 4 | Qwen 3.6 Plus | 16.9 | #217 |
| 5 | DeepSeek V3.2 | 0 | #403 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=pdeagent-bench-deal-ii · How It Works · Data refreshed daily, snapshot 2026-11-12.