MDGym - Medium: leaderboard

MDGym (Kumar et al., 2026) asks an AI agent to set up, run and analyse expert-curated molecular dynamics simulations in LAMMPS or GROMACS and report physical quantities; a task is solved only when every required quantity is within 5% of the reference. Medium tier (55 tasks): full success rate in percent, higher is better, with each entry a coding-agent harness and model pair.

Metric: Full success rate (%; share of the 55 medium expert-curated LAMMPS and GROMACS simulation tasks with every required output quantity within 5% of the reference). Source: arxiv.org. Saturation forecast: Around October 2028. 4 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.67.3#158
2GPT-5.2 Codex3.6#185
3GPT-OSS-20B0#1150
4Qwen3 Coder0#584

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=mdgym-medium · How It Works · Data refreshed daily, snapshot 2026-11-12.