TestEvo-Bench - Test Generation: leaderboard

Metric: Success rate (%; per-task share of target test methods whose agent-written test passes on the new code revision and fails or does not compile on the old one, macro-averaged over 746 test-generation tasks from 152 Java projects; per-task budget of 3 US dollars). Source: arxiv.org. Saturation forecast: Around December 2026. 4 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)68.6
2Claude Opus 4.766.1

Interactive version: theaggregate.ai/benchmark?slug=testevo-bench-test-generation · How It Works · Data refreshed daily, snapshot 2026-09-29.