TraceEval: leaderboard

Metric: Average F1 (self-reported). Source: benchmarklist.com. 10 models tracked.

Top models

#ModelScore
1Claude Opus 4.672.9
2Claude Sonnet 4.664.5
3DeepSeek V3.262.1
4GPT-5.460
5GPT-5.4 Mini56.5
6Qwen 2.5 Coder 32B Instruct46.6
7Llama 3.3 70B Instruct44.3
8Gemini 3.1 Pro (Preview)31.8
9Qwen 2.5 Coder 7B Instruct27.1
10Qwen2.5-Coder-1.5B-Instruct9.5

Interactive version: theaggregate.ai/benchmark?slug=traceeval · How It Works · Data refreshed daily, snapshot 2026-09-05.