LongDS v1.1 Full - Community: leaderboard
The Community domain of LongDS v1.1 Full: 16 long-horizon data-analysis tasks built from Kaggle notebooks and datasets, where each model runs under one vendor's agentic coding harness (Claude Code, Codex, Kimi Code or Qoder). Later turns update, perturb, roll back or combine analytical states set up earlier; a judge scores each turn against executable reference code, and the score is turn accuracy macro-averaged over tasks, in percent.
Metric: Accuracy (%; judged turn accuracy macro-averaged over 16 tasks), each model under one agentic coding harness. Source: zjunlp.github.io. Saturation forecast: Around February 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol | 77.06 | #29 |
| 2 | Qwen 3.8 Max (0902) | 76.87 | #49 |
| 3 | Kimi K3 | 76 | #53 |
| 4 | GLM-5.2 | 74.47 | #137 |
| 5 | DeepSeek V4 Pro | 57.54 | #181 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=longds-v1-1-full-community · How It Works · Data refreshed daily, snapshot 2026-11-12.