GACC-Bench (10% budget) - Micro accuracy: leaderboard
GACC-Bench-full (500 goals, 2,571 questions over 281 contexts from seven long-document and agent-trace collections). The listed model is the goal-conditioned compressor; questions are withheld from it. A fixed DeepSeek-V4-Pro reader answers each question from the compressed context and a fixed DeepSeek-V4-Pro judge scores it against the reference (98.25% human agreement on 114 sampled responses). Retention budget 10% of source-context tokens. Micro accuracy is the percentage of individual questions answered correctly. Model labels as printed; reasoning or effort settings are not disclosed. Full-context reference: 99.38 Micro / 96.80 Macro; no-context: 6.46 / 0.20. Metric: Question accuracy (%). Higher is better. Source: https://arxiv.org/html/2610.21893v1
Metric: Question accuracy (%). Source: arxiv.org. Saturation forecast: Around 2029. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 57.41 | #6 |
| 2 | GPT-6.1 Sol | 56.4 | #7 |
| 3 | GLM-5.3 Flash | 50.8 | #63 |
| 4 | GLM-5.3 | 48.46 | #40 |
| 5 | Kimi K3 | 45.62 | #29 |
| 6 | Qwen 3.8 Max | 44.96 | #32 |
| 7 | Claude Opus 5.5 | 43.95 | #4 |
| 8 | GPT-5.6 Sol | 43.21 | #20 |
| 9 | DeepSeek V4 Pro | 42.4 | #102 |
| 10 | Gemini 3.6 Flash | 33.68 | #51 |
No result here: #8 Gemini 4 Argon, #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=gacc-bench-10-budget-micro-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-18.