CarryoverBench - Instant ASR: leaderboard
CarryoverBench:nanobot persistent-agent runtime,101attack variants and12benign tasks;temp0,sharedprompt/tools. Instant single-shot and Autonomous/Latent any-fire over5followups; utility task-weighted artifact rubric. Qwen3-235B-A22B main run disables thinking; other requested efforts unspecified. Defense/runtime ablations are separate experiments. Rate (%).
Metric: Rate (%). Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.6 | 22.9 | #92 |
| 2 | GPT-5.4 | 22.9 | #82 |
| 3 | GLM-5 | 34.3 | #140 |
| 4 | Qwen 3 235B A22B (Non-reasoning) | 57.1 | #315 (Qwen 3 235B A22B) |
| 5 | Gemini 3.1 Pro (Preview) | 60 | #60 |
No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=carryoverbench-instant-asr · How It Works · Data refreshed daily, snapshot 2026-10-22.