LongZero - FRAMES: leaderboard

LongZero: two-run means, temperature 0.7 and top-p 0.95; Qwen3-8B uses 4x YaRN at evaluation. Enhanced HotpotQA, Teacher QA and LongZero are separately trained research checkpoints, not aliases of original weights. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 4B 2507 (Thinking)51.27#535 (Qwen 3 4B 2507)
2Qwen 3 8B (Thinking)48#678 (Qwen 3 8B)

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=longzero-frames · How It Works · Data refreshed daily, snapshot 2026-10-23.