PredicateLongBench - Lexicographic Longest (LongBench): leaderboard

Metric: Accuracy (%; share of the 93 LongBench v2 documents under 170K tokens used as word lists whose answer is exactly the one word sequence satisfying the predicate, retrieve the longest lexicographically sorted run; up to 16K output tokens including reasoning, an answer past the cap counts as wrong). Source: arxiv.org. Saturation forecast: Around 2029. 9 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=predicatelongbench-lexicographic-longest-longbench · How It Works · Data refreshed daily, snapshot 2026-09-29.