PredicateLongBench - Lexicographic Locate (LongBench): leaderboard

Metric: Accuracy (%; share of the 93 LongBench v2 documents under 170K tokens used as word lists whose answer is exactly the one word sequence satisfying the predicate, locate the lexicographically sorted run as long as the longest in the document, no decoys; up to 16K output tokens including reasoning, an answer past the cap counts as wrong). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=predicatelongbench-lexicographic-locate-longbench · How It Works · Data refreshed daily, snapshot 2026-09-29.