LongListBench - Agentic CLI - Exact Record F1: leaderboard

Models extract structured records from the same released OCR transcripts through agentic command-line tools. Exact-record F1 and weighted F1 measure extraction fidelity across the document corpus. The Agentic CLI track keeps a shared input protocol separate from raw-PDF extraction products and page-level pipelines. This board reports LongListBench - Agentic CLI - Exact Record F1 using Exact Record F1 (%).

Metric: Exact Record F1 (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.6 Sol98.66#22
2Claude Opus 4.897.83#39
3Claude Fable 597.08#20
4GPT-5.596.59#33
5GPT-5.6 Terra95.58#40
6GPT-5.6 Luna94.68#79

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=longlistbench-agentic-cli-exact-record-f1 · How It Works · Data refreshed daily, snapshot 2026-11-05.