TRACE Legislation - Test100 Nonblind All Flags Lenient - L1 v1.1, all flags: leaderboard
TRACE Legislation - Test100 Nonblind All Flags Lenient - L1 v1.1, all flags: Recall against automated NAZK findings (0-1). TRACE arXiv 2611.14244v1: agreement with model-extracted NAZK legal findings, strict Same and lenient Same+partial recall. Single runs. Claude Sonnet 5.5 low reasoning, Opus 5.5 same settings; monolithic prompt temperature 0 and max output 12000. Native parser/version, split, top-10 versus all-flags, blind/non-blind and Codex/OpenRouter judge routes are kept separate. Gemma local profile is held because source describes FP8 or higher precision, without identifying one released served artifact. This is automated agreement, not human-validated legal correctness.
Metric: Recall against automated NAZK findings (0-1). Source: arxiv.org. 1 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 5.5 (Benchmark Sweep Run: source=trace_legislation_paper; harness=L1 v1.1, all flags; reasoning=low; judge route=Codex) | 0.46 |
Interactive version: theaggregate.ai/benchmark?slug=trace-legislation-test100-nonblind-all-flags-lenient-l1-v1-1-all-flags · How It Works · Data refreshed daily, snapshot 2026-11-12.