TRACE Legislation - Test Top 10 Lenient - monolithic prompt: leaderboard
TRACE Legislation - Test Top 10 Lenient - monolithic prompt: Recall against automated NAZK findings (0-1). TRACE arXiv 2611.14244v1: agreement with model-extracted NAZK legal findings, strict Same and lenient Same+partial recall. Single runs. Claude Sonnet 5.5 low reasoning, Opus 5.5 same settings; monolithic prompt temperature 0 and max output 12000. Native parser/version, split, top-10 versus all-flags, blind/non-blind and Codex/OpenRouter judge routes are kept separate. Gemma local profile is held because source describes FP8 or higher precision, without identifying one released served artifact. This is automated agreement, not human-validated legal correctness.
Metric: Recall against automated NAZK findings (0-1). Source: arxiv.org. 1 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 5.5 (Low) | 0.59 | #18 (Claude Sonnet 5.5) |
Interactive version: theaggregate.ai/benchmark?slug=trace-legislation-test-top-10-lenient-monolithic-prompt · How It Works · Data refreshed daily, snapshot 2026-11-12.