NuclearBench - Adversarial Criteria Score: leaderboard
Long-document nuclear regulatory and engineering question answering: models receive the full source document and are graded for rubric criteria coverage and sentence-level faithfulness. NuclearBench (Atomic Canyon with Idaho National Laboratory SMEs): 280 published questions over 247 public NRC and nuclear technical documents; the model receives the question and the complete source document (no retrieval). CriteriaJudge marks each rubric criterion met or not met without the document; criteria score is the mean per-question fraction met. FineSurE classifies each answer sentence against the document; the score is the mean share of error-free sentences. The 125-question holdout is not used. Per-model temperature, reasoning effort and provider pins are kept in the gated models.yaml; the public card names no judge model. Adversarial set (61 questions). Adversarial items plant errors, strip identifiers or pair a mismatched document; refusing or correcting the premise is acceptable. Question access: The question and document files on Hugging Face require accepting access terms (unauthenticated README is public; models.yaml and JSONL return 401). A 125-question holdout is withheld.
Metric: Criteria score (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Fable 5.1 (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 99.5 | |
| 2 | Claude Opus 5.5 (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 97.8 | |
| 3 | Claude Sonnet 5.5 (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 97.8 | |
| 4 | GPT-6 Astra (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 97.8 | |
| 5 | Gemini 3.8 Flash (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 97.4 | |
| 6 | Claude Haiku 5.5 (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 97.3 | |
| 7 | GPT-6.1 Sol (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 96.2 | |
| 8 | DeepSeek V4 Pro (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 95.1 | |
| 9 | Gemini 4 Argon (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 94.5 | |
| 10 | GPT-6.1 Terra (Benchmark Sweep Run: source=NuclearBench; adversarial set; full source document in context; settings in gated models.yaml) | 92.2 |
Interactive version: theaggregate.ai/benchmark?slug=nuclearbench-adversarial-criteria-score · How It Works · Data refreshed daily, snapshot 2026-11-07.