Pyrite - Reasoner Full 484 - Interactions + Raw 3D: leaderboard
Pyrite - Reasoner Full 484 - Interactions + Raw 3D: Pairwise pose-ranking accuracy (0-1). Pyrite arXiv 2611.14511v1 Tables 2-3: pairwise pose-ranking accuracy (0-1), mean and 95% confidence interval. Post-AF3 curated 265 pairs and full 484 pairs remain separate. PyriteReasoner prompt/input ablations and PyriteFeaturizer code/LLM-subcall feature discovery plus pre-AF3-trained logistic regression remain separate native runs. Paper names four unmodified backbones; effort, decoding and exact dated API snapshots are not reported. GRPO-trained rows are held without a released checkpoint identity.
Metric: Pairwise pose-ranking accuracy (0-1). Source: arxiv.org. Saturation forecast: Around August 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.8 27B | 0.64 | #199 |
| 2 | GPT-5.6 Sol | 0.61 | #29 |
| 3 | Claude Opus 4.8 | 0.6 | #56 |
| 4 | Claude Sonnet 5 | 0.55 | #108 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=pyrite-reasoner-full-484-interactions-plus-raw-3d · How It Works · Data refreshed daily, snapshot 2026-11-12.