Skepthical Study - Astrophysics False Positive Flags: leaderboard

Skepthical tests models and review pipelines on deliberately flawed research papers. Astrophysics and machine-learning results use separate 15-paper cohorts and expert error annotations. Free-form, structured and concise review prompts remain distinct. False-positive rates use all raised flags on the clean-paper controls. This board reports clearly false flags / all raised flags on clean copies (%). Lower is better.

Metric: Clearly false flags / all raised flags on clean copies (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked. Updated 14 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 4.7Evaluation run: Skepthical Study Free Form1#78
2GPT-5.5Evaluation run: Skepthical Study Structured3.4#52
3Gemini 3.1 Pro PreviewEvaluation run: Skepthical Study Structured5.6

Interactive version: theaggregate.ai/benchmark?slug=skepthical-study-astrophysics-false-positive-flags · How It Works · Data refreshed daily, snapshot 2026-11-16.