Skepthical Study - Machine Learning Numerics: leaderboard

Skepthical tests models and review pipelines on deliberately flawed research papers. Astrophysics and machine-learning results use separate 15-paper cohorts and expert error annotations. Free-form, structured and concise review prompts remain distinct. False-positive rates use all raised flags on the clean-paper controls. This board reports error detection rate (%). Higher is better.

Metric: Error detection rate (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 6 models tracked. Updated 14 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.5Evaluation run: Skepthical Study Concise Structured95.6#52
2Claude Opus 4.7Evaluation run: Skepthical Study Claude Code Concise Structured91.1#78
3SkepthicalEvaluation run: multi-provider pipeline frozen 2026-04-2191.1
4Gemini 3.1 Pro PreviewEvaluation run: Skepthical Study Concise Structured64.4
5PaperAudit_Qwen3_14B_sft_rlEvaluation run: Skepthical Study Deep4.4
6Llama-OpenReviewer-8BEvaluation run: Skepthical Study ICLR Template2.2

Interactive version: theaggregate.ai/benchmark?slug=skepthical-study-machine-learning-numerics · How It Works · Data refreshed daily, snapshot 2026-11-16.