SciTrue - Claim Attribution: leaderboard

Honest per-sample development results on NTCIR SciClaimEval. Author runs include structured table data as an auxiliary text channel; official baseline runs and the PNG-only extension are kept on separate protocol boards. Claim validation is macro-F1, evidence pairing requires both paired claims correct, and attribution is Subtask 2 accuracy. This board is the authors’ structured-table-text protocol.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScoreOverall rank
1Claude Fable 597.7#20
2GPT-5.597.4#33
3Claude Opus 4.892.9#39
4Qwen 3.6 35B A3B92#238
5Gemma 4 31B (IT)88.9#178
6Qwen 3.5 35B A3B86.1#268
7Qwen 3.5 9B81.8#391
8gemma-4-E4B-it68.8#577

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=scitrue-claim-attribution · How It Works · Data refreshed daily, snapshot 2026-11-05.