Qasper: leaderboard

5,049 questions over 1,585 NLP papers, written by practitioners from only the title and abstract and answered from the full text with supporting evidence; Allen AI (NAACL 2021); answer F1.

Source: arxiv.org.

Interactive version: theaggregate.ai/benchmark?slug=qasper · How It Works · Data refreshed daily, snapshot 2026-09-05.