AbstentionBench - answer unknown - BB/Known unknowns - Recall Leaderboard · The Aggregate

AbstentionBench - answer unknown - BB/Known unknowns - Recall: leaderboard

Metric: Abstention Recall (%). Source: github.com. 20 models tracked.

Top models

#	Model	Score
1	Llama 3.1 8B Instruct	100
2	Llama 3.3 70B Instruct	100
3	Llama 3.1 70B Instruct	100
4	Mistral 7B Instruct (v0.3)	100
5	Llama 3.1 405B Instruct	100
6	Gemini 1.5 Pro	100
7	Qwen 2.5 32B Instruct	100
8	O1	100
9	Llama-3.1-Tulu-3-70B	100
10	Llama-3.1-Tulu-3-70B-DPO	100
11	GPT-4o	95.65
12	Llama-3.1-Tulu-3-8B	95.65
13	Llama-3.1-Tulu-3-8B-DPO	95.65
14	Llama-3.1-Tulu-3-8B-SFT	91.3
15	DeepSeek R1 Distill Llama 70B	60.87

Interactive version: theaggregate.ai/benchmark?slug=abstentionbench-answer-unknown-bb-known-unknowns-recall · How It Works · Data refreshed daily, snapshot 2026-09-19.