SABER-Math - Full-Full: leaderboard

SABER-Math (2026) tests retrieval models on finding mathematically related competition problems: each query problem reranks a pool of 150 candidate problems whose graded relevance comes from pairwise LLM judgments. This board gives queries and candidates as problems with their full solutions. Scored as nDCG@10 on a 0 to 100 scale; higher is better.

Metric: Overall nDCG@10 (0-100) with exponential gain, printed 0 to 1 and scaled by 100: each competition or olympiad problem query reranks its own pool of 150 candidate problems, graded 0 to 5 by Bradley-Terry fits of GPT-OSS-120B pairwise relevance judgments over a 20-round Swiss tournament; every system at its default configuration and task instruction, all 1000 queries, full-full setting (queries and documents are problems with their solutions); higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 43 models tracked.

Top models

#ModelScoreOverall rank
1ReasonReranker-Qwen3-32B80
2ReasonEmbed-Qwen3-8B79.5
3ReasonEmbed-Llama-3.1-8B75.1
4RaDeR-14B74.1
5RaDeR-7B73.8
6Diver-4B73.7
7Qwen3-Reranker-4B73
8Diver-GroupRank-32B72.9
9Qwen3-Reranker-0.6B71.7
10Qwen3-Reranker-8B71.4

Interactive version: theaggregate.ai/benchmark?slug=saber-math-full-full · How It Works · Data refreshed daily, snapshot 2026-11-13.