SABER-Math - Statement-Statement: leaderboard
SABER-Math (2026) tests retrieval models on finding mathematically related competition problems: each query problem reranks a pool of 150 candidate problems whose graded relevance comes from pairwise LLM judgments. This board gives queries and candidates as problem statements only, without solutions. Scored as nDCG@10 on a 0 to 100 scale; higher is better.
Metric: Overall nDCG@10 (0-100) with exponential gain, printed 0 to 1 and scaled by 100: each competition or olympiad problem query reranks its own pool of 150 candidate problems, graded 0 to 5 by Bradley-Terry fits of GPT-OSS-120B pairwise relevance judgments over a 20-round Swiss tournament; every system at its default configuration and task instruction, all 1000 queries, statement-statement setting (queries and documents are problem statements only, no solutions); higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 43 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | ReasonEmbed-Qwen3-8B | 68.5 | |
| 2 | RaDeR-14B | 67.7 | |
| 3 | RaDeR-7B | 67.1 | |
| 4 | Diver-4B | 65.9 | |
| 5 | Qwen3-Reranker-4B | 65.3 | |
| 6 | Diver-GroupRank-32B | 65.1 | |
| 7 | ReasonReranker-Qwen3-32B | 64.7 | |
| 8 | RaDeR-3B | 64.4 | |
| 9 | ReasonEmbed-Llama-3.1-8B | 64.3 | |
| 10 | SPLADE-Code-8B | 63.4 |
Interactive version: theaggregate.ai/benchmark?slug=saber-math-statement-statement · How It Works · Data refreshed daily, snapshot 2026-11-13.