LIBRA - MatreshkaYesNo: leaderboard
LIBRA long-context subtask: answer nested yes/no questions requiring retrieval and reasoning across Matreshka-style contexts up to 128K tokens.
Metric: Dataset Total Score (%). Source: huggingface.co. Saturation forecast: Around 2030. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Llama 3.1 8B Instruct | 75 | #1035 |
| 2 | Phi-3.5-mini-instruct | 73.42 | #1167 |
| 3 | Qwen 3 30B A3B 2507 Instruct | 55.1 | #488 |
| 4 | Qwen 3.5 35B A3B | 46.8 | #256 |
| 5 | Qwen 3.5 122B A10B | 45.73 | #173 |
| 6 | Qwen 3.5 9B | 44.41 | #379 |
| 7 | Qwen 3.5 4B | 41.84 | #475 |
| 8 | Qwen 3.5 2B | 40.03 | #1148 |
| 9 | LFM2.5-1.2B Instruct | 38.83 | #1462 |
| 10 | Qwen 3.5 0.8B | 38.04 | #1424 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=libra-matreshkayesno · How It Works · Data refreshed daily, snapshot 2026-10-20.