LIBRA - LongContextMultiQ *: leaderboard
LIBRA updated long-context multi-question retrieval subtask, requiring a model to answer several questions from one extended context.
Metric: Dataset Total Score (%). Source: huggingface.co. Saturation forecast: Around 2033. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3 30B A3B 2507 Instruct | 45.96 | #488 |
| 2 | Llama 3.1 8B Instruct | 40.68 | #1035 |
| 3 | Qwen 3.5 35B A3B | 39.04 | #256 |
| 4 | Qwen 3.5 122B A10B | 38.14 | #173 |
| 5 | Qwen 3.5 9B | 37.04 | #379 |
| 6 | Phi-3.5-mini-instruct | 34.92 | #1167 |
| 7 | Qwen 3.5 4B | 34.9 | #475 |
| 8 | Qwen 3.5 2B | 33.39 | #1148 |
| 9 | Qwen 3.5 0.8B | 31.73 | #1424 |
| 10 | LFM2.5-1.2B Instruct | 21.2 | #1462 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=libra-longcontextmultiq-star · How It Works · Data refreshed daily, snapshot 2026-10-20.