Llama-3.1-OpenScholar-8B — benchmark results
University of Washington and Ai2's Llama 3.1 8B fine-tune powering OpenScholar, a retrieval-augmented system for citation-backed scientific-literature synthesis. Provider: Meta. Released 2024-11-15. Access: Open.
Unified ELO 1445 ± 23, rank #1026 of 1776 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - IFEval | 60.64 | Score | 72.5 |
| Open LLM Leaderboard - MATH Level 5 | 16.54 | Score | 64.8 |
| Open LLM Leaderboard - MuSR | 11.84 | Score | 63.8 |
| Open LLM Leaderboard - BBH | 32.4 | Score | 61.1 |
| Open LLM Leaderboard - MMLU-Pro | 30.09 | Score | 60.5 |
| Open LLM Leaderboard - GPQA | 4.25 | Score | 36.8 |
| FACTS Leaderboard | 24.15 | Combined Score (%) | 31.8 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-openscholar-8b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.