OpenBookQA: leaderboard
Open Book Question Answering: 5,957 elementary science questions that require combining an 'open book' of 1,326 core science facts with broad commonsense knowledge.
Metric: Accuracy (%). Source: epoch.ai. Status: saturated. 42 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Median Human | 92 |
| 2 | Phi-3 Mini 4K Instruct | 88 |
| 3 | Phi-3-small-8k-instruct | 88 |
| 4 | Phi-3-medium-128k-instruct | 87.4 |
| 5 | GPT-3.5 Turbo (1106) | 86 |
| 6 | Mixtral 8x7B (v0.1) | 85.8 |
| 7 | Llama 3 8B Instruct | 82.6 |
| 8 | Mistral-7B-v0.1 | 79.8 |
| 9 | gemma-7B | 78.6 |
| 10 | Phi-2 | 73.6 |
| 11 | text-davinci-001 | 65.4 |
| 12 | Llama 2 70B Base | 60.2 |
| 13 | LLaMA-65B | 60.2 |
| 14 | Llama 2 7B | 58.6 |
| 15 | LLaMA-7B | 57.2 |
Interactive version: theaggregate.ai/benchmark?slug=openbookqa · How It Works · Data refreshed daily, snapshot 2026-09-05.